Architectures (ETL/ELT)

ELT (Extract Loading  And Transformation)

ETL(Extarct Transformation And Loading)

Oracle Data Integrator (ODI) is an E‐LT (Extract, Load and Transform) tool used for high‐speed data movement between disparate systems.

•

ODI is based on metadata .This metadata is stored in a centralized metadata repository

Metadata means data about data. In other words it describes the information system and its contents

It provides faster approach for integration.

So that  ODI is simpler and faster integration.

What is Oracle Data Integrator

• It is a ELT tool
• It is an integration platform. It is used to move and transform information across the Information system servers.
• It is also a development platform. It follows business-rules driven approach and E-LT approach for developing datawarehouses.
• Using business approach the developer can focus his efforts on the business side of integration instead of focusing on the technical aspects.
• ELT means extacting , Loading and then transforming. But the traditional approach like informatica, data stage follows ETL exttracting, transforming and then loading. ODI does not run or execute the integration process by itself. It takes the advantage or help of a process that leverages existing systems.
• ODI approaches ELT which eliminates middle tier server to perform transformations required when moving large volume of data.It improves performance and reduces integration costs.

DAY WISE CONTENT

Datawarehousing Concepts:

• Physical and Logical Data modeling
• Creating Physical tables and schemas
• Creating Oracle Queries
• Data base installations
• Dataware house concepts
• Star Schema , Snowflake Schema and Galaxy Schema
• SCD Types  ( slowly changing dimentions)
• Dimentional modeling
• Data modeling
• ODI Installations
• Weblogic Installations and configurations
• Oracle Data Integrator 11G New Features Overview

Course Objectives:

• Overview of the architecture of the complete Oracle Data Integrator system

• Define the Information System architecture

• Get started with projects in Oracle Data Integrator and release your work for deployment

• An overview of models, reverse-engineering model metadata from your database, and how and why to flesh out models with missing metadata

• Manage metadata in Oracle Data Integrator: models and data quality

• Create simple interfaces and add multiple sources to an interface

• Launch a session to run an interface

• Enforce data quality constraints in an interface

• Manage packages

• Add more advanced integration components

• Customize data flow and get the best performance out of your system

• An overview of sessions, use Operator to monitor, stop and start sessions, and basic troubleshooting.

Introduction :  DAY1

·  Identifying the Course Content

·  What is Oracle Data Integrator?

·  Why Oracle Data Integrator?

·  Overview of ODI 11g Architecture

·  Overview of ODI 11g Components

·  About Graphical Modules

·  Types of ODI Agents

·  Overview of Oracle Data Integrator Repositories

Administering ODI Repositories and Agents: DAY 2

·  Administrating the ODI Repositories

·  Creating Repository Storage Spaces

·  Creating and Connecting to the Master Repository

·  Creating and Connecting to the Work Repository

·  Overview of ODI Topology

·  About Data Servers and Physical Schemas

·  Defining the Physical Architecture

·  Defining the Logical Architecture

·  Mapping Logical and Physical Resources

·  Defining Agents

·  Defining a Topology

·  Planning the Topology

Describing the Physical and Logical Architecture : DAY 3

·  Overview of Topology Navigator

·  Creating Physical Architecture

·  Creating a Data Server

·  Testing a Data Server Connection

·  Creating a Physical Schema

·  Creating Logical Architecture

·  Overview of Logical Architecture and Context Views

·  Linking the Logical and Physical Architecture

Setting Up a New ODI Project : DAY 4

·  Overview of ODI Projects

·  Creating a New Project

·  Using Folders

·  Organizing Projects and Folders

·  Understanding Knowledge Modules

·  Exchanging ODI Objects

·  Exporting and Importing Objects

·  Using Markers

Oracle Data Integrator Model Concepts :  DAY 5

·  What is a Model?

·  Understanding Metadata in ODI

·  Understanding Reverse Engineering

·  Creating Models

·  Organizing Models

·  Creating Data stores

·  Using Constraints in ODI

·  Creating Keys and References

Organizing ODI Models and Creating Data stores : DAY 6

·  What is an Interface?

·  Business Rules for Interfaces

·  What is a Mapping?

·  What is a Join?

·  What is a Filter?

·  What is a Constraint?

·  What is a Staging Area?

·  Creating a Basic Interface

ODI Interface Concepts  : DAY 7

·  What is an Interface?

·  Business Rules for Interfaces

·  What is a Mapping, Filter, Join?

·  Overview of Integration Process

·  What is a Staging Area?

·  About Execution Location

·  Using Knowledge Modules (KM) with ODI Interface

·  Creating a Basic Interface

Designing Interfaces : DAY 8

·  Designing an Interface

·  Multiple Source Data stores

·  Creating Joins

·  Filtering data

·  Disabling Transformations

·  Overview of the Flow

·  Specifying the Staging Area

·  Selecting Knowledge Modules

Interfaces: Monitoring and Debugging : DAY 9

·  Monitoring Interfaces

·  Using Operator

·  Viewing Sessions and Tasks

·  How to Monitor Execution of an Interface

·  How to Troubleshoot a Session

·  Keys to Reviewing the Generated Code

·  Working with Errors

·  Tips for Preventing Errors

Designing Interfaces: Advanced Topics : DAY 10

·  Using Business Rules in Interfaces

·  Overview of Business Rule Elements

·  Using variables

·  Using User Functions

·  Using Substitution Methods

·  Modifying a KM

·  Developing Your Own KM

·  Using RKM for Customized Reverse Engineering

Using ODI procedures : DAY 11

·  What is a Procedure?

·  Examples of Procedures

·  Creating Procedures

·  Adding Commands

·  Adding Options

·  Running a Procedure

·  Using Operator to View Results

Using ODI Packages : DAY 12

·  What is a package?

·  Creating a package

·  Executing a package

·  Creating Advanced Packages

·  Error handling

·  Controlling an Execution Path

·  Creating a Loop

·  Using the Advanced tab

Managing ODI Scenarios and Versions :  DAY 13

·  What is a Scenario?

·  Managing Scenarios

·  Preparing Scenarios for Deployment

·  Automating Scenario Management

·  Scheduling the ODI Scenario

·  Overview of ODI version management

·  Using Version Browser and Version Comparison Tool

·  Handling concurrent changes

Designing Agents,Load Balancing DAY 14

·  Managing ODI Agents

·  Creating a Physical Agent

·  Launching a Listener, Scheduler and Web Agent

·  Example of Load Balancing 

·  Scheduling serial or parallel conditionally

Enforcing Data Quality and Auditing Data with ODI : DAY 15

·  Why Data Quality?

·  When to Enforce Data Quality?

·  Data Quality in Source Applications

·  Data Quality Control in the Integration Process

·  Data Quality in the Target Applications

·  Enforcing Data Quality(STATIC AND FLOW CONTROL)

·  Exploring Your Data

·  Auditing Data Quality

Working with Changed Data Capture :DAY 16

·  Overview of ODI version management

·  Techniques of Changed Data Capture

·  Changed Data Capture in ODI

·  CDC Strategies and Infrastructure

·  CDC Consistency

·  Using CDC

·  Viewing Data/Changed data

·  Using Journalization 

Administering ODI Resources: Advanced Topics 

·  Using Open Tools

·  Installing Open Tools

·  Using Open Tools in a Package

·  Using Open Tools in a Procedure or in a KM

·  Developing Your Own Open Tools

·  Setting Up ODI Security

·  Defining Security Policies

·  Defining Password Policies

 Installations & Configurations : 

·  Oracle 11G Database.

·  ODI 11G

·  Weblogic Server 11G

·  Configurations