p.19 pts odi11g goldengate

8/10/2019 P.19 PTS ODI11g GoldenGate

1/17

Copyright 2010, Oracle. All rights reserved.


2/17

Oracle Data IntegratorODI and GoldenGate

PTS Workshop: ODI 11g


3/17


Insert Picture Here

Agenda

GoldenGate Overview

ODI JKM for GoldenGate

Lab Overview

Q&A


4/17


GoldenGate Overview


5/17


Oracle GoldenGateThe Solution for Enterprise-wide Real Time Data Needs

Real-time

information

Oracle GoldenGate delivers real-t ime access of real-t ime information, enablin g

com panies to dramat ical ly imp rove the avai labi l i ty , rel iabi li ty , and performance

of cr i t ical data across enterpr ise systems.

Database and

appl icat ions, Mixed

sourc es, dist r ibu ted

sys tems, legacy,OLTP, OLAP

Mission Cri t ica l

App l ica t ions &

Data, Bu sin ess

Intell igence,Report ing for

Customers,

Partners &

Employees

Real-time Access


6/17


Oracle GoldenGate SolutionsEnterprise-wide Solution for Real Time Data Needs

Standardize on Single

Technologyfor MultipleRequirements

Deploy for ContinuousAvailability andReal-time Data

Access for Reporting / BI

Highly Flexible

Fast Deployments

Lower TCO & Improved ROI

Log Based, Real-Time Change Data

Capture

HeterogeneousSource Systems

EDWODS

EDW

Standby

(Open & Active)

ReportingDatabase

OGG

ETL

ETL

Operational

Reporting

Real-time BI

QueryOffloading

DataDistribution

Zero DowntimeMigration and

Upgrades

DisasterRecovery, Data

Protection


7/17


How Oracle GoldenGate Works

Modular De-Coupled Architecture

LAN/WAN

InternetTCP/IP

Bi-directional

CaptureTrail

Pump DeliveryTrail

SourceDatabase(s)

TargetDatabase(s)

Capture: committed transactions are captured (and can befiltered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed,encrypted for routing to target(s).

Delivery: applies data with transactionintegrity, transforming the data as required.


8/17


EMP

Oracle Real Time Data Integration

Oracles Unique Offering for Real Time Business Intelligence

Oracle

GoldenGate

Oracle DataIntegrator

EMP DEPT

DIM

FACT

DIM

DIMDIM

ODS Schema DW Schema

On-Disk Logs

Source 1

On-Disk Logs

Source 2

Oracle

GoldenGate

Oracle GoldenGate

Real time extracts from

transactional systems

Non-invasive on sources

Continuous streaming load

into ODS Schema of target

Latency in seconds

Oracle Data Integrator EE

High Performance E-LT on

target data warehouse

Periodic mini-batches (15 min)

Transform in the Database

Never go back to sources

EMP DEPT

DEPT


9/17


ODI JKM for GoldenGate


10/17


Transactional

RDBMS

Source Systems ODI Staging & TargetSource DBs

ODI J$Tables Target

EDW

ReplicatedSource Tables

TargetTablesReplicated

Source Tables

SourceTables

J$

ODI-EE Integration with GoldenGateNon-invasive Data Capture combined with ODI ELT strengths

Key Benefits:

1. Eliminate Overheadno need for DB API overhead on the Source, or the

invasiveness of the ODI J$ objects on the Source system,2. Automate GoldenGateautomation of GG deployment directly fromODI GUI

3. Provide Common DW Patternsupplies a common pattern for mini-batch style(non-real-time) DW aggregate loads

Key Consideration: not recommended for hard real-time requirements (use GG only)

ODI(w/GG JKM Consistent)

Generate all GG deployment files

Generate all ODI CDC infrastructure Execute end-to-end CDC

ODI CDCFramework


11/17


Data Integrator-GoldenGate

Journalizing Knowledge Module

Combines best-of-breed CDC from GoldenGate withbest EL-T from Data Integrator

Automates generation of GoldenGate configurationbased on ODI metadata

GoldenGate JKM adheres to ODI Journalizingframework

First release supports Oracle-to-Oracle loading with

ODI Consistent CDC


12/17


GG ODI JKM Setup

Staging Target

OGGExtract

OGGReplicat

ODI +

GG JKM

Source Server

Oracle DB

Generate

Conf igurat ion

Files

CDCTrans-

format ion

Source

Oracle DB

Target Server


13/17


Lab Overview


14/17


Lab Objectives

In this lab, you will learn how to :

Use Journalizing Knowledge Module for Oracle GoldenGate to manage OracleData Integrator CDC infrastructure and automatically generate the configurationfor Oracle GoldenGate

Part 1: Enable Staging model for CDC

Part 2: Configure Oracle GoldenGate using generated files Staging tables are enabled for CDC and generate OGG scripts to perform

replication from source to staging

Part 3: Initialize load to Staging and Target tables Initialize both staging and target areas with pre-existing source data by performing

1-to-1 copy from source table to staging table and bulk load & transformation fromstaging to target table

Part 4: Initialize CDC process and perform change operations OGG detects changes in the source and replicates them to the staging table in

real-time ODI is informed of changes arriving in the staging table through its standard CDC

framework ODI CDC module for GoldenGate picks up the change and moves the data to

target by performing a CDC-triggered load & transformation from staging to target


15/17


GG ODI JKM Demo Setup

Source Staging Target

GGExtract

GGReplicat

ODI +

GG JKM

Workshop Machine (Linux)

Oracle DB

Generate

Conf igurat ionFiles

CDC Transformat ion


16/17



17/17


p.19 pts odi11g goldengate

Documents