data integration using goldengate

7/31/2019 Data Integration using GoldenGate

1/18

Data integration for Real Time BI using GoldenGate

David YahalomCTO

Naya Technologies

tech.co.il-www.naya

tech.co.il-davidy@naya
http://www.naya-tech.co.il/http://www.naya-tech.co.il/http://www.naya-tech.co.il/mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]://www.naya-tech.co.il/http://www.naya-tech.co.il/http://www.naya-tech.co.il/


2/18

DATA Platform;,Oracle-MS.

,.

24X7

.

.

150"

:Oracle Gold Partner, Microsoft Silver Learning Partner


3/18

Oracle GoldenGate

Oracle GoldenGate software enables real-time, continuous

movement of transactional data across operational and analytical

business systems.

Real-Time Access

to

Real-Time Information

Real-Time Access

Availability: the degree to

which information can be

instantly accessed.

Real-Time Information

Integration: the process of

combining data from different

sources to provide a unified view.

Mission-Critical

Systems

Business challanges


4/18

Real-timeinformation

Database and

applications, Mixedsources, distributedsystems, legacy,

OLTP, OLAP

Mission Critical

Applications & Data,Business Intelligence,

Reporting forCustomers, Partners

& Employees

Real-time Access

Real time data integration


5/18

GoldenGate benefits

Oracle GoldenGate provides low-impact capture, routing,

transformation, and delivery of database transactions acrossheterogeneous environments in real time

Real TimeMoves with sub-second latency

HeterogeneousMoves changed data across

different databases and platforms

TransactionalMaintains transaction integrity

Key Capabilities:

Performance

Extensibility &

Flexibility

Reliability

Additional Differentiators:

Log-based capture moves

thousands of transactionsper second with low impact

Meets variety of customer

needs and data

environments with open,

modular architecture

Resilient against

interruptions and failures


6/18

TRANSACTIONALDATAINTEGRATION

Solutions overview


7/18

Key solutions


8/18

Two BI examples:

Realtime operational BI.

Realtime data integration BI.


9/18

Solution Query Offloading

Cost Reduction

Improve Resource Utilization

Find a solution that can transfer our data in real-time, keeping up with datavolumes and meet future business needs. In actuality, GoldenGate was theonly solution that handled all three requirements with ease.

J Seelan, DBA Manager, 1-800-Flowers.com


10/18

Query

Offloading Benefit:

Offloads Queries - reduces load on

transactional systems.

Leverage existing investment in physical

standby database. Replicate parts of the database as required.

Improve performance: indexes, MViews...

Reduce/Eliminate query load on

transactional systemOracle PhysicalStandby Database

OLTP

Transactions

Read Only

Users

GG

OraclePrimary Database

Improve Resource Utilization

Non-Oracle orLegacy Platform


11/18

Consumer case study

CHALLENGES / OPPORTUNITIES

Optimize OLTP system performanceoffload all query activity

Reduce TCO via platform changes andsegment lookers from bookers

Handle growing data volumes and

support heterogeneous systems over life-cycle of Air Travel Shopping Engine(ATSE)

Maintain data integrity across all systems

GoldenGate PROVIDES

Supports 1.6TB of data movement per day toread-only servers

Source Oracle 10g | Target MySQL

Current plans to migrate to Oracle 11g onboth source and target.

RESULTS

80% TCO Reduction Millions $$ saved

COMPANY OVERVIEW

A world leader in the travel marketplace,Sabre Holdings merchandises and retailstravel products and provides distribution andtechnology solutions for the travel industry

Bookers vs Looke

rs


12/18

Solution Real-time Data Integration

Operational Reporting Real-time Business Intelligence

Accessing the data in real time using GoldenGate we canimmediately see if were profitable and if our business processesare working.

- Sam Peterson, SVP Technology, Overstock.com


13/18

TransactionalApplications

OperationalData Store

OGG

Real Time DataIntegration

Benefit:

Report on live data in transactional systems.

No additional load on source system

offload reporting to a database instance that

is synchronized in real time.

Enables tactical reports quickly for decisionmaking and business transparency.

Removes impact from source systems.

Avoids the political challenges of running

reports on transactional systems.


14/18

HeterogeneousSources

Enterprise Data Warehouse

Oracle Database,Oracle Exadata

Production

Real-time Integration + BulkData Transformation

OGG

ODI

Real Time Data

Integration Benefit:

Populate an operational data store for

operational BI with real-time data.

Run ELT from the ODS to load data

warehouse with transformed data. Eliminates load on source systems.

Reduces latencies and batch windows.


15/18

EMP

22

OracleGoldenGate

ETL

EMP DEPT

DIM

FACT

DIM

DIMDIM

ODS Schema DW Schema

On-Disk Logs

Source 1

On-Disk Logs

Source 2

OracleGoldenGate

Oracle GoldenGate Real time extracts from

transactional systems Non-invasive on sources

Continuous streaming loadinto ODS Schema of target

Latency in seconds

Oracle Data Integrator EE High Performance E-LT on

target data warehouse Periodic mini-batches (15 min) Transform in the Database Never go back to sources

EMP DEPT

DEPT


16/18


Maintain high quality customer servicein competitive market reduce churn!

Centralize customer information for asingle view to support sales, marketing,

support & field service Significantly reduce data latency in

central data warehouse for all queries &reports edict for < 15 minutes!

GoldenGate PROVIDES

Real-time data integration from Siebel CRMon Oracle to central Teradata Warehouse

1,500 service agents log 600,000 customercalls p/day

GoldenGate moves 150-200 million recordsper day with 1.5 second latency.

RESULTS

Significantly reduced churn by 25%

All business units have access to real-timebusiness data.

COMPANY OVERVIEW

DIRECTV is a $17 billion provider ofsatellite-based television services.DIRECTVs 7,500 employees operate thecompanys broadcast centers, monitorsatellites, and deliver service to about 17million U.S. and over 5 million Latin

American customers.

Another case study


17/18

One more case study


Better understand customer purchasingbehavior

Provide timely information to supportmarketing, merchandising and

operational decisions Improve shopping database reliability

and uptime

GoldenGate PROVIDES

Support for high availability & disastertolerance across Oracle production sites

Zero-downtime system migration andupgrade

Enable active data warehouse roll-out in 90days with real-time data feeds

Complements Oracle Data Integrator fordata transforms on target

RESULTS

Customer analysis now done in minutes,rather than days

Dashboard reports using real-time data forP&L & customer profitability

Google Adwords adjusted based on real-time data reports Ranked #4 in customer service by National

Retail Federation

COMPANY OVERVIEW

Overstock.com is an online closeoutretailer offering high-quality, brand-namemerchandise, including bed-and-bathgoods, home dcor, kitchenware, watches,

jewelry, electronics and computers, sportinggoods, apparel and designer accessoriesamong other products at discount prices


18/18

How GoldenGate works?

Source

Database(s)

Target

Database(s)

Network

(TCP/IP)

Route: Data is compressed, encrypted for routing to targets.

Capture: Committed changes are captured (and can befiltered) as they occur by reading the transaction logs.

Capture

Trail files: Stages and queues data for routing.

Source

Trail

Delivery: Applies data with transaction integrity,

transforming the data as required.

Target

TrailDelivery

data integration using goldengate

Documents