improving your business with oracle · pdf file–fix quality at the source ......

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Improving Your Business with Oracle Data Integration See How Oracle Enterprise Metadata Management Can Help You

Özgür Yiğit Oracle Data Integration, Senior Manager, ECEMEA


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


Agenda

• Oracle Data Integration Overview

• Introducing Oracle Enterprise Metadata Management

• Oracle Enterprise Metadata Manager Drill Down

• Q&A and For More Information

1

2

3

4


Oracle Data Integration Platform

Real-Time Data Movement – Low impact capture, stage in Hadoop – Continuous data availability

Data Transformation – Bulk data movement – Pushdown data processing

Data Federation – Virtualized Data Services

Data Quality & Verification – Fix quality at the source – Verify data consistency

Metadata Management – Lineage and Impact Analysis – Business Glossary Semantics

Data Governance Foundation

Oracle Data Integrator (Transformation)

Enterprise Data Quality (Profile, Cleanse, Match and De-duplicate)

Fast Load

Oracle GoldenGate (Movement)

Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance)

Data Service Integrator (Federation)

GoldenGate Veridata (Online Data Verification)

ELT Processing on Hadoop or SQL

Continuous Availability


Data Governance Foundation

Differentiated Technical Approach

Dynamic Data Movement – Real-time CDC is by default, not ETL – Least invasive on sources – Proven best performance – Integrated Oracle capture/apply

No ETL Engines – Take the processing to the data;

don’t move the data to the process – Leverage your data engines for the

workloads (Hadoop or SQL)

Most Heterogeneous – Leverage open source Hadoop, not

proprietary distributions – Hadoop is the Hub, not ETL tools – Open metadata standards

Oracle Data Integrator (Transformation)

Enterprise Data Quality (Profile, Cleanse, Match and De-duplicate)

Fast Load

Oracle GoldenGate (Movement)

Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance)

Data Service Integrator (Federation)

GoldenGate Veridata (Online Data Verification)

ELT Processing on Hadoop or SQL

Continuous Availability


Agenda





1

2

3

4


Oracle Enterprise Metadata Management Trust your data

Executives Dashboards / Reports

!=

!!! ???

•Dashboard does not match report? •Where did this data come from? •Can I trust my other dashboards and reports?


Oracle Enterprise Metadata Management Data Lineage Impact Analysis

DBA’s / ETL / BI Developers Data Mgmnt. / Development Env.

•What impact on does my column change have? •What impact does my ETL mapping have? •I want to create new assets from my metadata!!

?? !! ??


Value of Enterprise Metadata Management Solves a significant pain point

ETL

BI Dashboards

App

ETL

ETL

How was sales figure calculated?

What will happen if I change this

table?

What reports use the mainframe

data? Sys Admin

Executive

BI Developer

Where did this data

come from?

Application User

Which reports use this

customer data?

CDC

Hadoop Data Lake

Data Steward

Can I trust the sources of this

customer data?

ETL

Developer

I want to design an experiment to measure the

success of a signup page. What data do I have?

Data Scientist

GG


Introducing Oracle Enterprise Metadata Management


Oracle Enterprise Metadata Management Packaged for two offerings:

Oracle Enterprise Metadata Management Fully featured enterprise edition product

Oracle Metadata Management for Oracle Business Intelligence Limited for use with Oracle technologies

Key Features:

Report to Source Lineage

Impact Analysis

Model Versioning

Annotations and Tagging

Supports Metadata Standards

Business Glossary

3rd Party BI Metadata

3rd Party ETL Metadata

3rd Party DB Metadata

Big Data Ready


Data Discovery Analytics

Oracle Metadata Management Logical Architecture Actionable Information

Data Lin

eage

Imp

act

An

alys

is

ETL Data Quality

Data Integration

Replication Messaging

Data Federation

File Based Cloud

Data Sources

Big Data Relational Applications

Business

Glossary

Metadata

Repository

Semantic

Linking


Exploring Metadata

Text Search and Metadata Browser,

Model/Diagram Visualizers, Birds-eye View, Metadata Reporting

Data Flow and Lineage Analyzer

Sarbanes-Oxley Act (SOX) Compliance

Versioning and Model Compare

URI Based Call back from BI reports or Business applications

Stewardship Collaboration

Feedback Comments and Review Board

Metadata Tagging with Labels

Multimedia attachments (documents, videos, presentation, code)

URL link references for e-mail, blogging, social networking

Detailed Feature List Lifecycle Change Management

Metadata Harvesting from any DM, DW, ETL/DI, BI Tooling and Big Data/Hadoop

Enterprise Architecture Management (Metadata Configuration Management)

Impact of Change

Data Standardization & Data Governance

Supports Variety of Metadata Standards

Annotations and Tagging

Business Glossary with Semantic Lineage

Oracle Integrated

Oracle Database

Oracle Data Integrator, Oracle GoldenGate

Oracle Business Intelligence Enterprise Edition

Oracle Business Intelligence Applications (ODI and older Informatica based OBIA)


Metadata Harvesting from all Popular Platforms


Agenda





1

2

3

4


OEMM Home with Repository Panel and Bookmarks

Deploys as a web based application

with an attached metadata repository


Graphical Browser for Data Model Diagrams

Birds-eye-view metadata

viewer enables zoom-in / zoom-out

around complex

metadata models


Keyword Based Search on all Metadata

Full index text search

provides simple

navigational access to very

large metadata models


Versioning with Model Comparisons

Easily group and compare data models from similar databases or

between different

versions to determine

crucial differences


Social Collaboration for Stewardship Teams

Complete team-based environment

including support for

reviewing the lifecycle of terms and domains


End-to-End Data Flow Architecture Views

See how systems are connected

while visualizing

annotations and system boundaries


Reporting System Calculations

Drill into formulas and calculations

that are directly

harvested from ETL and BI Reporting engines


Find Data Provenance from the Report Layers

Visualize column and calculation

level dependencies

across systems, databases and

reporting views


Business Glossary is Built In (not a separate add-on)

Going beyond database

dictionaries, link business terminology

across metadata

models and systems


Business Glossary Policies and Reference Data

For code tables and value

ranges, associate glossary

metadata to valid data

Terms, Types and

Relationships


Questions and Answers


Join the Community

#OOW14 #ODI12c #GoldenGate12c #EDQ12c

Oracle Data Integration blog

blogs.oracle.com/dataintegration

Connect with Oracle on Social Media

OR connect via the web

Oracle Data Integration Home Page

oracle.com/goto/dataintegration

improving your business with oracle · pdf file–fix quality at the source ......

Documents