oracle · fotl’s edq journey april –july 2016 october - december 2016 september - december 2017...

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |

CON-6656

Oracle Enterprise Data Quality

Overview and Roadmap

Mike MatthewsSenior Director, Product Management

October 3rd 2017


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |

Develop & Deploy

Integrate & Extend

Oracle Cloud Platform

3

Analyze & Predict

Secure & Manage

Innovate with a Comprehensive, Open, Integrated and Hybrid

Cloud Platform that is

Highly Scalable, Secureand Globally Available

Publish & Engage


Data Management

Oracle Cloud Platform

4

Identity & Security

Application Development Content & Experience

Systems Management

Analytics and Big Data

HybridComprehensive Open Integrated

Oracle Data Center

Oracle Public Cloud

Your Data

Center

Oracle Cloud at Customer

Enterprise Integration

Data Integration

Built on High Performant Oracle Cloud Infrastructure


Oracle Cloud Platform Momentum

5

14,000+Oracle

Customers

$1.4 BillionFY17 Oracle Cloud

Revenue(60% YoY Growth )

3,000+Apps in the

Marketplace

10 PaaSCategories where

LeaderOracle is a

Industry

Cloud Platform Oracle Cloud

Analysts

According to

Platform

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |10/3/2017 6Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |

Application and Data Integration

Complete

Simplified

Open

DATA GOVERNANCE

PROCESSAUTOMATION

STREAMANALYTICS

API MANAGEMENT

APPLICATIONINTEGRATION

DATA QUALITY

BULK DATA TRANSFORMATION

REAL TIME DATA STREAMING AND DATA

REPLICATION

Oracle Cloud Platform for Integration

6

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 7

Oracle Enterprise Data QualityOverview and Update


Summary• Market-leading DQ Platform for

Business Users

• Single DQ Platform for all Oracle

Cloud Services

• Roadmap for fully integrated DQ and

Data Governance in the Cloud


8


EDQ · Usability

Oracle Enterprise Data Quality is the market-leading Data Quality Management tool for non-technical users.

• Accelerate your data insights with fast data ingestion, manipulation and profiling

• Engage Business Users directly with the data they know

• Collaborate to understand and improve your data

• Design reusable Data Services that integrate easily in any application or data flow


EDQ · Governance Features

Use EDQ’s extensive Collaboration and Governance features to engage Stakeholders, and to give flexible rule management, review and remediation options to Data Stewards when they need to change rules or make manual decisions

• Simple management of Business Rules for data quality without the need to modify DQ services

• Zero training user-tailorable Data Quality Dashboard for KPI monitoring and trend analysis

• Highly flexible Case Management application for data stewards to review data quality issues and make decisions

Data StewardsData StakeholdersData Analysts


EDQ · Data Diversity and Specialism

EDQ is data agnostic and offers unparalleled time-to-value with any type of data in any language. It also provides out-of-the-box, pre-integrated, tailorable, services and tools for common data domains such as Customer and Product Data.

Customer Data Services

Product Data Services

• Individual• Name Validation, Standardization and Transliteration• Gender Derivation and Standardization• Matching

• Entity• Name Validation, Standardization and Transliteration• Matching

•Address• Address Verification, Enhancement, Search• Matching• Country and Nationality Validation and Standardization

• Email• Validation and Standardization

• Product• Profiling• Extraction (Colors, Units of Measure, Size, Dimensions)• Abbreviation and Standardization• Matching

REST/SO

AP

Web

Services

Oracle Cloud Services

Other Cloud Services and Applications

DIPC EDQ Platform

Over 100 standard tools for any type of data

Over 40 pre-configured tools for common data domains

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 12

Oracle Enterprise Data QualityCustomer Use Cases

Copyright © 2017, Oracle and/or its affiliates. All rights reserved.Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 13

GLOBAL INTELLIGENT SCREENING SYSTEM

• Standardization > Matching > Case Management

• Processing over 500m records daily against 2m parties on watchlists

• New feeds going live every 2 weeks

• Over 1000 Case Management users

• Robotic checks to automate 90% of first line review

Immediate productivity gains over old system and a far more rigorous approach to screening


OPTIMUM MARKET DATA ANALYTICS

• Data Quality Governance of key Financial Instrument and Market Data

• Business Rules and Thresholds defined by business users and processed by EDQ

• Complex Time Series data checks

• Transparent Data Governance control

Use cases could not be addressed by competitor offerings


GOVERNED CLOUD CUSTOMER DATA MANAGEMENT

• EDQ used to profile, clean, match and load data from all sources of customers and contacts

• Oracle Customer Data Management Cloud Service uses EDQ to protect data quality in real-time, all the time

• Trusted data enables automated marketing, sales effectiveness and digital transformation

EDQ enables standardized, enriched and trusted customer data for critical business applications

Copyright © 2017, Oracle and/or its affiliates. All rights reserved.

E-Business Suite

Siebel

JD Edwards

3rd Party

HCM

ERP Sales

ServiceMarketing

...

EDQ powers Oracle Cloud Applications and ServicesEDQ powers Data Quality Assurance in Oracle Cloud Services

- Preventing duplicate entry of persons, organizations and addresses

- Enhancing data using Data as a Service

- Validating and standardizing names and addresses


Highly flexible, fully integrated Case ManagementThousands of data stewards use EDQ Case Management to drive their daily work

• Supports data stewardship decisions that drive automated data cleansing rules

• Built-in hierarchies for records with many issues, or rules with many exceptions

•Automated prioritization, timers for escalation, fully configurable workflows and notifications

• Comments, attachments, and comprehensive audit trail

•Built-in operational reporting

•Highly scalable


Oracle Enterprise Data QualityProduct Roadmap

18

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 19

Now Available: EDQ 12.2.1.3New: Product Data Services

• Out-of-the-box matching services to match product data effectively with minimal tuning• Ready extension points to plug in your own extractions, standardizations and strip words to tune

matching further where required• Out-of-the-box profiling for product data examines product descriptions and finds:

• Companies• Colors• Units of Measure• Possible Dimensions• Possible Abbreviations• Tokens and phrases that may require standardization

• Fully open and extensible Reference Data sets for extraction of key product data attributes• New Extract Attributes processor enables easier attribute extraction from description fields using

literals or regular expressions• New processors to generate Entity – Attribute – Value output, or attributed rows


EDQ Product Data Services

Out-of-the-box profiling to understand data quicker

Dedicated Product Data toolkit with

starter processors

Out-of-the-box matching services


Announcing: Data Integration Platform Cloud Service

Business DataOLTP/Applications

Oracle Data Integration Platform CloudAnalytics / OLAP

and Serving Layers

3rd PartyData Sets

Access >125 Sources Integrate >100 Targets

Oracle Data Integration Platform Cloud Governance Edition is a fully provisioned environment running on Oracle Platform as a Service catering to all your enterprise data replication, integration, quality and governance requirements.

Scaling Patching Backup/ Restore

Platform as a Service (WebLogic and Oracle DB)

Management UI


Data Integration Platform Cloud ∙ Simplifying the journeyDIPC with EDQ provides:

1. Oracle PaaS features:• Automated backup• Simple restore• Easy scale in/out/up/down

2. Elastic scalability for all workloads

3. The richest out-of-the-box DQ Services for Global Data

4. Single product heritage, consistent UI, seamless data processing

5. Market-leading usability from data to insight to rules


3 major drivers of change in the DQ market

1. Embedding Data Quality Management in a Data Governance framework

2. Strategic move to the Cloud

3. Rise of Big Data systems


Enterprise Data Quality and Governance - Roadmap

New Product Data Services• Product Data Profiling Template• Product Data Matching Service• Toolkit for Extracting, Classifying, Parsing and

Standardizing Product DataAdditional Customer Data Services

• Name, Email, Country and Nationality Validation and Standardization Services

• Additional reusable processors for Customer Data

Hierarchical Data • 17 new processors to work with Arrays• 20 existing processors enhanced to work with

multiple values• Support for use of Arrays in Matching

REST Configuration API• Supports data profiling as a service to integrated

applications, linking to results in EDQ• REST API for running, monitoring and cancelling

EDQ jobs

Data Governance in the Oracle Public Cloud• Provisioned EDQ in Oracle Public Cloud with

additional features for Data Stewardship:• Data Catalog• Business Glossary• Business Rules

• Subscription Pricing, Cloud PaaS features• Scale Up/Down• Backup, Restore, Patching

• Full EDQ capabilities for SaaS customers

Advanced Data Stewardship

• Advanced DQ Dashboards with Drilldowns

• Remediation Workflow Support

Integration of DQ into Data Integration Flows

EDQ 12.2.1.3August 2017

What’s Next Future Directions

Data Integration Platform Cloud – Governance Edition

EDQ – Cloud or On-Premise

EDQ – Cloud or On-Premise

Data Integration Platform Cloud – Governance Edition

Big Data and Cloud Application Connectivity• Improved connectivity for Cloud Applications,

Web Services and Big Data

Enterprise Manager Integration• Monitoring and Control of EDQ in EM

Operability Improvements• Improved control of resource utilization

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 25

A Glimpse of the Future of Data Management

26

Customer SpotlightFruit of the Loom

Amanda Farley, Data Quality Manager

DATA QUALITY AT FRUIT OF THE LOOM

AMANDA FARLEY

[email protected]

FOTL ARCHITECTURE

Oracle Product Data

Hub (PDH)

Product Lifecycle

Management (PLM)

Item Publication

Hub

Manufacturing

NEED FOR DATA QUALITY

Fruit of the Loom has

• ~383,000 SKUs• 62% Active Status in the Product Lifecycle

• ~219,000 Bills of Material (BOM)

• Distributed across 48 Organizations• Cutting, Sewing, Packing, Distribution, etc.

Fruit of the Loom Men’s EversoftShort Sleeve Crew T-Shirt

NEED FOR DATA QUALITY

Available in:• 96 Colors

• 7 Sizes: S, M, L, XL, 2XL, 3XL, 4XL

• 2 Packaging Hierarchies

=1,344 SKUs for just one style!

FOTL’S EDQ JOURNEY

April – July 2016

October -December 2016

September -December 2017

EDQ Project #1• Enterprise Data Quality (EDQ)

initial setup / configuration

• Validations within Oracle only

• Defined and implemented 40+ EDQ Rules for Item Attribution

With the help of our partners at Kaygen Enterprise Solutions

EDQ PROJECT #1

Oracle Product Data Hub

(PDH)

Product Lifecycle

Management (PLM)

Item Publication

Hub

Manufacturing

EDQ Validations focused on

Oracle Items/Attributes and

included:

• Audit:• Formula Based Validations

• Defaulting Validations

• Missing Data Validations

• LOV/Value Set Validations

• Matching:• Comparisons between Organizations

PROJECT #1 SAMPLES

SIMPLE:

MORE COMPLEX:


April – July 2016







EDQ Project #2• Validations/Comparisons between

PLM and Oracle

• Focused on both Item Attribution and BOM validations

• Defined and implemented 20+ additional EDQ Rules


EDQ PROJECT #2


(PDH)

Product Lifecycle

Management (PLM)

Item Publication

Hub

Manufacturing

EDQ Validations focused on

PLM/Oracle Items and BOMs

and included:



• Matching:• Comparisons between Systems


April – July 2016








PLM and Oracle

• Focused on both Item Attribution and BOM validations

• Defined and implemented 20+ additional EDQ Rules


PLM, Oracle, and Manufacturing Systems

• Focused on both Item Attribution and BOM validations to Manufacturing


EDQ PROJECT #3


(PDH)

Product Lifecycle

Management (PLM)

Item Publication

Hub

Manufacturing

EDQ Validations will focus

on Manufacturing Items

and BOMS and include:


• Defaulting Validations


• Matching:• Comparisons between Systems

LESSONS LEARNED

• Cleanse where possible before implementation• Starting with hundreds, thousands, tens of thousands of “errors” is overwhelming

• Keep rules as simple as possible• Use attribution to filter rather than manually defined exception lists

• Prioritize notifications• Some rules do not warrant a daily report while others may need to be reported immediately

• Reevaluate rules early and often• Assumptions may not always be valid, rules may not always apply

• Recipients may ignore conflicts rather than requesting a change to the rule

• Implement a Project Structure

LOOKING FORWARD

Current and Future Initiatives:

• Utilize EDQ to Expand Data Governance and Data Quality

• Improve data integration to peripheral systems• Introduce Integration Stop for “bad data”

• Expand Validations to Customer and Supplier Data Hubs• Matching to address duplication

• Address Standardization

• Ensure we are leveraging all features of Oracle Product Data Hub (PDH)

• Develop a go forward strategy for PDH

• MDM in its own instance?

• Move to the cloud?


Get a sneak peek at cutting-edge data integration designs and receive a free gift!

• Oracle is constantly developing new software and features that will make your work easier, and Oracle's User Experience team would love to get your feedback on new data integration designs.

• Feedback sessions will take place at a date and time of your own choice.

• You can take part via webconference, from the comfort and convenience of your own office.

• If you’re interested, please fill out the 1-page form at http://bit.ly/2vIHlSg uppercase I lowercase l

• To show our appreciation, we will post all participants their choice from a wide selection of thank-you gifts.

40


Presen-tations on:

41

Data Integration Programme – FOCUS ON DOC LINK

DemoStations:

Hands-on Labs:

OracleEnterprise

Data Quality

OracleGoldenGate

Oracle Data Integrator

OracleData Integration Platform Cloud

OracleEnterprise Metadata

Management

Oracle GoldenGateReal-Time Data Replication

in the CloudHOL7715


HOL7653

ODI and OGGfor Big Data

HOL7708

Oracle Data Integration Platform Cloud

HOL7673

The EXchangeIntegration Area- Moscone West

The EXchangeAnalytics & Big Data Area

- Moscone West

The EXchangeData Management Area

- Moscone West

https://events.rainfocus.com/widget/oracle/oow17/1504907768525001COvY

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 42

Data Integration Programme – FOCUS ON DOC LINK

Sunday, October 1• Lift and Shift Workloads to Cloud with Oracle Data Integration Platform

Cloud [SUN6653]• Data Movement between On-Prem, Fusion ERP Cloud, Fusion HCM Cloud

and Salesforce [SUN7286]• Accelerate Migration to Cloud Infrastructure with Data Integration Platform

[SUN6896]

Monday, October 2• Oracle Data Integration Platform Strategy and Roadmap [CON6646]• Filling Your Data Lake with Potable Data, Using Data Integration [CON5465]• GoldenGate : Deep Dive into Automating OGG using the new Microservices

[CON6569]• Oracle Data Integration Platform: Foundation for Cloud Integration

[CON6650]• Oracle Data Integration Platform Empowers Enterprise Grade Big Data

Solutions [CON6893]• Oracle Data Integration Platform Cloud Deep Dive [CON6651]• Oracle GoldenGate Cloud Service: Real-Time Data Replication in the Cloud

[HOL7715]

Tuesday, October 3• Oracle Data Integrator Product Update and Strategy [CON6654]• Oracle Enterprise Data Quality: Product Overview and Roadmap [CON6656]• Accelerate Cloud On-Boarding Using Oracle GoldenGate Cloud Service

[CON6894]• Oracle Enterprise Data Quality for All Types of Data [HOL7653]• Oracle Data Integration Platform: a Cornerstone for Big Data [CON6655]• GoldenGate: MAA and Best Practices for Oracle GoldenGate Microservices

[CON6570]• Oracle GoldenGate Product Update and Strategy [CON6897]

Wednesday, October 4• A Practical Path to Enterprise Data Governance with Oracle Enterprise Data

Quality [CON6657]• Oracle Data Integrator and Oracle GoldenGate for Big Data [HOL7708]• Introduction to Oracle Data Integration Platform Cloud [HOL7673]• An Enterprise Databus: GoldenGate in the Cloud Working with Kafka and

Spark (CON6895]• GoldenGate: Best Practices & Deep Dive on OGG 12.3 Microservices at Cloud

[CON6568]• Oracle GoldenGate for Big Data [CON6898]• Oracle Data Integration Platform Cloud Service Governance Edition

[CON6652]

https://events.rainfocus.com/widget/oracle/oow17/1504907768525001COvY


Connect with Oracle Integration

@OracleDI

Blogs.oracle.com/DataIntegration/

Oracle Data Integration

Oracle Data Integration

Oracle FMW

@OracleIntegrate

Blogs.oracle.com/Integration/

Oracle SOA

oracle · fotl’s edq journey april –july 2016 october - december 2016 september - december 2017...

Documents