bi applications integration with odi and · pdf filebi applications 11g features over 7.9.x...

38
© Copyright 2014. Apps Associates LLC. 1 BI Applications Integration with ODI and GoldenGate July 22, 2014 Narasimha Rao Madhuvarsu L V Sr. Principal Architect Apps Associates LLC Julian Troake Marketing Director Apps Associates LLC

Upload: vuongcong

Post on 12-Feb-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 1

BI Applications Integration with ODI and GoldenGate

July 22, 2014

Narasimha Rao Madhuvarsu L V Sr. Principal Architect Apps Associates LLC

Julian Troake Marketing Director Apps Associates LLC

Page 2: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 2

Confidentiality Statement

The content of this document is proprietary, confidential information pertaining to Apps Associates’ products, services, solutions and methods. Information herein is intended for use by the client or prospective client only and must not be shared

with any third party without consent from Apps Associates.

For any questions with this proposal, please contact

Julian Troake

Email: [email protected]

Phone: (978) 399-0230

Page 3: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 3

Agenda

• Introduction

• Customer Benefits

– Infrastructural

– TCO

– Productivity

– Additional Content

– Data Lineage

• BI Apps 7.9.x vs. 11g

• ODI BI Apps Architecture

• Oracle Data Integrator

• Licensing and Supported Platforms

• Migration Options from 7.9.x Versions

• Real-Time Data Refresh Using GoldenGate

• Demo

– Configuration Manager

– Functional Setup Manager

– Web-Based ODI Console

Page 4: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 4

Introduction

• Most significant BI Applications release

• Completely re-architected solution

• Expansion of content and new products

• Released on the latest version of OBIEE 11.1.1.7

Page 5: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 5

Customer Benefits

• Leverages the database tier power for ELT

• No need of separate ETL tier – significant cost reduction

• Number of new out-of-the-box tools to increase productivity and drive

down TCO

– Configuration Manager

– Functional Setup Manager

• Additional modules and content expansion

• Reduced functional configuration time

• Complete data lineage from source to analysis

Page 6: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 6

Customer Benefits

• Integrated FMW security across components

• Easy near real time incremental refresh of data warehouse

Page 7: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 7

BI Applications 11g Features Over 7.9.x

• Significant release with multiple enhancements

• Additional content and new products

• New architecture leveraging the power of ODI

• Content built on latest version of OBIEE

• Tools to increase productivity and drive down TCO

• Near real time option for customers that have significant ETL time pressures

Page 8: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 8

New Features

Page 9: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 9

New Content in BI Apps 11g Over 7.9.x

• Financials

– Commitment Control & Public Sector Financial / Budget Analysis (EBS & PSFT)

– Fixed Assets (EBS & PSFT)

• HR

– Time & Labor (EBS & PSFT)

– Global Payroll (PSFT)

– Transfers (EBS & PSFT)

• Projects

– Resource Management (EBS & PSFT)

– Cross Charge (EBS & PSFT)

– Forecasting Enhancements & Commitments (PSFT)

– GL Reconciliation (EBS & PSFT)

Page 10: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 10

New Content in BI Apps 11g Over 7.9.x

• CRM

‒ Service Analytics Enhancements (EBS)

‒ Price Analytics (EBS)

• Procurement & Spend

‒ Sourcing Analytics

‒ Enhancements to Change Orders and Agreements

• Supply chain & Order Management

‒ Costing

‒ Inventory Cycle Count and Other Enhancements

• Student Information Analytics

‒ Admissions, Recruiting, Records, partial Financials (PSFT)

• Indirect Spend Planning

Page 11: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 11

Extended Connectivity Over 7.9.x

• Application Adapters for SAP ERP and SAP BW

• Application Adapters for Endeca, Hadoop

• Oracle OLAP

• Hyperion Planning, Financial Management and Essbase

• Real-Time CDC with GoldenGate

• Oracle DB multi-table insert

• Optimizations for IBM DB2, Microsoft SQL Server, Teradata, Netezza

Page 12: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 12

Bulk Data Processing & Data Transformation

BI Apps 11.1.1.7.1 supports more source systems over 7.9.6.4

Page 13: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 13

ODI BI Apps Architecture

Page 14: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 14

ETL

• BI Apps 7.9.6.4 with Informatica

• BI Applications 11.1.1.7.1 with Oracle Data Integrator and GoldenGate

Page 15: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 15

Data Loading

The Key to Improved Performance and Reduced Costs

E-LT provides flexible architecture for optimized performance

Benefits

• Leverage set-based transformations

• Improved performance for loading, no network hop

• Takes advantage of existing hardware

Page 16: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 16

ETL Architecture

Informatica

• Is an ETL tool (Extract, Transform, Load)

• Has dedicated ETL engine

• Transformation is the core part of ETL

• Integration service handles the transformation part, resulting in better performance

• File based transformation operations

Page 17: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 17

ETL Architecture

ODI

• Is an ELT tool (Extract, Load, Transform)

• Does not have dedicated ETL engine

• Relies on database capabilities of the source / target database i.e. first loads the data in some staging tables in the target database and later inserts / updates the data into the final target tables based on the data transformation has to perform

• Performance is primarily based on Source and Target Tables and Database

Page 18: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 18

ETL Architecture

• In-database E-L-T Transformation vs. E-T-L.

• Best in class performance, scalability, availability

• Lightweight deployment for lower TCO

• Faster time-to-value through declarative design

• Heterogeneous, open and standards-based

• Set based transformation

Page 19: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 19

Components

Informatica

Page 20: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 20

Components

ODI

Page 21: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 21

GUI

7.9.6.4 11.1.1.7.1

Connecting to the ETL Repository We need to have client tool installed in the machine to access repository

Connecting to the ETL Repository No separate Client tools is involved. We can connect to repositories using ODI console or by web based URL

ETL Repositories It has only one repository, so we have one set of connection entries

ETL Repositories We have two Repositories. Master and Work Repositories. So we need two Independent connection entries

Cost ODI is cost effective compared to Informatica

Page 22: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 22

GUI

Hardware Informatica tool utilize its own engine to implement the ETL process. So investment in additional hardware to implement the tool’s ETL engine.

Hardware Utilizes existing hardware. ODI can run on the same hardware as the database engine underpinning the data warehouse, using the existing hardware deployed.

Page 23: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 23

Implementation

Domain Files We need to configure manually

Domain Files No need to configure Domain files. It is automatically configured by using Configuration Manager.

Time It takes more time for configurations

Time It takes less time for configurations

ETL Customization In order to load data to custom column we need to edit the Mapping

ETL Customization In order to load data to custom column we need to edit the interface

ETL Troubleshooting Features like backtracking, dependencies and debugger

ETL Troubleshooting Features like Simulation to debug

Page 24: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 24

Declarative Design

Improved Developer Productivity and Lower Maintenance Costs

Informatica ETL Design • Developer must define every step of Complex ETL

Flow Logic • And significant development and maintenance

efforts

ODI Declarative Design • Simplifies the number of steps • Automatically generates the Data Flow whatever

the sources and target DB

Benefits • Reduces the learning curve • Shorter implementation times • Streamline access to non-IT pros

Page 25: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 25

Benchmarking

Page 26: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 26

Tools for Accelerating Deployment

BI Applications 7.9.6.4

• DAC

– Another tool to install

BI Applications 11.1.1.7.1

• Configuration Manager

– Administrative UI to manage system configuration for BI Applications

• Functional Setup Manager

– Administrative UI to track and manage implementation projects and functional setup steps

Page 27: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 27

BI Applications Configuration Manager

A centralized (thin client/web application) console to

– Simplify configuration process

– Minimize manual setups and configurations

– Generate list of necessary configurations based on BI Application being configured and user selections

– Provide check lists and validations of all necessary tasks

– Reduce dependency on documentation

– Configuration migration capabilities

Page 28: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 28

Edit Dialog

Page 29: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 29

Functional Setup Manager

• Domains ETL execution to extract configuration data from source

• Ability to track configuration progress for project management

• Enable / disable a functional area from a module

• Ability to create load plans with extract only

• Define, generate, execute and monitor load plan

• Scheduling for load plan for data refresh

Page 30: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 30

BI Applications OLTP Coverage

Page 31: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 31

Migration Path

• No formal migration path from 7.9.x to 11g

• Ideal for implementations with minimal customizations

• Upon implementation of BI Apps 11g, manually migrate the customizations on a case by case basis as needed

Page 32: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 32

Enhanced ETL Architecture Using GoldenGate

Optional Feature for 11g

Challenge:

Customers with geographically distributed source systems are increasingly being challenged by rapidly expanding data sizes and shorter ETL windows

Solution:

Optimize ETL load and reduce impact on OLTP system leveraging the strengths of GoldenGate

– Completely prepackaged solution

– Creation of Source Dependent Data Store (SDS)

– Ability to complete all extraction tasks while in source system availability window

Page 33: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 33

Real-Time Data Refresh Using GoldenGate

• Built in integration with GoldenGate

• No need for batch load windows

• ODS/SDS near real time refresh from distributed source databases

• Ability to add/change indexes and views on SDS

• Source for real time reporting needs

• Recommended for customers with pressing ETL times

• Suitable for 24 x 7 deployments

Page 34: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 34

Demo

• Configuration Manager

• Functional Setup Manager

• ODI Console

Page 35: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 35

Why ODI BI Apps?

Faster

– Fastest E-LT Bulk/Batch Performance

– Faster Real Time integration (sub-second) with CDC, Replication, and SOA

– Faster Project Setup, Design and Delivery

Simpler

– Simpler Setup, Configuration, Management, and Monitoring

– Simpler way to do Mapping using Declarative SQL Interfaces

– Simpler Deployment with Fewer Hardware Devices

– Simpler extensibility with Knowledge Module code templates

Page 36: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 36

Why ODI BI Apps?

Saves Money (Lower TCO, Higher ROI)

– Less Hardware & Energy Costs with E-L-T Architecture

– Less Time spent on Unnecessary ETL Mappings, Scripting, and Training

– Less Integration Overhead Integrating with Applications, SOA, and Management

Page 37: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

© Copyright 2014. Apps Associates LLC. 38

Connect with Us

Web: www.appsassociates.com

Email: [email protected] | [email protected]

YouTube: www.youtube.com/user/AppsAssociates

LinkedIn: www.us.linkedin.com/company/Apps-Associates

Twitter: @AppsAssociates

Facebook: www.facebook.com/AppsAssociatesGlobal

Google+: www.plus.google.com/+AppsAssociatesGlobal/

Page 38: BI Applications Integration with ODI and · PDF fileBI Applications 11g Features Over 7.9.x • Significant release with multiple enhancements ... ETL Customization In order to load

Thank You!