transform your data integration platform from informatica to odi
TRANSCRIPT
Transform Your Data Integration Platform From Informatica To ODI
About Jade
Pune
San Jose
San DiegoNoida
Atlanta
Hyderabad
Reading
10 Offices
Worldwide
5 Global
Delivery Centers
Services High-Tech Manufacturing Energy Social Media & Entertainment
Boston
Los Angeles
Philadelphia
Speaker’s Introduction
Kulvinder Hari
Director,
Sales Support Oracle Data Integration
Technologies Oracle
Amit Raj
Director,
Analytics & Information Management
Jade Global
Agenda Oracle Data Integrator Cloud Service
Oracle Data Integrator Benefits
Customer Example: Leading Customer Advocacy Group
Useful Links
Oracle Data Integration Platform
ODI Performance
Migration to ODI: Key Decision Considerations
INFAtoODI: Jade’s Value Proposition
Case Study
Live Demo
Q&A
Oracle Data Integrator Cloud Service
• Deploy ODI in the Oracle Public Cloud and execute E-LT workloads into Oracle Platform as a Service
• Pushdown processing is best for the cloud – high performance ETL with less data movement
Lower Development Costs
Powerful Hybrid Cloud Solution
Accelerate Analytics
• Native integration with Oracle Database Cloud Service, Exadata Cloud Service, Big Data Cloud Service and Java Cloud Service
• Reduced infrastructure and maintenance costs with Oracle Data Integrator Cloud Service
• Subscribe to ODI using monthly subscription
• Leverage hybrid deployments with ODI running on-premises to move data into OPC
SaaS Apps
DBCS
ExadataCloud Service
StorageCloud Service
Business IntelligenceCloud Service
ODI CS
JavaCloud Service
Big Data CS
DB on Compute
Oracle Data Integrator Benefits
Improved Productivity
• Easy and universal for designing any Mapping
• Robust and reusable: Create Mappings once for any physical design
• Quick to define and refactor Maps with automation
• Extensible model for any data integration mechanism
Key Productivity Benefits
• Significantly reduces the learning curve
• Shortens implementation times
• Simpler maintenance
ODI Declarative Design
Define How: Knowledge Modules
21
Automatically Generate
Dataflow
Define
WhatYou Want
Oracle Data Integrator Benefits
Key Architecture Benefits• Faster development and simpler
maintenance using templates
• Easy to extend and add new best
practices
• Enforces predictability and
reduces cost of ownership
Reverse
Engineer
Metadata
Journalize
(CDC)
Load from
Source to
Staging
Check
Constraints
Integrate,
Transform
Data
Service
7
Database
CS
Exadata
CSHive HBase Spark Sqoop
BICS KafkaOracle
DBLinkPig
External
TablesCassandra
Oracle
DatapumpTeradata
eBusiness
SuiteIBM DB2 Netezza SCD
Pluggable Knowledge Modules Architecture
Pluggable Knowledge Modules Architecture
HeterogeneousCloud
Integration
Data Migrations into Cloud
Migrations
Customer 360
Load a Cloud Data
Warehouse or Data Mart
Lift & Shift
Big Data ETL Pipelines
Analytics
Oracle Data Integrator Benefits
• With Oracle VPN options, Oracle Cloud becomes an
extension of your own network
• Without VPN, on-premises data can be transferred via
Oracle Storage CS automated using ODI
• ODI supports integration with GoldenGate Cloud
Service for real-time data movement
• ODI supports SaaS services via RESTful Services or 3rd
party adapters
• Data is transformed in a relational DB or Hadoop using
the data processing engines: SQL or Hive
On PremiseDBCS
ExadataCloud Service ODICS
DB on Compute
GGCSBig Data CS
SaaSApps
Oracle Data Integrator Benefits
Customer Example: Leading Customer Advocacy Group
• Using Oracle Database Cloud Service (DBCS) to run a Data
Warehouse
• Uses Oracle Data Integrator (ODI) to load data from on-premises
and Cloud data sources (Salesforce Marketing Cloud, NetSuite, and
SiteCore) into DBCS
• ODI helped this customer consolidate and enrich their customer
data to produce a richer dataset which is utilized for Marketing
campaigns as well as to know their customers better
• Planning to migrate to ODICS soon
Customer 360-Degree View
Useful Links
• Website
http://cloud.oracle.com/en_US/data-integrator
• Datasheet
http://cloud.oracle.com/opc/paas/datasheets/odics-ds.pdf
• Trials
Trial accounts available through Java Cloud Service trials
Oracle Data Integration Platform
1stto certify E-LT tool withApache Spark/ Python
1stto offer Self-Service & Hybrid Cloud solution
#1Pushdown/ E-LTData Integration Tool
ODI Performance
0
50
100
150
200
250
300
350
ODI on Exadata
Conventional ETL
Job e
xecution
tim
e in m
inute
s 5hrs 11mins
7min 20sec
42XIMPROVEMENT
E-LT provides a flexible architecture for optimized
performance.
Benefits
• Leverages set-based transformations
• Improves performance for loading, no network
hop, no centralized ETL processing
• Takes advantage of existing infrastructure:
hardware and software
Migration to ODI: Key Decision Considerations
Modernize with Rapid & Future Ready ELT Technology
Use native technologies for any data sourceOptimal performance, reduced network traffic
No proprietary middle tierReduced infrastructure cost and maintenance effort
Declarative designSimplified developmentReusable across technologies
Migration to ODI: Key Decision Considerations
• ODI for Hyperion Applications
• ODI for ERP Applications
• ODI for Oracle BI Applications
• ODI for SAP BI Applications
• ODI for Oracle Fusion Applications
• ODI for Cloud Integration
AnalyticsODI
Analytics
ODI
ODI
ANY
Module YModule x
ODI
OD
I: O
racl
e’s
E-L
T T
oo
l
Migration to ODI: Key Decision Considerations
ODI
(ODI)
INFAtoODI: Jade’s Value Proposition
INFAtoODI: Jade’s Value Proposition(*Patent Pending)
INFAtoODI: Jade’s Value Proposition
Simple Medium Complex
Simple Mapping Benchmark
1. Mappings with only Source, Target,
Source Qualifier, Connected Lookup
and Simple Expression Transformations.
1. No variable Ports
2. No Informatica specific functions
3. No unconnected lookup
4. No Parameters/Mapping Variables
2. Mappings with no SQL overrides in
Source-Qualifier
3. Mappings with no SQL overrides in
Lookup
Medium Mapping Benchmark
1. Mapping with Only one Mapplet
2. Simple SQL Override in Source Qualifier
3. Simple SQL Override in Connected Lookups
4. Expressions with Informatica specific
functions (isnull, isdate, isnumber etc.,) which
can be converted to DB equivalent
5. Filter and Sequence-Generator
transformations
6. Expressions with Variable port storing
temporary values for current record
7. Multiple parallel lookups.
8. Update Strategy based on Primary key
updates
9. Mapping with Static variables
10. Unconnected Source qualifier output ports
11. Unconnected Input ports in an Expression
transformation/Filter/update
strategy/mapplet
Complex Mapping Benchmark
1. Multiple Mapplets in one Mapping
2. Complex SQL overrides in Source Qualifier
3. Complex SQL Overrides in Connected Lookups
4. Unconnected Lookups without SQL Override
5. Mappings with multiple Targets (multiple Source qualifier
- One source qualifier to one Target)
6. Mappings with multiple Targets (Single Source qualifier
without Router Transformation)Multiple lookups
Serial/Parallel combination
7. Mapping Parameters/Dynamic Variables
8. Lookup getting input from multiple transformations
9. Complex linking of transformations where each
transformation has multiple pipelines and pass through
different transformations and finally merge at one
transformation
10. Having sequence generator transformation to insert
unique key in target, when source & Target are from
different data sources.
11. Reusable Lookup transformations overridden (SQL/Table)
in the mapping
12. For Mapping with SQL Override and no user defined joins
for at least one source, manual intervention is required.
13. For mapping with filter conditions defined on User
defined joins, manual intervention is required.
Technology
Leverages ODI’s Public SDKs and APIs
INFA 8/9.x ODI 11g/12c
Desktop file (.exe) that launches the tool
Cloud Enabled
User friendly interface
Patent Pending
Informatica “Custom Mappings”
Informatica components: sources, targets, SDE & SIL mappings, lookups, expressions, transformations, etc.
BI Apps: Category 1, Category 2, Category 3
INFA mappings: Simple: 100%, Medium: ~70%, Complex: ~50%
The ONLY Automated conversion tool
Convert INFA Mappings to ODI Packages
Single or Bulk INFA mapping conversion
Saves significant analysis effort
Error Handling capabilities
End-to-end migration framework –
Services include:
• Pre-Migration Activities
• Actual Migration using the tool
• Post-Migration Testing
Oracle
Recommended
Coverage
INFAtoODI: Jade’s Value Proposition
Automated
Conversion
Reduced
Development
Time
Cost Savings
Up to 80% overall
Up to 50%
Up to 60-65%*
Testing for migrated entities
Productivity Gain Fast & Reliable with speed up to 3x
(assuming a mix of approximately 20% simple, 30% medium and 50% complex mappings)
(assuming a minimum of 100 medium or complex mappings to be converted)
Quality Assurance
*Note: Above numbers are averages based on an onsite offshore global delivery engagement model
INFAtoODI: Jade’s Value Proposition
Case Study
About The Company
The client is a leading global multinational risk management, insurance brokerage and advisory company that helps clients around the world
turn risk into a path for growth. With presence in more than 120 countries, the client has 39,000 employees globally.
Business Requirements
• Migrate to a single ERP system with OBIA
as the reporting platform
• Perform technical upgrade of OBI
Applications from OBIA 7.9.6.4 to OBI
Applications 11.1.1.9.2 to provide the
technical foundation for supporting the
future needs
The Challenges
• Convert over 650 Informatica mappings
into the latest technical stack which
involved ODI
• Upgrade was estimated to take a
minimum of 12 to 13 months derailing the
future business plans
The Solution
• Jade Global deployed the first and only
patent pending Informatica to Oracle
Data Integrator conversion tool
• InfatoODI tool and processes enabled up
to 80% automatic conversion of the
existing customized mappings
Case Study
The Benefits
InfatoODI automated conversion tool migrated and
upgraded the client’s existing environment, and
improved the process quality by 90%
InfatoODI reduced the implementation time and
increased the speed of project execution by 63%
Reduced the duration of the conversion from the estimated
12-13 months to 4.5 months, thereby reinstituting the client’s
future business plans
Contact Us
Connect With Us
Visit us at www.informaticatoodi.jadeglobal.com
Email us at [email protected]
Call us at +44-118-9653506