quick start with data federator xi
TRANSCRIPT
-
8/8/2019 Quick Start With Data Federator Xi
1/38
QUICK START WITH DATA FEDERATOR XI 3.xSession 813
Pierpaolo Vezzosi, Group Product Manager, Semantic Layer
-
8/8/2019 Quick Start With Data Federator Xi
2/38
2010 SAP AG. All rights reserved. / Page 2
AGENDA
1.Data Federator overview
2.Data Federator and the suite
3.Data Federator modeling and transformations
4.Roadmap
5.Conclusion
6.Q & A
-
8/8/2019 Quick Start With Data Federator Xi
3/38
2010 SAP AG. All rights reserved. / Page 3
AGENDA
1.Data Federator overview2.Data Federator and the suite
3.Data Federator modeling and transformations
4.Roadmap
5.Conclusion
6.Q & A
-
8/8/2019 Quick Start With Data Federator Xi
4/38
2010 SAP AG. All rights reserved. / Page 4
DATA EXPLOSIONA natural result of modern business and the internet
281 billion gigabytes of digital data was
created in 2007 which is equal to 5million times the information in all booksever written
By 2011, data will grow 10 times theamount it was in 2006
Data is scattered across the enterprise
Redundant and inconsistent data isubiquitous
Users can rarely perform cross-functional analysis
Source: The Diverse and Exploding Digital Universe IDC, March 2008
-
8/8/2019 Quick Start With Data Federator Xi
5/38
2010 SAP AG. All rights reserved. / Page 5
CUSTOMER PAINS
Cross functional analysis
What is the difference between your production andanalysis data model?
How many marts do you have? Do you have information silos?
Difficult to integrate disparate sources
Do you have on-premise and on-demand sources? How do you integrate your information systems?
Time to solution What is the duration of your last data warehouse
project? What is your process to add a new source of
information to your data warehouse? How do you deal with ad-hoc marketing campaign?
Real time information What is the latency of your information? Do you need real time information?
-
8/8/2019 Quick Start With Data Federator Xi
6/38
2010 SAP AG. All rights reserved. / Page 6
WHAT IS DATA FEDERATOR?
Multi-source Query Engine
SQL generator Optimizer (Optimize then re-write optimally native statements)
Brokerage (combine source result sets)
Uniform query mechanism independent of the sources
Pull data on-demand
Data Modeling
Design any data models
Transformations (support all the relational transformations)
Map sources to target tables
Connectors
Connect to relational and non relational systems
Databases, flat files, SAS, SAP BW, Web Services / XML
-
8/8/2019 Quick Start With Data Federator Xi
7/38 2010 SAP AG. All rights reserved. / Page 7
DESIGN PHASEDESIGN A UNIFIED VIEW
Connect to sources
Extract metadata
Relational and nonrelational
Data model suitedfor analysis
Data transformations
XML to relationalconversion
Web Services
SAP 2009 / Page 7
-
8/8/2019 Quick Start With Data Federator Xi
8/38 2010 SAP AG. All rights reserved. / Page 8
DESIGN PHASEDESIGN A UNIFIED VIEW
Design a data model
Business oriented Abstract physical
implementation
Flexible
Connect to sources
Extract metadata
Relational and nonrelational
Data model suitedfor analysis
Data transformations
XML to relationalconversion
Web Services
SAP 2009 / Page 8
-
8/8/2019 Quick Start With Data Federator Xi
9/38 2010 SAP AG. All rights reserved. / Page 9
DESIGN PHASEDESIGN A UNIFIED VIEW
Design a data model
Business oriented Abstract physical
implementation
Flexible
Transform data Business rules
Case statements
Align incompatible ID
Merge lists
Connect to sources
Extract metadata
Relational and nonrelational
Data model suitedfor analysis
Data transformations
XML to relationalconversion
Web Services
SAP 2009 / Page 9
-
8/8/2019 Quick Start With Data Federator Xi
10/38 2010 SAP AG. All rights reserved. / Page 10
RUNTIME PHASEQUERY ANY SOURCES UNIFORMLY
Optimize
Generate an optimalexecution plan
Execute
Submit sub queries
Delegate computation tosources
Execute SQL operationsnot supported by sources
Adapt
Generate native SQL Generate function calls
from SQL (Web Services,ABAP)
Submit sub queries
SQL to WS calls
Query using SQL
Web Services
SAP 2009 / Page 10
-
8/8/2019 Quick Start With Data Federator Xi
11/38 2010 SAP AG. All rights reserved. / Page 11
DATA FEDERATOR ARCHITECTURE
Receive SQL from Client tool
ODBC or JDBC drivers
-
8/8/2019 Quick Start With Data Federator Xi
12/38 2010 SAP AG. All rights reserved. / Page 12
DATA FEDERATOR ARCHITECTURE
Optimize the query execution plan
ODBC or JDBC drivers
-
8/8/2019 Quick Start With Data Federator Xi
13/38 2010 SAP AG. All rights reserved. / Page 13
DATA FEDERATOR ARCHITECTURE
ODBC or JDBC drivers
Rewrite the SQL in native source syntax andsend each request to the sources
-
8/8/2019 Quick Start With Data Federator Xi
14/38 2010 SAP AG. All rights reserved. / Page 14
DATA FEDERATOR ARCHITECTURE
ODBC or JDBC drivers
Receive data from each source
-
8/8/2019 Quick Start With Data Federator Xi
15/38 2010 SAP AG. All rights reserved. / Page 15
DATA FEDERATOR ARCHITECTURE
Synchronize data, aggregate it and send it tothe client tool
ODBC or JDBC drivers
-
8/8/2019 Quick Start With Data Federator Xi
16/38 2010 SAP AG. All rights reserved. / Page 16
AGENDA
1.Data Federator overview
2.Data Federator and the suite3.Data Federator modeling and transformations
4.Roadmap
5.Conclusion
6.Q & A
-
8/8/2019 Quick Start With Data Federator Xi
17/38 2010 SAP AG. All rights reserved. / Page 17
MULTI-SOURCE UNIVERSEHOW TO CONNECT UNIVERSE TO MULTIPLE SOURCES
Universe Data Federator integration
WebI Reports Universe Data Federator SAP ERP(Labs)
SAP BW
Teradata
Data Federator Engine
Connect to multiple relational and non-relational systems
Optimize, generate and delegate SQL execution
Join multiple sources effectively (brokerage)
SAP 2009 / Page 17
-
8/8/2019 Quick Start With Data Federator Xi
18/38 2010 SAP AG. All rights reserved. / Page 18
Universes
PRODUCT INTEGRATIONUNIVERSE AND DATA FEDERATOR SEMANTIC LAYER
Data model suitedfor analysis
Data transformations
XML to relationalconversion
Web Services
Data Federator
Business Layer
-
8/8/2019 Quick Start With Data Federator Xi
19/38 2010 SAP AG. All rights reserved. / Page 19
MULTI-SOURCE UNIVERSE
-
8/8/2019 Quick Start With Data Federator Xi
20/38 2010 SAP AG. All rights reserved. / Page 20
AGENDA
1.Data Federator overview
2.Data Federator and the suite
3.Data Federator modeling and transformations4.Roadmap
5.Conclusion
6.Q & A
-
8/8/2019 Quick Start With Data Federator Xi
21/38 2010 SAP AG. All rights reserved. / Page 21
DATA FEDERATOR MAPPING RULESDATA MODELING TARGET TABLE
SAP 2009 / Page 21
Design any data models Top down or bottom up approaches
Top down
Design your tables independently of your sources
Bottom up
Leverage the source schema (copy database schema)
-
8/8/2019 Quick Start With Data Federator Xi
22/38 2010 SAP AG. All rights reserved. / Page 22
DATA FEDERATOR MAPPING RULESDATA MODELING TARGET TABLE
SAP 2009 / Page 22
-
8/8/2019 Quick Start With Data Federator Xi
23/38 2010 SAP AG. All rights reserved. / Page 23
DATA FEDERATOR MAPPING RULESMAP SOURCES TO TARGET
TPCR
S1:CUSTOMER S2:NATION S3:REGION
TPCRO
FRENCH_CUSTOMER
SAP 2009 / Page 23
Sources
Relationships
(inner and leftouter joins)
Mapping rule
Target table
-
8/8/2019 Quick Start With Data Federator Xi
24/38 2010 SAP AG. All rights reserved. / Page 24
DATA FEDERATOR MAPPING RULESPRE AND POST FILTERS
SAP 2009 / Page 24
Pre filters Filter data before entering Data Federator
Post filters
Filter data after the relationships
S1:CUSTOMER S2:ORDER
Pre filters
Post filters
-
8/8/2019 Quick Start With Data Federator Xi
25/38 2010 SAP AG. All rights reserved. / Page 25
DATA FEDERATOR MAPPING RULESPRE AND POST FILTERS
SAP 2009 / Page 25
-
8/8/2019 Quick Start With Data Federator Xi
26/38 2010 SAP AG. All rights reserved. / Page 26
DATA FEDERATOR MAPPING RULESPRE AND POST FILTERS
SAP 2009 / Page 26
-
8/8/2019 Quick Start With Data Federator Xi
27/38
2010 SAP AG. All rights reserved. / Page 27
DATA FEDERATORDATA FLOW
SAP 2009 / Page 27
Target tableColumn = f( source columns)
Post filter
RelationshipsInstantiate the joins
Pre filter(in the source)
Source tables
Mapping rule
-
8/8/2019 Quick Start With Data Federator Xi
28/38
2010 SAP AG. All rights reserved. / Page 28
SUPPORTED SOURCES AND PLATFORMS
Data Federator supported platforms
Data Federator online user guides
Supported SourcesOracle Redbrick
DB2 Generic ODBC
SQL Server Generic JDBC
MS Access Text files
MySQL 5.x XML
Teradata Web Services
Sybase IQ & ASE SAS
Netezza SAP BW
Informix
Supported PlaformsWindows
Solaris
AIX
Suse Linux
Red Hat Linux
http://service.sap.com/bosap-supporthttp://help.sap.com/businessobject/product_guides/boexi3SP1/en/xi3_sp1_df_userguide_en.pdfhttp://help.sap.com/businessobject/product_guides/boexi3SP1/en/xi3_sp1_df_userguide_en.pdfhttp://service.sap.com/bosap-support -
8/8/2019 Quick Start With Data Federator Xi
29/38
2010 SAP AG. All rights reserved. / Page 29
DATA FEDERATOR CONNECTOR FOR SAP BWQUERY SAP BW USING SQL (BYPASS THE OLAP ENGINE)
BOBJ/SAP End-to-End Solution
Information DemocracyWeb Intelligence
(uses for analysis and reporting relational metaphor)
Relational Universes(business objects defined using SQL)
NetWeaver BI
SAP NetWeaver 7.01
Enterprise Data Warehouse
SAP NetWeaver 7.01 BW OLAP Engine
BEX / Pioneer(OLAP metaphors)
MDX Queries SQL Queries
Data Federator
OLAP Universes(business objects
defined using MDX)
-
8/8/2019 Quick Start With Data Federator Xi
30/38
2010 SAP AG. All rights reserved. / Page 30
DATA FEDERATOR WEB SERVICESMASH-UP WITHOUT PROGRAMMING
Standard model (Relational)
Automatically convert the XML returned by a Web service into a relational model
Combine Web services by joining tables
Standard query mechanism (SQL)
Query Web services using SQL (fully compatible with tools from Business Objects)
Design to query multiple sources (Unified view)
Optimized to inject parameters dynamically
Scalable and distributed architecture
Design tool to define relationships between tables
Can be used by power users (Non-IT)
No development skills required to createWeb Services mashups
-
8/8/2019 Quick Start With Data Federator Xi
31/38
2010 SAP AG. All rights reserved. / Page 31
AGENDA
1.Data Federator overview
2.Data Federator and the suite
3.Data Federator modeling and transformations
4.Roadmap5.Conclusion
6.Q & A
-
8/8/2019 Quick Start With Data Federator Xi
32/38
2010 SAP AG. All rights reserved. / Page 32
Safe Harbor Statement
This document is intended to outline future product direction, and is not a commitment by SAP
to deliver any given code or functionality. Any statements contained in this document that are
not historical facts are forward-looking statements. SAP undertakes no obligation to publicly
update or revise any forward-looking statements. All forward-looking statements are subject to
various risks and uncertainties that could cause actual results to differ materially from
expectations. The timing or release of any product described in this document remains at the
sole discretion of SAP. This document is for informational purposes and may not be
incorporated into a contract. Readers are cautioned not to place undue reliance on these
forward-looking statements, and they should not be relied upon in making purchasing decisions.
SAP BUSINESSOBJECTS DATA FEDERATOR
-
8/8/2019 Quick Start With Data Federator Xi
33/38
2010 SAP AG. All rights reserved. / Page 33
Agile integration
Relational sources
Web Services
XML and flat files
SAS
SAP BW SQL connector
SQL access to BW Automatic Universe
generation
Optimization and performance
Query optimization algorithms
Server balancing
SAP ERP connector
Infosets
SAP queries
RPC calls
SSO
End to end SSO to SAP BW
and SAP ERP Sizing guide
64 bit connectivity for all sources
SAP BUSINESSOBJECTS DATA FEDERATOR
Data Federator XI 3.0
up to SP2
Multi Source Universe
(Federation in BOE)
End Q3 2010
Current
BOE integration
Query Server as a BOEservice
CMC integration
Multi-Source Universe (MSU)
Federation desing within theinformation design
tool(basic data integration, nodata modeling)
Engine update
Support native DB syntax
New query optimizations
Major release2010 Ramp Up
Planned functionality only. SAP reserves the right to change planning.
Data Federator XI 3.0 SP3
AGENDA
-
8/8/2019 Quick Start With Data Federator Xi
34/38
2010 SAP AG. All rights reserved. / Page 34
AGENDA
1.Data Federator overview
2.Data Federator and the suite
3.Data Federator modeling and transformations
4.Roadmap
5.Conclusion6.Q & A
-
8/8/2019 Quick Start With Data Federator Xi
35/38
2010 SAP AG. All rights reserved. / Page 35
DATA FEDERATOR SWEET SPOTS
Ad-hoc SAP BW reporting
Scalable WebI deployment on top of SAP BW
Federate SAP BW with other sources
Agile data integration
Flexible data model
Prototyping, faster time to solution, ad-hoc marketing campaigns
Cross functional analysis
Supercharge Data Warehouse (add real-time dimension/measure)
Combine on-demand and on-premise information
Combine BI and SAS information
Operational BI
Huge data source volume
Real-time query to operational systems (data latency is not an option)
-
8/8/2019 Quick Start With Data Federator Xi
36/38
2010 SAP AG. All rights reserved. / Page 36
CONCLUSION
Data Federator is the solution of choice for agile BI data integration
Real time multi-source reporting
Integrate on-demand information into BI applications
Prototyping
Data Federator extends and adds value to our offering Uniform access and query to your information systems
Extend classic BOBJ products
Multi-source Universe, access to non relational systems, SAS, XML and Web Services
Pervasive Federation
Creative analysis comes from combining sources (connected the dots)
Vertical vs. horizontal access to information (break information silos)
All your information cannot be stored in one place
-
8/8/2019 Quick Start With Data Federator Xi
37/38
Questions
-
8/8/2019 Quick Start With Data Federator Xi
38/38
Thank you!