quick start with data federator xi

Upload: vikram-kothakonda

Post on 09-Apr-2018

225 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/8/2019 Quick Start With Data Federator Xi

    1/38

    QUICK START WITH DATA FEDERATOR XI 3.xSession 813

    Pierpaolo Vezzosi, Group Product Manager, Semantic Layer

  • 8/8/2019 Quick Start With Data Federator Xi

    2/38

    2010 SAP AG. All rights reserved. / Page 2

    AGENDA

    1.Data Federator overview

    2.Data Federator and the suite

    3.Data Federator modeling and transformations

    4.Roadmap

    5.Conclusion

    6.Q & A

  • 8/8/2019 Quick Start With Data Federator Xi

    3/38

    2010 SAP AG. All rights reserved. / Page 3

    AGENDA

    1.Data Federator overview2.Data Federator and the suite

    3.Data Federator modeling and transformations

    4.Roadmap

    5.Conclusion

    6.Q & A

  • 8/8/2019 Quick Start With Data Federator Xi

    4/38

    2010 SAP AG. All rights reserved. / Page 4

    DATA EXPLOSIONA natural result of modern business and the internet

    281 billion gigabytes of digital data was

    created in 2007 which is equal to 5million times the information in all booksever written

    By 2011, data will grow 10 times theamount it was in 2006

    Data is scattered across the enterprise

    Redundant and inconsistent data isubiquitous

    Users can rarely perform cross-functional analysis

    Source: The Diverse and Exploding Digital Universe IDC, March 2008

  • 8/8/2019 Quick Start With Data Federator Xi

    5/38

    2010 SAP AG. All rights reserved. / Page 5

    CUSTOMER PAINS

    Cross functional analysis

    What is the difference between your production andanalysis data model?

    How many marts do you have? Do you have information silos?

    Difficult to integrate disparate sources

    Do you have on-premise and on-demand sources? How do you integrate your information systems?

    Time to solution What is the duration of your last data warehouse

    project? What is your process to add a new source of

    information to your data warehouse? How do you deal with ad-hoc marketing campaign?

    Real time information What is the latency of your information? Do you need real time information?

  • 8/8/2019 Quick Start With Data Federator Xi

    6/38

    2010 SAP AG. All rights reserved. / Page 6

    WHAT IS DATA FEDERATOR?

    Multi-source Query Engine

    SQL generator Optimizer (Optimize then re-write optimally native statements)

    Brokerage (combine source result sets)

    Uniform query mechanism independent of the sources

    Pull data on-demand

    Data Modeling

    Design any data models

    Transformations (support all the relational transformations)

    Map sources to target tables

    Connectors

    Connect to relational and non relational systems

    Databases, flat files, SAS, SAP BW, Web Services / XML

  • 8/8/2019 Quick Start With Data Federator Xi

    7/38 2010 SAP AG. All rights reserved. / Page 7

    DESIGN PHASEDESIGN A UNIFIED VIEW

    Connect to sources

    Extract metadata

    Relational and nonrelational

    Data model suitedfor analysis

    Data transformations

    XML to relationalconversion

    Web Services

    SAP 2009 / Page 7

  • 8/8/2019 Quick Start With Data Federator Xi

    8/38 2010 SAP AG. All rights reserved. / Page 8

    DESIGN PHASEDESIGN A UNIFIED VIEW

    Design a data model

    Business oriented Abstract physical

    implementation

    Flexible

    Connect to sources

    Extract metadata

    Relational and nonrelational

    Data model suitedfor analysis

    Data transformations

    XML to relationalconversion

    Web Services

    SAP 2009 / Page 8

  • 8/8/2019 Quick Start With Data Federator Xi

    9/38 2010 SAP AG. All rights reserved. / Page 9

    DESIGN PHASEDESIGN A UNIFIED VIEW

    Design a data model

    Business oriented Abstract physical

    implementation

    Flexible

    Transform data Business rules

    Case statements

    Align incompatible ID

    Merge lists

    Connect to sources

    Extract metadata

    Relational and nonrelational

    Data model suitedfor analysis

    Data transformations

    XML to relationalconversion

    Web Services

    SAP 2009 / Page 9

  • 8/8/2019 Quick Start With Data Federator Xi

    10/38 2010 SAP AG. All rights reserved. / Page 10

    RUNTIME PHASEQUERY ANY SOURCES UNIFORMLY

    Optimize

    Generate an optimalexecution plan

    Execute

    Submit sub queries

    Delegate computation tosources

    Execute SQL operationsnot supported by sources

    Adapt

    Generate native SQL Generate function calls

    from SQL (Web Services,ABAP)

    Submit sub queries

    SQL to WS calls

    Query using SQL

    Web Services

    SAP 2009 / Page 10

  • 8/8/2019 Quick Start With Data Federator Xi

    11/38 2010 SAP AG. All rights reserved. / Page 11

    DATA FEDERATOR ARCHITECTURE

    Receive SQL from Client tool

    ODBC or JDBC drivers

  • 8/8/2019 Quick Start With Data Federator Xi

    12/38 2010 SAP AG. All rights reserved. / Page 12

    DATA FEDERATOR ARCHITECTURE

    Optimize the query execution plan

    ODBC or JDBC drivers

  • 8/8/2019 Quick Start With Data Federator Xi

    13/38 2010 SAP AG. All rights reserved. / Page 13

    DATA FEDERATOR ARCHITECTURE

    ODBC or JDBC drivers

    Rewrite the SQL in native source syntax andsend each request to the sources

  • 8/8/2019 Quick Start With Data Federator Xi

    14/38 2010 SAP AG. All rights reserved. / Page 14

    DATA FEDERATOR ARCHITECTURE

    ODBC or JDBC drivers

    Receive data from each source

  • 8/8/2019 Quick Start With Data Federator Xi

    15/38 2010 SAP AG. All rights reserved. / Page 15

    DATA FEDERATOR ARCHITECTURE

    Synchronize data, aggregate it and send it tothe client tool

    ODBC or JDBC drivers

  • 8/8/2019 Quick Start With Data Federator Xi

    16/38 2010 SAP AG. All rights reserved. / Page 16

    AGENDA

    1.Data Federator overview

    2.Data Federator and the suite3.Data Federator modeling and transformations

    4.Roadmap

    5.Conclusion

    6.Q & A

  • 8/8/2019 Quick Start With Data Federator Xi

    17/38 2010 SAP AG. All rights reserved. / Page 17

    MULTI-SOURCE UNIVERSEHOW TO CONNECT UNIVERSE TO MULTIPLE SOURCES

    Universe Data Federator integration

    WebI Reports Universe Data Federator SAP ERP(Labs)

    SAP BW

    Teradata

    Data Federator Engine

    Connect to multiple relational and non-relational systems

    Optimize, generate and delegate SQL execution

    Join multiple sources effectively (brokerage)

    SAP 2009 / Page 17

  • 8/8/2019 Quick Start With Data Federator Xi

    18/38 2010 SAP AG. All rights reserved. / Page 18

    Universes

    PRODUCT INTEGRATIONUNIVERSE AND DATA FEDERATOR SEMANTIC LAYER

    Data model suitedfor analysis

    Data transformations

    XML to relationalconversion

    Web Services

    Data Federator

    Business Layer

  • 8/8/2019 Quick Start With Data Federator Xi

    19/38 2010 SAP AG. All rights reserved. / Page 19

    MULTI-SOURCE UNIVERSE

  • 8/8/2019 Quick Start With Data Federator Xi

    20/38 2010 SAP AG. All rights reserved. / Page 20

    AGENDA

    1.Data Federator overview

    2.Data Federator and the suite

    3.Data Federator modeling and transformations4.Roadmap

    5.Conclusion

    6.Q & A

  • 8/8/2019 Quick Start With Data Federator Xi

    21/38 2010 SAP AG. All rights reserved. / Page 21

    DATA FEDERATOR MAPPING RULESDATA MODELING TARGET TABLE

    SAP 2009 / Page 21

    Design any data models Top down or bottom up approaches

    Top down

    Design your tables independently of your sources

    Bottom up

    Leverage the source schema (copy database schema)

  • 8/8/2019 Quick Start With Data Federator Xi

    22/38 2010 SAP AG. All rights reserved. / Page 22

    DATA FEDERATOR MAPPING RULESDATA MODELING TARGET TABLE

    SAP 2009 / Page 22

  • 8/8/2019 Quick Start With Data Federator Xi

    23/38 2010 SAP AG. All rights reserved. / Page 23

    DATA FEDERATOR MAPPING RULESMAP SOURCES TO TARGET

    TPCR

    S1:CUSTOMER S2:NATION S3:REGION

    TPCRO

    FRENCH_CUSTOMER

    SAP 2009 / Page 23

    Sources

    Relationships

    (inner and leftouter joins)

    Mapping rule

    Target table

  • 8/8/2019 Quick Start With Data Federator Xi

    24/38 2010 SAP AG. All rights reserved. / Page 24

    DATA FEDERATOR MAPPING RULESPRE AND POST FILTERS

    SAP 2009 / Page 24

    Pre filters Filter data before entering Data Federator

    Post filters

    Filter data after the relationships

    S1:CUSTOMER S2:ORDER

    Pre filters

    Post filters

  • 8/8/2019 Quick Start With Data Federator Xi

    25/38 2010 SAP AG. All rights reserved. / Page 25

    DATA FEDERATOR MAPPING RULESPRE AND POST FILTERS

    SAP 2009 / Page 25

  • 8/8/2019 Quick Start With Data Federator Xi

    26/38 2010 SAP AG. All rights reserved. / Page 26

    DATA FEDERATOR MAPPING RULESPRE AND POST FILTERS

    SAP 2009 / Page 26

  • 8/8/2019 Quick Start With Data Federator Xi

    27/38

    2010 SAP AG. All rights reserved. / Page 27

    DATA FEDERATORDATA FLOW

    SAP 2009 / Page 27

    Target tableColumn = f( source columns)

    Post filter

    RelationshipsInstantiate the joins

    Pre filter(in the source)

    Source tables

    Mapping rule

  • 8/8/2019 Quick Start With Data Federator Xi

    28/38

    2010 SAP AG. All rights reserved. / Page 28

    SUPPORTED SOURCES AND PLATFORMS

    Data Federator supported platforms

    Data Federator online user guides

    Supported SourcesOracle Redbrick

    DB2 Generic ODBC

    SQL Server Generic JDBC

    MS Access Text files

    MySQL 5.x XML

    Teradata Web Services

    Sybase IQ & ASE SAS

    Netezza SAP BW

    Informix

    Supported PlaformsWindows

    Solaris

    AIX

    Suse Linux

    Red Hat Linux

    http://service.sap.com/bosap-supporthttp://help.sap.com/businessobject/product_guides/boexi3SP1/en/xi3_sp1_df_userguide_en.pdfhttp://help.sap.com/businessobject/product_guides/boexi3SP1/en/xi3_sp1_df_userguide_en.pdfhttp://service.sap.com/bosap-support
  • 8/8/2019 Quick Start With Data Federator Xi

    29/38

    2010 SAP AG. All rights reserved. / Page 29

    DATA FEDERATOR CONNECTOR FOR SAP BWQUERY SAP BW USING SQL (BYPASS THE OLAP ENGINE)

    BOBJ/SAP End-to-End Solution

    Information DemocracyWeb Intelligence

    (uses for analysis and reporting relational metaphor)

    Relational Universes(business objects defined using SQL)

    NetWeaver BI

    SAP NetWeaver 7.01

    Enterprise Data Warehouse

    SAP NetWeaver 7.01 BW OLAP Engine

    BEX / Pioneer(OLAP metaphors)

    MDX Queries SQL Queries

    Data Federator

    OLAP Universes(business objects

    defined using MDX)

  • 8/8/2019 Quick Start With Data Federator Xi

    30/38

    2010 SAP AG. All rights reserved. / Page 30

    DATA FEDERATOR WEB SERVICESMASH-UP WITHOUT PROGRAMMING

    Standard model (Relational)

    Automatically convert the XML returned by a Web service into a relational model

    Combine Web services by joining tables

    Standard query mechanism (SQL)

    Query Web services using SQL (fully compatible with tools from Business Objects)

    Design to query multiple sources (Unified view)

    Optimized to inject parameters dynamically

    Scalable and distributed architecture

    Design tool to define relationships between tables

    Can be used by power users (Non-IT)

    No development skills required to createWeb Services mashups

  • 8/8/2019 Quick Start With Data Federator Xi

    31/38

    2010 SAP AG. All rights reserved. / Page 31

    AGENDA

    1.Data Federator overview

    2.Data Federator and the suite

    3.Data Federator modeling and transformations

    4.Roadmap5.Conclusion

    6.Q & A

  • 8/8/2019 Quick Start With Data Federator Xi

    32/38

    2010 SAP AG. All rights reserved. / Page 32

    Safe Harbor Statement

    This document is intended to outline future product direction, and is not a commitment by SAP

    to deliver any given code or functionality. Any statements contained in this document that are

    not historical facts are forward-looking statements. SAP undertakes no obligation to publicly

    update or revise any forward-looking statements. All forward-looking statements are subject to

    various risks and uncertainties that could cause actual results to differ materially from

    expectations. The timing or release of any product described in this document remains at the

    sole discretion of SAP. This document is for informational purposes and may not be

    incorporated into a contract. Readers are cautioned not to place undue reliance on these

    forward-looking statements, and they should not be relied upon in making purchasing decisions.

    SAP BUSINESSOBJECTS DATA FEDERATOR

  • 8/8/2019 Quick Start With Data Federator Xi

    33/38

    2010 SAP AG. All rights reserved. / Page 33

    Agile integration

    Relational sources

    Web Services

    XML and flat files

    SAS

    SAP BW SQL connector

    SQL access to BW Automatic Universe

    generation

    Optimization and performance

    Query optimization algorithms

    Server balancing

    SAP ERP connector

    Infosets

    SAP queries

    RPC calls

    SSO

    End to end SSO to SAP BW

    and SAP ERP Sizing guide

    64 bit connectivity for all sources

    SAP BUSINESSOBJECTS DATA FEDERATOR

    Data Federator XI 3.0

    up to SP2

    Multi Source Universe

    (Federation in BOE)

    End Q3 2010

    Current

    BOE integration

    Query Server as a BOEservice

    CMC integration

    Multi-Source Universe (MSU)

    Federation desing within theinformation design

    tool(basic data integration, nodata modeling)

    Engine update

    Support native DB syntax

    New query optimizations

    Major release2010 Ramp Up

    Planned functionality only. SAP reserves the right to change planning.

    Data Federator XI 3.0 SP3

    AGENDA

  • 8/8/2019 Quick Start With Data Federator Xi

    34/38

    2010 SAP AG. All rights reserved. / Page 34

    AGENDA

    1.Data Federator overview

    2.Data Federator and the suite

    3.Data Federator modeling and transformations

    4.Roadmap

    5.Conclusion6.Q & A

  • 8/8/2019 Quick Start With Data Federator Xi

    35/38

    2010 SAP AG. All rights reserved. / Page 35

    DATA FEDERATOR SWEET SPOTS

    Ad-hoc SAP BW reporting

    Scalable WebI deployment on top of SAP BW

    Federate SAP BW with other sources

    Agile data integration

    Flexible data model

    Prototyping, faster time to solution, ad-hoc marketing campaigns

    Cross functional analysis

    Supercharge Data Warehouse (add real-time dimension/measure)

    Combine on-demand and on-premise information

    Combine BI and SAS information

    Operational BI

    Huge data source volume

    Real-time query to operational systems (data latency is not an option)

  • 8/8/2019 Quick Start With Data Federator Xi

    36/38

    2010 SAP AG. All rights reserved. / Page 36

    CONCLUSION

    Data Federator is the solution of choice for agile BI data integration

    Real time multi-source reporting

    Integrate on-demand information into BI applications

    Prototyping

    Data Federator extends and adds value to our offering Uniform access and query to your information systems

    Extend classic BOBJ products

    Multi-source Universe, access to non relational systems, SAS, XML and Web Services

    Pervasive Federation

    Creative analysis comes from combining sources (connected the dots)

    Vertical vs. horizontal access to information (break information silos)

    All your information cannot be stored in one place

  • 8/8/2019 Quick Start With Data Federator Xi

    37/38

    Questions

  • 8/8/2019 Quick Start With Data Federator Xi

    38/38

    Thank you!