what's new for sap businessojects data services xi 4.0 - vision and roadmap

]

SARAH MERTZ[ASUG INSTALLATION MEMBER

MEMBER SINCE: 1998

DAVID SWIERENGA[ASUG INSTALLATION MEMBER

MEMBER SINCE: 2005

GREG REISCHLEIN[ASUG INSTALLATION MEMBER

MEMBER SINCE: 2007

What’s new in DataServices 4.0

Werner Daehn

Real Experience. Real Advantage.

[

2

Learning Points

Where are we today and Vision

What is Information Steward

DataQuality enhancements

DataIntegration enhancements


[

Are these terms consistent

with our business

definitions?

Can I trust this data enough

to make my critical

decisions? Has the data

passed all our business rule

checks?

How current is this data?

When was it last updated?

Where did these numbers

come from? Are we

considering all our relevant

sources?

How Good Is the Data Behind Your Dashboard

EIM adds trust in your data


[ SAP Provides Best-In-Class EIM SolutionsDeliver Information That Is Complete, Accurate, and Accessible

Data Integration & Quality Management:

SAP BusinessObjects Data Services

SAP BusinessObjects Data Quality Management

SAP BusinessObjects Data Federator

SAP BusinessObjects Text Analysis

SAP BusinessObjects Data Insight

SAP Data Migration services

Master Data Management:

SAP NetWeaver Master Data Management

SAP Master Data Governance for Financials

Enterprise Data Warehousing:

SAP NetWeaver Business Warehouse

SAP NetWeaver Business Warehouse Accelerator

SAP BusinessObjects Rapid Marts

SAP BusinessObjects Metadata Management

Content &

Information Lifecycle Management:

SAP NetWeaver Information Lifecycle Management

SAP Extended ECM by Open Text

SAP Document Access by Open Text

SAP Archiving by Open Text


[SAP Provides an Integrated End-to-End IM Platform

SAP NetWeaver

BW

Data Federator

Data Services

Data Quality

ManagementData IntegratorD

ata

Fo

un

dati

on

SAP NetWeaver

BW Accelerator

Master Data

Management

Text

Analysis

CRM SCM

SRM PLM

SAP Business Suite

ERP

Financials

Operations

Human Resources

Corporate Services

Data

Quality

Mgmt

3rd-Party Databases and Applications

‘Classic’ SAPSAP Business Objects

Portfolio (SBOP)3rd-Party *SBOP Advanced Analysis (fka project Pioneer) planned for 2010

Me

ta D

ata

Ma

na

ge

me

nt

SAP NetWeaver PortalAny Portal, Any

Destination

SAP BusinessObjects Enterprise

Crystal

ReportsWeb Intelligence Xcelsius

OLAP

client

(SAP BEx,

Advanced

Analysis*)

Info

rmati

on

Acc

es

s

Explorer

Mobile BI

© SAP 2010 /


[ SAP BusinessObjects Data ServicesIntegrate and Improve the Quality of All Data

Market-leading, unified solution for

enterprise-class data integration and

data quality

Single, easy-to-use user interface to build,

test and deploy projects

Connect, transform and make the information

available from virtually any source

Comprehensive data quality solution for

cleansing and enriching all types of data

Scalable solution for high data volumes with

high throughput (batch and real-time)

SAP BusinessObjects Data Services is a “leader” in the Data Integration

and Data Quality Magic Quadrants from Gartner, as well as in the Data

Integration Forrester Wave.

SAP has 5000+ customers on our Data Integration and Data Quality

solutions.

“


[ Building the EIM Suite

What we have : What we want :

Many user interfaces

Metadata spread across repositories

Multiple ways to specify rules

Multiple engines

Multiple platforms

One solution for all Information

Management tasks

Limited number of interfaces for

different types of users

Seamless metadata

DS

(DI+DQ)

TA

BOMM

Data

Insight

MDM

Design Administer

Stewardship/

Governance

Universe

Designer


[ IM Solution Suite Goals

To

ols

Business User UI Designer Administration

Use

rs Developers Administrators

Data Stewards & Business Analysts

Pla

tfo

rm

Core Platform Services (security, user management, scheduling, ...)

Provided by SAP BusinessObjects Enterprise

Se

rvic

es

ETL DQ Profile Text MetadataBusiness User FocusTypically, IM products have not

been focused on the non-IT

users. The interfaces are much

too technical for even those

tasks that require considerable

business knowledge and input.

We plan to change that.

Data Governance and TrustIM provides the key elements that enable governance and improve trust in

the data infrastructure. From data quality to profiling to business metadata,

we plan to bring key IM capabilities in service of governance initiatives.

Integrated IM SuiteThe cost of IM deployments has

been raised by piecemeal,

disconnected tools. An integrated

suite based on a common

platform will reduce development

and operating costs.


[

New functionality in the core Data Services 4.0 release

Information Steward

Text Data Processing

Enhanced Data Quality Management

BOE Integration/New security model

Superior SAP support

Other goodies

But DataServices 4.0 is used for more...

Provides embedded Data Integration and Data Quality

SAP BusinessObjects Information Steward backend

HANA (High-performance analytical appliance) loading

SAP BO Financial Information Management (FIM) loading

SAP BusinessObjects DataServices 4.0


[ SAP Completeness of Vision:

EIM Portfolio Consolidation and Integration

TextAnalysis

MetadataManagement

Data Integration

Data QualityManagement

SBOPData Services

SBOP Data Insight

SBOP Information Steward

Master Data Management

Data Profiling

SBOP Metadata Mgmt

SAP NW MDM

SBOPText Analysis

Current 3.2 timeline 4.0 versionSolution


[ SAP BusinessObjects Information Steward 4.0

Discover

Profile and

analyze enterprise data

Catalog data

assets

Monitor & Remediate

Surface data

quality scores in

other applications

Monitor

data quality

Single environment to discover, assess, define, monitor, and

improve your enterprise data assets

SBOP

Information

Steward

Create cleansing

packages for

parsing/standardization

Define

Define business

terms and establish

validation rules

Assign data

ownership


[ Data Services 4.0 & Information Steward : Introducing

Cleansing Package Builder

Empowers Business Users to specify data cleansing rules

Allows users to

Enhance regional

cleansing packages

for person and firm

data

Develop new data

cleansing solutions

for non-party data

Creates the dictionary

for DataServices


[


Information Steward





Other goodies










TextAnalysis

MetadataManagement

Data Integration


SBOPData Services

SBOP Data Insight

SBOP Data Services

SBOP Information Steward


Data Profiling

SBOP Metadata Mgmt

SAP NW MDM

SBOPText Analysis



[ Data ExplosionA Natural Result of Modern Societies, Businesses, and the Internet

Source: IDC, 2009

Data created each year


[ 80% of Data Is Unstructured

Source: IDC

Unstructured information

Structured information


[ Text Data Processing Capabilities

Access text data in log files, spreadsheets, surveys, comments

fields and in similar places

Sort through the noise of unstructured content by

automatically identifying what your text content is “about”

Who, what, where, when, how much, etc


[ Text Data Processing on the Data Services Platform

Native Text Data Processing with Entity Extraction transform

Predefined entities (like company, person,

firm, city, country, …)

Sentiment Analysis (e.g. Strong positive,

Weak positive, Neutral, Strong Negative)

Custom entities (via dictionaries)

Languages supported (for version 4.0)

English

German

French

Spanish

Japanese

Simplified Chinese


[


Information Steward





Other goodies










TextAnalysis

MetadataManagement

Data Integration


SBOPData Services

SBOP Data Insight

SBOP Information Steward 4.0

SAP NWMDM


Data Profiling

SBOP Metadata Mgmt

SAP NW MDM

SBOPText Analysis


SB

OP

Ente

rprise

SBOP Data Services 4.0

DQM SDK 4.0


[

Customer‟s Application (Provides the “Platform” for DQM SDK)

C++, Java, or

.Net API’s

Embed Data Quality natively in any application

Data Services Platform

Pass in data for

processing via

API

Retrieve

operational

metadata via APIReference

Data Files

Specify Data

Quality Rules via

XML passed to

API

RDBMS

Flat-File

XML

Cobol Copy Books

JMS

Web Services

Etc…

RDBMS

Flat-File

XML

Cobol Copy Books

JMS

Web Services

Etc…


[

© SAP 2009 / Page 23

What is Data Quality Management ?

Guarantee Clean and Accurate Data

CONTINUOUS

MONITORINGMEASURE

ANALYZE

PARSE

STANDARDIZE

CORRECT

ENHANCE

MATCH

CONSOLIDATE

Data Assessment

Enhance

Data Cleansing

Match &

Consolidate

Continuous Monitoring

Data Cleansing: automatically

correct your data based on

reference data and data

cleansing rules

Address cleansing

Data Cleansing

Data Enhancement: enhance

the data with additional

attributes.

e.g. geocoding: adding

latitude and longitude

information

Match and Consolidate:

finding duplicates and merging

records into one consolidated

record

Data Quality Management on the Data Services platform includes:


[ Expanding the Geographical Reach in Data Services 4.0

Address Cleansing

240 countries covered of which 37 with country specific directories

New in Data Services 4.0 : street level validation for China

Geocoding

Support for United States, Canada, UK, France and Germany

New in Data Services 4.0 : adding Austria and Switzerland

*City Level Validation

*Street and House Level Validation

new


[ Validation Transform enhanced

New GUI design

Multiple rules per

column

Complex rules across

multiple columns

Integration with

Information Steward

maintained rules

25


[ Internal Cleanups

No AddressServer component but native engine code

Native DataType support for performance

NULLs are NULLs

Proximity Matching

Diameter 0.19 is matching diameter 0.18

Long/Lat values are very close

More input options, more output options in the DQ

transforms

26


[


Information Steward



BOE integration/New security model


Other goodies








[ DataServices 4.0 and SAP BusinessObjects Enterprise 4.0

Single location to store all users and connections to repositories

Advanced user management with password policies etc

Use external authentication mechanisms like Active Directory, etc

Manage permissions to control access to repositories and administative tasks

to more granular level.

To

ols

Business User UI Designer Administration

Use

rs Developers Administrators

Data Stewards & Business Analysts

Pla

tfo

rm

Core Platform Services (security, user management, scheduling, ...)

Provided by SAP BusinessObjects Enterprise

Se

rvic

es

ETL DQ Profile Text Metadata

SAP BusinessObjects

Data Services 4.0

leverages the

SAP BusinessObjects

Enterprise 4.0 platform

for its user management.


[ SAP BusinessObjects Information Platform Services 4.0

BOE customer maintain all users and permission centrally in the

CMC (Central Management Console)

None-BOE customers get a mini-version of BOE

Only the CMS and related services (no reporting or dashboard

engines)

Offers all platform functionality for user management,

authentication, authorization, scheduling, job processing, ...

Available for all Data Services customers from their Data Services

download


[


Information Steward





Other goodies








[ Extractor Support for Native Access to SAP

Access the business content extractors natively (no

BW required)

No other tool – apart from BW – will be able to access

these extractors.

Benefits

Return “Business Terms” not database fields

They include support for delta queues

Using ABAP dataflows is optional, data can be streamed

As simple as reading from tables


[ Extractor support: Customer benefits

BW customers

Apply DQ transformations when loading SAP data into BW

Non-BW customers

Get access to the Business Suite same way as BW does

SAP

Business Suite

All 3rd-Party

Data SourcesSAP BusinessObjects

Data Services

SAP Extractors

DWH,

data marts,

applications, ...

SAP NetWeaver

BW


[ SAP Integration: Extractor Support

Use extractors in a data flow like a

regular source

Browse & import extractors in an

SAP applications datastore


[ Other SAP Integrations: Data Services for SAP BW 7.3

Integrated Data Services connectivity in NetWeaver BW 7.3

From within the BW, browse external metadata through Data

Services connectivity

BW GUI can use DataServices as backend for loading data

Native loading into DataSources instead of InfoSources

No need to use BW 3.5 emulation mode


[ Other SAP Integrations: SAP Solution Manager 7.1

SLD (System Landscape Directory) :

Register Data Services components (Job Server, Access Server, and

Management Console) in SLD.

SLD will show all SAP software installed

Provide monitoring/performance statistics with CA

Wily/Introscope

CPU/memory usage and

total execution time at job

level

Predefined DataServices

dashboards for Solution

Manager


[


Information Steward





Other goodies








[ Enhancements worth mentioning

Some goodies

ANSI join support (seperate WHERE and JOIN clauses)

Datastore configurations for WebServices datastore

Support for Synonyms (Oracle and DB2)

Built-in function for encrypt/decrypt

Native 64-bit support for server components

Server components will only run on 64-bit

Now also on Windows we can benefit from more memory – not

limited to 2 GB per process anymore

We discontinue support for 32-bit servers, so all server components

requires 64-bit hardware/OS versions.

Clients will still run on 32-bit (but a 64-bit version of Designer is

available too)


[


Information Steward





Other goodies








[

NewDB

(in memory)

SAP

ERP

Any Source

BW

Modeler

Data Load

Metadata

Repository

ServerOpen Hub

SAP BusinessObjects

Data Services HANA

Designer and

Management

Console

SAP BusinessObjects Data Services is the engine to load all data into NewDB (in memory)

Loading via ODBC array loads with optimizations for bulk/initial loads

The HANA Modeler will generate initial loading jobs

Modeler will use Data Services S to browse and „import‟ external metadata

Modeler will generate initial flows to load data into New DB tables

Further modifications to flows done via Data Services Designer

Run-time monitoring, administration done via Data Services Admin Console

SAP BusinessObjects DataServices 4.0 and HANA


[

40

Key Learnings

DataServices 4.0 needs a (mini-) CMC

New Text Analytics Transform

Even embedded into other company’s products

Extractor support can have a large impact on the customer

DWH strategy

DataServices is used in more and more places and initiatives


[

41

[

] Thank you for participating.

SESSION CODE:

306

Please remember to complete and return your

evaluation form following this session.

For ongoing education on this area of focus, visit the Year-Round

Community page at www.asug.com/yrc

what's new for sap businessojects data services xi 4.0 - vision and roadmap

Documents