sap business warehouse, sap hana and sybase iq (1).pdf

34
Data Warehousing Solutions from SAP One Happy Data Warehouse family SAP Business Warehouse, SAP HANA and Sybase IQ Nov 2011

Upload: manikbasha009

Post on 29-Nov-2015

76 views

Category:

Documents


2 download

DESCRIPTION

SAP Business Warehouse, SAP HANA and Sybase

TRANSCRIPT

Data Warehousing Solutions from SAP

One Happy Data Warehouse family

SAP Business Warehouse, SAP HANA and Sybase IQ

Nov 2011

© 2011 SAP AG. All rights reserved. 1 Confidential

Legal Disclaimer

The information in this presentation is confidential and proprietary to SAP and may not be disclosed without

the permission of SAP. This presentation is not subject to your license agreement or any other service or

subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this

document or any related presentation, or to develop or release any functionality mentioned therein. This

document, or any related presentation and SAP's strategy and possible future developments, products

and/or platforms directions and functionality are all subject to change and may be changed by SAP at any

time for any reason without notice. The information on this document is not a commitment, promise or legal

obligation to deliver any material, code or functionality. This document is provided without a warranty of any

kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness

for a particular purpose, or non-infringement. This document is for informational purposes and may not be

incorporated into a contract. SAP assumes no responsibility for errors or omissions in this document, and

shall have no liability for damages of any kind including without limitation direct, special, indirect, or

consequential damages that may result from the use of this document. This limitation shall not apply in

cases of intent or gross negligence.

All forward-looking statements are subject to various risks and uncertainties that could cause actual results

to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-

looking statements, which speak only as of their dates, and they should not be relied upon in making

purchasing decisions.

© 2011 SAP AG. All rights reserved. 3 Confidential

The Most Comprehensive Solution Portfolio From the Leader in Business Analytics

Strategy Management

Planning, Budgeting, and

Forecasting

Profitability and Cost Management

Financial Consolidation

Enterprise Performance Management

Disclosure Management

Enterprise Data Warehouse

RDBMS

Enterprise Data Warehousing

Reporting and Analysis

Dashboards and Visualization

Data Exploration Mobile

BI Platform

Business Intelligence

Enterprise GRC Access Risk Management

Global Trade Services

Continuous Transaction Monitoring

Governance, Risk, and Compliance

Data Services

Master Data Management

Event Processing

Content Management

Enterprise Information Management

Information Governance

Analytic Applications

By LoB Service, Sales, and Marketing

Procurement

Supply Chain

Finance

Sustainability

IT, HR, and more…

By Industry Financial Services

Public Sector and Healthcare

Manufacturing

Consumer Products

Retail and Telco

Utilities and more….

© 2011 SAP AG. All rights reserved. 4 Confidential

Data Warehousing Solutions from SAP Comprehensive data foundation enabling price/performance optimization

Complex and diverse challenges

Real-time analytics

– Immediate availability of data for analysis

– Fast and easy creation of ad-hoc views

Big data

– Massive data volumes

– Structured and unstructured data

Efficiency

– Reduce complexity and minimize TCO

Sophisticated information landscapes

High-performance operational analytics

– In-memory and disk storage

Enterprise data warehousing

– SAP and non-SAP source systems

– Complex transformations

Customer choice via complementary and

inter-operable solutions

SAP HANA

Sybase IQ

– Sybase PowerDesigner

SAP NetWeaver Business Warehouse

– SAP NetWeaver BW Accelerator

Disk

© 2011 SAP AG. All rights reserved. 5 Confidential

1. SAP NetWeaver Business Warehouse

2. SAP HANA Appliance

3. Sybase IQ

4. Sybase Power Designer

5. Teradata Foundation for SAP NetWeaver BW

6. SAP BusinessObjects Rapid Marts

Most Complete Offering Data Warehousing Solutions from SAP

© 2011 SAP AG. All rights reserved. 6 Confidential

SAP NetWeaver Business Warehouse Strong EDW capabilities

Reliable

Data Acquisition

Business

Content

Streamlined

Operations

Lifecycle

Management

Fast, sustainable implementation through:

Modeling Patterns

Business Content

Openness and data quality through:

Out-of-the box integration for data originating in SAP systems

Integrated with SAP BusinessObjects Data Services (Data Integrator and Data Quality Management)

Efficient data management through:

Management of data consistency

Sophisticated Security, Authorization and Identity Handling

High availability

Enable sophisticated lifecycle management at different levels:

System

Meta Data

Data (Nearline storage, archiving)

Integrated, scalable Enterprise Data Warehouse (EDW) platform

EDW = Database + X

© 2011 SAP AG. All rights reserved. 7 Confidential

SAP NetWeaver Business Warehouse Stable Product, Large installed Base, Constant Growth

Adoption of SAP NetWeaver BW constantly growing

Unaffected by economic down-turn in 2009

More than 12000 customers referring to more than 15000 productive systems

13

,91

0

14

,21

7

14

,45

0

14

,69

3

14

,95

2

15

,24

3

15

,53

3

15

,67

1

12,000

12,500

13,000

13,500

14,000

14,500

15,000

15,500

16,000

Q3 0

9

Q4 0

9

Q1 1

0

Q2 1

0

Q3 1

0

Q4 1

0

Q1 1

1

Q2 1

1

Productive SAP NetWeaver BW systems – constant growth

© 2011 SAP AG. All rights reserved. 8 Confidential

SAP NetWeaver Business Warehouse

Overview

Staging

Acceleration Archiving

EDW based on the Layered Scalable

Architecture (LSA) that satisfies the

need of decision makers across all areas

of a company and acts as a single point

of truth for any kind of information.

Includes capabilities for data flow

modeling, ETL process modeling, real

time data acquisition, scheduling,

administration lifecycle management,

and high performance OLAP

processing.

What is SAP NetWeaver Business Warehouse

© 2011 SAP AG. All rights reserved. 9 Confidential

In-Memory Computing – a new Lifestyle

Technology that allows the processing

of massive quantities of real time data

in the main memory of the server

to provide immediate results from

analyses and transactions

© 2011 SAP AG. All rights reserved. 10 Confidential

In-Memory Computing

“By 2012, 70% of Global 1000 organizations will load detailed data into

memory as the primary method to optimize BI application performance.”

- Gartner

Conventional Databases

Disk Read

5 milliseconds

In-Memory Databases

Disk Read

5 nanoseconds

© 2011 SAP AG. All rights reserved. 11 Confidential

A Shift of Frontiers in Computer Science Freely Adapted from Jim Gray, Turing Award Winner 1998

Tape is Dead

Disk is Tape

Main Memory is Disk

CPU Cache is Main

Memory

© 2011 SAP AG. All rights reserved. 12 Confidential

SAP In-Memory Evolution

SAP BusinessObjects

and other Applications

SQ

L

MD

X

BIC

S

SAP HANA

SAP

ECC

SAP BW

3rd Party

Real-

Time

Replicati

on

SAP BusinessObjects

Data Services

SAP BWA

Accelerate BWA

Explorer

Open Acceleration

Self-Service BI

SAP HANA

In-Memory Platform

2007 2009 2010+

© 2011 SAP AG. All rights reserved. 13 Confidential

What is SAP HANA

A flexible, data source agnostic in-memory

appliance to quickly process and analyze

large volumes of transactional data in real

time

Includes capabilities for calculation

processing, data modeling, lifecycle

management, security, operations, and so

forth

Combines SAP software components

optimized on hardware (blades) provided,

and delivered, by SAP’s leading hardware

partners.

SAP HANA Appliance

Overview

SAP HANA Modeling Studio

Real-Time Data Replication

SAP HANA™

SAP BusinessObjects BI Solutions

SAP Applications Non SAP Data

sources

SAP HANA Database

Calculation Engine

Row & Column In-Memory

SAP BusinessObjects Data Integrator

© 2011 SAP AG. All rights reserved. 14 Confidential

In-Memory Computing – The Time is NOW Orchestrating Technology Innovations

HW Technology Innovations

64bit address space – 2TB in

current servers

100GB/s data throughput

Dramatic decline in

price/performance

Multi-Core Architecture (8 x 8core CPU

per blade)

Massive parallel scaling with many

blades

One blade ~$50.000 = 1 Enterprise

Class Server

Row and Column Store

Compression

Partitioning

No Aggregate Tables

The elements of in-memory computing are not new. However, dramatically improved hardware economics and

technology innovations in software have now made it possible for SAP to deliver on its vision of the Real-Time

Enterprise with in-memory business applications

SAP SW Technology Innovations

© 2011 SAP AG. All rights reserved. 15 Confidential

Fast – Software Optimization for Memory

Conventional databases store records in rows

Storing data in columns enables faster in-memory processing

of operations such as aggregates

Columnar layout supports sequential memory access

A simple aggregate can be processed in one linear scan

A 10 € B 35 $ C 2 € D 40 € E 12 $

A B C D E 10 35 2 40 12 € $ € € $

memory address

organize by row

organize by column

A 10 €

B 35 $

C 2 €

D 40 €

E 12 $

conceptual view

mapping to memory

© 2011 SAP AG. All rights reserved. 16 Confidential

SAP HANA™

■ In-Memory software + hardware

(HP, IBM, Fujitsu, Cisco, Dell)

■ Data Modeling and Data Management

■ Real-time Data Replication

■ SAP BusinessObjects Data Services for ETL

capabilities from SAP Business Suite, SAP

NetWeaver Business Warehouse (SAP NetWeaver

BW), and 3rd Party Systems

Capabilities Enabled

■ Analyze information in real-time at

unprecedented speeds on large volumes of non-

aggregated data

■ Create flexible analytic models based on real-

time and historic business data

■ Foundation for new category of applications

(e.g., planning, simulation) to significantly

outperform current applications in category

■ Minimize data duplication

SAP In-Memory Appliance (SAP HANA™)

SAP HANA Studio

Real-Time Data Replication

SAP HANA™

SAP

Applications Non SAP Data

sources

SAP HANA Database

Calculation Engine

Row & Column In-Memory

SAP BusinessObjects Data Integrator

SAP Information Composer

SAP BusinessObjects

BI Solutions

Other

Applications

© 2011 SAP AG. All rights reserved. 17 Confidential

SAP HANA Proof Points

460B Data records

analyzed in less

than a second

21% Average increase

in revenue

3600x Faster reporting

speed

© 2011 SAP AG. All rights reserved. 18 Confidential

A platform for delivering a new class of real-time analytics

and applications

Real-time analytics

SAP Business Suite Third-party systems

SAP HANA

Microsoft

Excel

SAP Business

Objects solutions

Other devices

(mobile)

Real-time replication services

Data services

Real-time

applications

In-memory database

Planning and calculation engine

Business function library

Application services

SAP NetWeaver

Business Client

© 2011 SAP AG. All rights reserved. 19 Confidential

HANA

Operational Performance Applications

Planning Simulation

Forecasting

SAP ERP Acceleration

real-time replication

service

DATA SERVICES

Premium connectors &

Content

Any Data Source

Acceleration

SAP Business Objects BI

APPLICATIONS RUNNING ON SAP HAHA

TODAY

SAP BusinessObjects Strategic workforce

planning

SAP CO-PA Accelerator

SAP ERP Operational Reporting

SAP Smart Meter Analytics

TOMORROW

Lines of Business

Industries

Cross

SAP Applications Running on SAP HANA

Roadmap

© 2011 SAP AG. All rights reserved. 20 Confidential

SAP HANA: Value Proposition Addressing Key Business Drivers

Make Decisions in Real-time

Fast and easy creation of ad-hoc views on business

Access to real time analysis

Accelerate Business Performance

Increase speed of transactional information flow in

areas such as planning, forecasting, pricing, offers…

Unlock New Insights

Remove constraints for analyzing large data

volumes, trends, data mining, predictive analytics…

Structured and unstructured data

Increase Business Productivity

Business designed and owned analytical models

reduce reliance on IT

Use data from anywhere

Improve IT Efficiency

Manage growing data volume and complexity

Lower landscape costs

Speed

Scale

Flexibility

© 2011 SAP AG. All rights reserved. 21 Confidential

Sybase IQ Product Profile

Grid Based Column Store

Fast Complex Queries High Performance Data

Loads Storage, User Scalability

Non-relational Data Support

Schema Independent

3NF, Star, Flat

Standard Connectivity: ODBC, JDBC OLE-DB

Standard Language: ANSI SQL

Platform Agnostic: Linux, Unix,

Windows

Outside: Standards based open interfaces enables best-of-

breed eco-System

Inside: Architected

ground up for High Performance

Analytics

© 2010 SAP AG. All rights reserved. / Page 22

What Analysts Say

Gartner

• “During the past few years, Sybase has shown increased ability to

move from offering an analytic data mart to offering an enterprise

data warehouse DBMS. “

• “The company has consistently won POCs with analytic

applications, sometimes with performance 100 times greater than its

competitors. “

• “We believe Sybase will achieve increased market share growth in

2011 and beyond. “

Gartner, Jan 2010 MQ for DW Database Mgt Systems

Forrester • “Sybase’s mature columnar EDW platform, coupled with a fresh

injection of development capital from new parent SAP, gives it a

competitive advantage.”

• “Expect SAP Sybase to leverage these strengths, plus intensify

its focus on in-memory and in-database analytics, to grow its

share of the EDW market among large enterprises requiring

robust real-time analytics solutions.”

Forrester, Feb 2010 EDW Platform Wave

© 2011 SAP AG. All rights reserved. 23 Confidential

Sybase IQ Widespread Adoption

Stands out as the

leading enterprise

data warehouse

amongst the largest

banks, insurance

agencies, and telecom

operators worldwide Manage and analyze

statistical measures

for the entire nation

of Canada

Analyze complex

models in more than

200 financial

institutions

worldwide

Analyze ALL Federal

tax returns in the US

Store and Analyze massive amounts of industry segment data in 30 of

the largest information providers in the world, including Transunion,

Nielsen

and Axiom

© 2010 SAP AG. All rights reserved. / Page 24

Sybase IQ Designed for Analytics

Each column is stored separately

Bitmapped Index

Index on every column

Fast access and load

Data Is Stored Vertically

Input data is compressed

Usually = 40%-70%

Database smaller than input data

Even with all the indexes

Optimized Storage

Reduces system I/O dramatically

Average 90% less than competition

Permits better data manipulation

Easy to alter and manage

Query Engine Retrieves

Only Columns Used in the Query

Design based on application use

Flat, Star, Relational, Snowflake

Any schema

Schema Design Not Restricted

© 2011 SAP AG. All rights reserved. 25 Confidential

Designed and optimized for fast query processing

More efficient utilization of hardware resources

Accelerating Reporting Systems

Sybase IQ

Offload

Reporting

Data

Operational

System's)

Reporting

and Decision

Support

Systems

Reporting

Applications

and Users

ETL

Replication

Data warehouse's

Order Entry Sybase ASE

Billing DB2

Inventory Oracle

Offload scheduled production reports, on-demand reporting, KPIs, and dashboards from

transactional systems or databases to a Sybase IQ column-based analytics server

© 2011 SAP AG. All rights reserved. 26 Confidential

Accelerating Advanced Analytics

Custom SQL/C++ UDFs

Tool Kit VisualNumerics.

Package App Fair Isaac,…

ETL Custom Replication

Transaction

Database

Flat Files

EDW

Speed for complex

queries on large

data sets

VLDB scaling

deep analysis

Speed for complex

unplanned/ad-hoc

queries

Support for

visualization/simula

tion/analysis tools

Logical Servers for

Virtual Data Marts

Source

Data Integration

Enterprise

Data Warehouse

Analytical Data Marts

Analysis Interface

Users/Analysts

Text Files

Power Users

IQ

IQ

IQ

© 2011 SAP AG. All rights reserved. 27 Confidential

Data Compression Dramatically Reduces Storage and Maintenance

Base table:

0.2 - 0.5 TB

Indexes:

0.05 - 0.3 TB

Aggr/Summ:

0 - 0.1 TB

Conventional DBMS

Summaries

Aggregates

1 – 2 TB

Indexes

0.5 – 3 TB

Base table

―RAW data‖

no indexes

0.9 – 1.1 TB

2.4-6

TB

0.25 - 0.9

TB

Same INPUT data:

―Conventional DW‖

is 3x-6x larger than

Sybase IQ DW

LOAD

Source: flat files, ETL, replication, ODS

LOAD

INPUT DATA:

1 TB

© 2011 SAP AG. All rights reserved. 28 Confidential

Sybase IQ Integrated Text Analysis

Relational Data

Non- Relational Text Data

SYBASE IQ

Combined Analytics with

In-database Text Indexing

Optional 3rd party pre-filter/ Text Segmentation or Entity Extractors

Text Search: Email-Archiving, E-discovery, E-library

Text Analytics: Fraud detection, Risk analytics, News feed analysis

Text Mining: Clustering, categorization, sentiment analysis

• Text Index – SQL based on terms/phrases, prefix, proximity, scoring

• Interface to plug in 3rd party Document converters or Term Breakers

• 3rd party text mining libraries (not available in GA)

© 2011 SAP AG. All rights reserved. 29 Confidential

The Sybase IQ Advantage

Speed from a vertical, column-based architecture

Up to 1000-times faster than traditional transactional database technology

High-speed analytics performance handles volumes of ad-hoc queries in

―real-time‖

Scalability and flexibility from multiplexing

Supports thousands of users and years of historical and real-time data

Can support both simple and complex analytics for structured and

unstructured data

Lowest TCO from data compression

Compression algorithms reduce volume of stored data by up to 70%

Low startup and long-term TCO — less storage and maintenance resources

Easy to learn and use — minimal training and staff requirements

© 2010 SAP AG. All rights reserved. / Page 30

Data Warehousing Solutions from SAP Summary

Solving complex and diverse challenges

Real-time analytics

Big data

Efficiency

Powering sophisticated information landscapes

High-performance operational analytics

Enterprise data warehousing

Providing customer choice through

complementary and inter-operable solutions

SAP HANA Appliance

Sybase IQ

SAP NetWeaver Business Warehouse

SAP BusinessObjects Rapid Marts

© 2010 SAP AG. All rights reserved. / Page 31

Data Warehousing Solutions from SAP Summary

Instant access to massive

volumes of data

Flexible data foundation to enable

analysis of any business question

Optimize time-to-value by lowering

costs and implementation times

Questions?

Yuvaraj Athur Raghuvir

Data Warehouse Solution Management

[email protected]

Bruce Taylor

Global CoE Data Warehouse Solutions

[email protected]

Contact information:

© 2011 SAP AG. All rights reserved. 33 Confidential

THANK YOU

THANK YOU

Copyright

© Copyright 2011 SAP AG. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information

contained herein may be changed without prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.

IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries,

xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+,

POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect,

RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks

of IBM Corporation.

Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States

and/or other countries.

Oracle is a registered trademark of Oracle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.

HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Sun Microsystems, Inc.

JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP Business ByDesign, and other SAP products and services mentioned herein as well as their

respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.

Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business

Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects S.A. in the

United States and in other countries. Business Objects is an SAP company.

All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational

purposes only. National product specifications may vary.

These materials are subject to change without notice. These materials are provided by SAP AG and its affiliated companies ("SAP Group") for informational

purposes only, without representation or warranty of any kind, and SAP Group shall not be liable for errors or omissions with respect to the materials. The only

warranties for SAP Group products and services are those that are set forth in the express warranty statements accompanying such products and services, if

any. Nothing herein should be construed as constituting an additional warranty.