comparing ibm db2 for z/os’s high performance analytics and transaction processing to oracle...

Comparing IBM DB2 for z/OS’s High Performance Analytics and Transaction Processing to OracleSession #6973Sheryl M. Larsen, IBMWed, 29/Oct, 03:00 PM - 04:00 PM

© 2014 IBM Corporation

Please Note• IBM’s statements regarding its plans, directions, and intent are subject to change or

withdrawal without notice at IBM’s sole discretion.

• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.

• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

2

Three Myths

#1 Oracle RAC can scale like DB2

#2 Oracle has the same availability as DB2

#3 Oracle Exadata Database Machine can do business analytics like DB2 + IBM DB2 Analytics Accelerator

Oracle Real Application Clusters for OLTP Demo

Server 1 Server 2

Transactions

Database Resources (rows)

Oracle RAC for OLTP

Server 1 Server 2

Transactions

Database Resources (rows)

Oracle RAC for OLTP

Server 1 Server 2

Transactions

Oracle RAC for OLTP

Inefficient utilization of resources!Limited Scalability!

Server 1 Server 2

Transactions

8

Oracle RAC uses network based sharing

LocksCache

LocksCache

LocksCache

Switch

Oracle Oracle Oracle

Disks

InfiniBand

SharedInterconnect

Shared disk across nodes

Software-based distributed lock and cache management

Less efficient scalability due to increasing inter-node activity as cluster grows or as workload increases

Unable to scale bandwidth for Data Warehouse processing

BEFORE / WITHOUT EXADATA

IBM Internal Use Only

Oracle 12c with Real Application Clusters (RAC)

• 3 Oracle 12c Instances, 1 per server

• RAC is software that manages the application clusters across the servers

9

Separate Servers- No shared components- Each running an Oracle

Instance

Fiber Channel Switch- for concurrent access to

shared storage

Single storage with single copy of the database

High Speed Interconnect

DB2 for z/OS Data Sharing is hardware based• There are many ways to separate DB2 Databases

For example, 1 LPAR on each machine

10

Coupling Facility(dedicated processors and memory)

Group BufferpoolsCentralized Lock Mechanism

Coupling Facility(dedicated processors and memory)

Group BufferpoolsCentralized Lock Mechanism

Shared Storage

DB2 for z/OS delivers a truly

scalable shared disk architectureTrue shared caching

Delivers better availability Hot pages stored in centralized

cache Faster recovery if one member

fails

DB2 for z/OSCentralized Coupling Facility Design

Oracle RAC Distributed Design

lock and buffer management communicates with central coupling facility

LocksCache

LocksCache

LocksCache

OracleNode

OracleNode

OracleNode

DB2 Parallel Sysplex Clusters vs. Oracle RAC

DB2

Member

DB2

Member

Shared Disk

LocksCache

DB2

Member

InfiniBand Switch

CF

Network Switch

Shared Disk

distributed locking and buffer management

11

Myth #1 Oracle RAC can scale like DB2

A and C have read locks and local copiesD is the lock master for this element

1. B requests write lock2. D requests C to release lock

3. C acknowledges4. D request A to release lock and transfer data element to B

5. A releases lock and transfers data element

6. B updates data, assumes lock and informs D

7. B updates local copy

Network

Instance

AInstance

BInstance

CInstance

D

100100 MasterNodeXX

Request Write Lock

Inter-node connections:

In a cluster with 4 nodes, an update operation may need 6 network connections and two in-memory calls (not shown).

1

Release Lock

2

Done

3

Inform Lock Holder

4

Transfer Lock and Data

5

Lock assume

6

115

Example based on Oracle’s US Patent 7,107,319 B2.

Oracle RAC’s distributed lock management design causes network overhead

12

z/OS image A with DB2

z/OS image B with DB2

z/OS image D with DB2

z/OS image C with DB2

High Speed Hardware

Links

100

100

X

X

CFBuffer Pools

Locks

1. B registers page to CF and obtains write lock

2. B updates data

3. B commits update

B caches update in group buffer pool

CF invalidates all cached copies without interrupting processors

115

Cache and locks are maintained with no inter-node disturbance!

A and C have data in local buffer pool without locks

100115

zEnterprise’s centralized Coupling Facility permits efficient lock and cache management in DB2

13

CF can support over 1 million requests per second

DB2 for z/OS Near Linear Scalability

5.24

9.98

6.86

3.48

1.781

2

3

4

5

6

7

8

9

10

11

12

1 2 3 4 5 6 7 8 9 10 11 12Nodes in Cluster

Pro

du

ctiv

e N

od

es

Perfect LinearPerformance

ProductiveNodes

1.692.44

Oracle RACPoor Scalability

Oracle RAC characteristics as shown in Dell RAC InfiniBand Study http://www.dell.com/downloads/global/power/ps2q07-20070279-Mahmood.pdfCERN (European Organization for Nuclear Research) http://www.oracleracsig.org/pls/apex/RAC_SIG.download_my_file?p_file=1001900Insight Technology http://www.insight-tec.com/en/mailmagazine/vol136.html

DB2 Parallel Sysplex Clusters Scale far Better!

DB2 for z/OS OLTP result (ITG ‘03)14

• DB2 for z/OS - Adding nodes is close to perfect linear scaling

• Oracle inter-node communications make scaling difficult

Myth #1 Oracle RAC can scale like DB2

What about Availability?

16

zEnterprise EC12 Parallel Sysplex Availability Leads The Pack

0

0.5

1

1.5

2

2.5

3

3.5

Source: ITIC: ITIC 2009 Global Server Hardware & Server OS Reliability Survey; July 2009; http://itic-corp.com/blog/2009/07/itic-2009-global-server-hardware-server-os-reliability-survey-results/; Results are measured in minutes per year. *Note: All operating systems included in the survey are not included in this chart. Fifteen operating systems on various processor architectures were included in the survey. The chart will be updated when the full report is available.

Novell Linux on Intel x86

(modified)

IBM AIX on

IBM Power

Downtime Survey (400 participants in 20 countries)

5 minutes

Mandrake Linux on

Intel x86

Sun Solaris

on Sun SPARC

HPHP-UX

on HP PA-RISC

HPHP-UX

on Intel Itanium

MicrosoftWin2003

on Intel x86

MicrosoftWin2008

on Intel x86

Novell Linux on Intel x86

(unmodified)

IBM z/OS

Sysplex

Do

wn

tim

e H

ou

rs P

er Y

ear

System z Parallel Sysplex with

99.999% availability

Myth #2 Oracle RAC can have the same availability as DB2

Availability: Maintenance and Upgrade

DB2 for z/OS: Applications keep running during maintenance and upgrades!

Oracle RAC requires downtime to upgrade the database

Refresh in place

Maintenance in place even with mixed versions

Source: Fact that RAC required downtime to upgrade is documented in Metalink Note 244241.1

Myth #2 Oracle RAC can have the same availability as DB2

CF

Single System Sysplex

CF

CF

CF

External Coupling Facility(Can be different class server)

CF

CF

CF

Cross Connected Serverswith internal Coupling Facilities

CF

zEnterprise parallel sysplex clusters provide unmatched processing power and availability

• Clustering driven by specialty engines (Coupling Facility)

• Presents a single system image of a z/OS workload

• Potentially 2.5M MIPS

per 32-way cluster*

• Enables rolling updates• Supports continuous access

to business services and data – from anywhere, at anytime

• Designed for 99.999% availability

*Equivalent to about 240 of the largest Oracle servers

18

Business AnalyticsDeep Analytics Operational AnalyticsTransactional

Complex analytic queries

Many concurrent queries

of varying complexity

Many concurrent transactions

response time throughput throughput

Optimal Execution of Mixed Workloads

19

Real time answers cannot be derived from extracted data sources

Myth #3 Oracle Exadata Database Machine handles business analytics like DB2 + IBM DB2 Analytics Accelerator

Exadata to the Rescue?

• Exadata intended to “fix” Oracle storage bottleneck for DW

• Extreme Performance and Scalability for All Applications

• Oracle Exadata X4-8 is especially well suited for high-end OLTP workloads, in-memory or memory-intensive workloads, large-scale database consolidations, including DBaaS, and multi-rack data warehouses.

For every Oracle database server there are additional “Exadata” servers to perform the I/O, each with 12 disk drives and new Exadata software

IBM Internal Use Only

ExadataStorage Servers

DatabaseServers

Networking

Exadata is a Hardware Band-Aid for Oracle RAC

• Still uses Oracle RAC at the end of the day

Oracle is simply throwing lots of H/W at this problem to make it faster

• Another layer of servers which all need to be licensed

• Oracle needs this band-aid because they do not have an MPP solution

MPP is the proven way to properly reduce I/O (joins, aggregates, query push downs, etc.) and interconnect traffic

• Adding another layer of servers to scan and filter data still doesn’t solve RAC’s problems

Example: “large sorts cause massive performance problems with RAC”

• Quote from noted Oracle expert, Don Burleson

Internal Use Only

What They are Advertising

22

Oracle Exadata Database Machine is best for:

• ERP, CRM, data warehousing, HR• Mix OLTP, DW, batch and reporting• Large memory allows many

databases to be consolidated

Exadata Adds an I/O Layer and Complexity to RAC

Internal Use Only

Limited to predicate and column filtering for table scans and large-table-small table join processing.

Requires Oracle 11g R2 or higher Enterprise Server plus Oracle RAC software

Reality – Managing Parallel Execution of Concurrent Workloads With Oracle RAC is

EXTREMELY COMPLEX!

The Exadata Database Machine summary

• A hardware band-aid for Oracle RAC to “fix” I/O performance issues

• Is Not Smart Storage – just a bunch more servers

• Is complex under the covers – 2 layers of server clusters

• Degraded performance upon server failure

• Not Sparc and Not Solaris* (runs Oracle Enterprise Linux, which is not widely accepted in the market)

• Exadata Smart Scan disrupted when data is actively being updated

• Exadata compression enabled only for bulk loading read-only data

• Doesn’t include OLAP, data mining, business intelligence

• Newest edition has slower discs increasing I/O from 4 – 6ms

24

What Else are They are Advertising?• Oracle Exalytics In-Memory Machine X3-4

Engineered System for Extreme Analytics

Oracle Exalytics is the industry’s first engineered system for in-memory analytics that delivers extreme performance for Business Intelligence and Enterprise Performance Management applications.

Built using best in class hardware, market- leading business intelligence software and in-memory database technology, Oracle Exalytics is an optimized system that delivers speed of thought analysis with unmatched intelligence, simplicity and manageability.

Requiring no application redesign

25

ExalyticsSun Fire x4470 M2 server.

Bundle of Oracle Business Intelligence Foundation (Oracle OBI EE, Oracle publisher, and Essbase) together with Oracle’s Times Ten in-memory database

Oracle Summary

• RAC lives inside Exadata

• Data often arrives from DB2

26

Exadata exports data to Exalytics

Once the data is extracted it is old and stale unless kept in sync with replication

Hosts a whole database, data mart, result cache or cube in 1TB max memory

Exalytics

They adopt an extremely expensive ETL strategy to support analytics

OperationalData

OperationalData

A large Asian bank: One mainframe devoted

exclusively to bulk data transfers

ETL consuming 8% of total distributed core and 18% of total MIPS

A large European bank: 120 database images

created from bulk data transfers

1,000 applications on 750 cores with 14,000 software titles

ETL consuming 28% of total distributed cores and 16% of total MIPS

AnalyticalData

AnalyticalData

ETLAnalytical

DataAnalytical

Data

AnalyticalData

AnalyticalData

AnalyticalData

AnalyticalData

AnalyticalData

AnalyticalData

ETL

ETL

ETL

ETL

With this strategy, IT costs grow faster than business growthSource: IBM Eagle Studies

27

What about Security?

29

System z – Protect Critical Data End To End

System z

security breaches: 0

Privacy Rights Clearinghouse noted 621 security breaches during 2013, involving 258 million sensitive records …

Source: http://www.privacyrights.org/data-breach/newhttp://www.redspin.com/docs/Redspin-2013-Breach-Report-Protected-Health-Information-PHI.pdfhttp://www.forbes.com/sites/maggiemcgrath/2014/01/10/target-data-breach-spilled-info-on-as-many-as-70-million-customers/

30

Oracle security patches far outnumber those for DB2 for z/OS

Source: http://www.oracle.com/technetwork/topics/security

0

10

20

30

40

50

60

70

80

90

100

2010 2011 2012 2013

Num

ber o

f Fix

es

Oracle DBDB2 on z/OS

Cumulative Database Security Fixes Since 1Q10

Oracle DBDB2 for z/OS

DB2 – only 40 security patches over past 29 years

April 2014 - 104 total, 2 for the database

January 2014 – 144 total,

5 for the database October 2013 - 127 total,

4 for the database

July 2013 - 89 total, 3 for the database

Oracle: 14 security patches during the past year:

Back to Myth #3

Oracle Exadata Database Machine handles business analytics like DB2 + IBM DB2 Analytics Accelerator

IBM has the only near-Real Time Analytics!

• A workload-optimized, blade-based appliance that runs queries in seconds versus hours

Storage integrated into the hardware rack

Eliminate table indexing and query tuning

• Deeply integrated with DB2 for z/OS, and transparent to applications

Pre-load data from DB2 for z/OS into Accelerator at over 400GB/hr

Maintain a single copy of table or partition in Accelerator and update incrementally (High Performance Storage Saver)

System z workload management implemented across Accelerator

Operational Data

Operational Data

AnalyticsData

AnalyticsData

IBM DB2 Analytics Accelerator

zEC12

IBM zEnterprise Analytics System 9700

Business AnalyticsOperational Analytics Deep

Analytics

32

Oracle RAC for OLTP

Inefficient utilization of resources!Limited Scalability!

Server 1 Server 2

Transactions

`

The Analyst Community Has Taken Notice!

• “By eliminating analytic latency and data synchronization issues, hybrid transaction/analytical processing will enable IT leaders to simplify their information management infrastructure”

· “This architecture will drive the most innovation in real-time analytics over the next 10 years via greater situation awareness and improved business agility”

· Real Time Analytics that minimizes or eliminates analytics latency or synchronization issues by eliminating the divide between operational and analytical systems.

Gartner Research Note G00259033: Gartner 01-2014 Hybrid Transaction Analytical Processing Will Foster Opportunities

Hybrid Transaction and Analytics Processing(HTAP)

The best-fit solution – Move analytics closer to the data

35

DB2

z/OS

InfoSphere Information Server

z/VM

SPSS

z/VM

DataStore

ExtractTransformLoad (ETL)

Predictive Analytics

z/VM or z/OS

Analysis Tools

Cognos BI

Full function operational business intelligence AND business analytics on the same platform

IBM zEnterprise Analytics System 9700 – A comprehensive packaged solution including hardware, OS, and business analytics software

FastStart Service Pack enables quickest time to value with the least amount of impact

Data Integration Pack provides data movement and transformation, data discovery and real-time delivery

Data Analytics Pack includes QMF, Cognos and SPSS zEnterprise

IBM DB2 Analytics Accelerator

Technical Value100+ stand alone deployments into

ONE analytics environmentSupports 450,000+ global users Consolidates value from 660+ data

warehouses 500+ analytic applications across all

business processes

Business ValueProduces 5+ Million $ in yearly

efficiency savings Conservatively added 300+ Million

in business value this year

“World's Largest Cognos Deployment”

Building a “culture of performance” by Progressing the Possible to the Proven

That’s what IBM did!Blue Insight delivers incremental value across IBM

• IBM® Cognos® Business Intelligence• IBM SPSS® Statistics• IBM SPSS Modeler• IBM InfoSphere® Warehouse • IBM zEnterprise™ 196• IBM DB2 for z/OS• IBM DB2 Analytics Accelerator

Solution Components

IBM Blue Insight – Turning big data into actionable business insight – fast and at low cost

100 hours to 6 minutes acceleration for one key analytics report

“DB2 Analytics Accelerator has enabled us to change the way we do business.”—Larry Yarter, Chief Architect, IBM Blue Insight Business Analytics Competency Center

400 percent faster responses to complex queries

Game-changing insight available almost in real time

Computer ServicesIBM Software

Solution components

The transformation: Previously, analyzing huge volumes of data from hundreds of systems required the creation of multiple inflexible data marts. Today, IBM can deliver near-real time analytic insight without going through manual data extraction and preparation stages, enabling users to respond to emerging business challenges faster and make more timely, fact-based strategic decisions.Software

• IBM® DB2® Analytics Accelerator for z/OS®

• IBM Cognos® Enterprise• IBM DB2 for Linux, UNIX and

Windows• IBM DB2 for z/OS• IBM PureData™ for Analytics• IBM SPSS® Statistics• IBM SPSS ModelerHardware• IBM zEnterprise® 196 ZSP03876-USEN-02

OLTP Transactions

Operational analytics

Real time data ingestion

High concurrency DB2 Native Processing

Standard reports

Complex queries

Historical queries

OLAP

Integrate

A single workload-optimized system for accelerating decisions to the speed of business

Everything is online –

analytics in the right place!

IBM

DB

2 Analytics A

ccelerator

Advanced analytics*

DB2 11 and Big Insights provide this extended capability

System z: A Hybrid Transaction and Analytics Platform - HTAP

39

Analytics models and software. These are the tools that deliver

actionable insights from data.Predictive View

… what happens if trends continue?… what happens if <fill in the blank>?… what is likely to happen next?… how to achieve the best outcome?

Data warehouses, marts, etc. These data sources support

reporting and predictive model creation.

Historical View

… what happened?… how many, how often, where?… what the problem is, exactly?… what actions are needed?

The operational systems that house the book of record. These

data sources are critical to day-to-day business processes.

Real-Time View

ADVANTAGE

ADVANTAGE

Data is our clients’ most important resource. The more effectively and efficiently they use that data, the greater their competitive advantage.

Business-critical analytics solutions depend on where

the source data resides

40

DB2:

What is happening now or in the future analytics?

Oracle:

What happened at the time of extract analytics?

Incremental updates keepData in sync

Business

Value Business

ValueA static data environment

Compare

Exalytics

41

Leading The World For Hybrid Transaction & Analytic Processing, HTAP!

#1 Efficiency at scale

#2 Trusted resiliency

#3 Optimized for OLTP and near real-time analytics

IBM zEnterprise

zEC12 IBM DB2 Analytics

Accelerator

Acknowledgements and Disclaimers Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

© Copyright IBM Corporation 2014. All rights reserved.

— U.S. Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

— Please update paragraph below for the particular product or family brand trademarks you mention such as WebSphere, DB2,Maximo, Clearcase, Lotus, etc

IBM, the IBM logo, ibm.com, [IBM Brand, if trademarked], and [IBM Product, if trademarked] are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or TM), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at

•“Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

•If you have mentioned trademarks that are not from IBM, please update and add the following lines:[Insert any special 3rd party trademark names/attributions here]

•Other company, product, or service names may be trademarks or service marks of others.

42

We Value Your Feedback!

• Don’t forget to submit your Insight session and speaker feedback! Your feedback is very important to us – we use it to continually improve the conference.

• Access the Insight Conference Connect tool to quickly submit your surveys from your smartphone, laptop or conference kiosk.

43

Thank You