comparing ibm db2 for z/os’s high performance analytics and transaction processing to oracle...
TRANSCRIPT
Comparing IBM DB2 for z/OS’s High Performance Analytics and Transaction Processing to OracleSession #6973Sheryl M. Larsen, IBMWed, 29/Oct, 03:00 PM - 04:00 PM
© 2014 IBM Corporation
Please Note• IBM’s statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice at IBM’s sole discretion.
• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.
• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
2
Three Myths
#1 Oracle RAC can scale like DB2
#2 Oracle has the same availability as DB2
#3 Oracle Exadata Database Machine can do business analytics like DB2 + IBM DB2 Analytics Accelerator
Oracle Real Application Clusters for OLTP Demo
Server 1 Server 2
Transactions
Database Resources (rows)
Oracle RAC for OLTP
Server 1 Server 2
Transactions
Database Resources (rows)
Oracle RAC for OLTP
Server 1 Server 2
Transactions
Oracle RAC for OLTP
Inefficient utilization of resources!Limited Scalability!
Server 1 Server 2
Transactions
8
Oracle RAC uses network based sharing
LocksCache
LocksCache
LocksCache
Switch
Oracle Oracle Oracle
Disks
InfiniBand
SharedInterconnect
Shared disk across nodes
Software-based distributed lock and cache management
Less efficient scalability due to increasing inter-node activity as cluster grows or as workload increases
Unable to scale bandwidth for Data Warehouse processing
BEFORE / WITHOUT EXADATA
IBM Internal Use Only
Oracle 12c with Real Application Clusters (RAC)
• 3 Oracle 12c Instances, 1 per server
• RAC is software that manages the application clusters across the servers
9
Separate Servers- No shared components- Each running an Oracle
Instance
Fiber Channel Switch- for concurrent access to
shared storage
Single storage with single copy of the database
High Speed Interconnect
DB2 for z/OS Data Sharing is hardware based• There are many ways to separate DB2 Databases
For example, 1 LPAR on each machine
10
Coupling Facility(dedicated processors and memory)
Group BufferpoolsCentralized Lock Mechanism
Coupling Facility(dedicated processors and memory)
Group BufferpoolsCentralized Lock Mechanism
Shared Storage
DB2 for z/OS delivers a truly
scalable shared disk architectureTrue shared caching
Delivers better availability Hot pages stored in centralized
cache Faster recovery if one member
fails
DB2 for z/OSCentralized Coupling Facility Design
Oracle RAC Distributed Design
lock and buffer management communicates with central coupling facility
LocksCache
LocksCache
LocksCache
OracleNode
OracleNode
OracleNode
DB2 Parallel Sysplex Clusters vs. Oracle RAC
DB2
Member
DB2
Member
Shared Disk
LocksCache
DB2
Member
InfiniBand Switch
CF
Network Switch
Shared Disk
distributed locking and buffer management
11
Myth #1 Oracle RAC can scale like DB2
A and C have read locks and local copiesD is the lock master for this element
1. B requests write lock2. D requests C to release lock
3. C acknowledges4. D request A to release lock and transfer data element to B
5. A releases lock and transfers data element
6. B updates data, assumes lock and informs D
7. B updates local copy
Network
Instance
AInstance
BInstance
CInstance
D
100100 MasterNodeXX
Request Write Lock
Inter-node connections:
In a cluster with 4 nodes, an update operation may need 6 network connections and two in-memory calls (not shown).
1
Release Lock
2
Done
3
Inform Lock Holder
4
Transfer Lock and Data
5
Lock assume
6
115
Example based on Oracle’s US Patent 7,107,319 B2.
Oracle RAC’s distributed lock management design causes network overhead
12
z/OS image A with DB2
z/OS image B with DB2
z/OS image D with DB2
z/OS image C with DB2
High Speed Hardware
Links
100
100
X
X
CFBuffer Pools
Locks
1. B registers page to CF and obtains write lock
2. B updates data
3. B commits update
B caches update in group buffer pool
CF invalidates all cached copies without interrupting processors
115
Cache and locks are maintained with no inter-node disturbance!
A and C have data in local buffer pool without locks
100115
zEnterprise’s centralized Coupling Facility permits efficient lock and cache management in DB2
13
CF can support over 1 million requests per second
DB2 for z/OS Near Linear Scalability
5.24
9.98
6.86
3.48
1.781
2
3
4
5
6
7
8
9
10
11
12
1 2 3 4 5 6 7 8 9 10 11 12Nodes in Cluster
Pro
du
ctiv
e N
od
es
Perfect LinearPerformance
ProductiveNodes
1.692.44
Oracle RACPoor Scalability
Oracle RAC characteristics as shown in Dell RAC InfiniBand Study http://www.dell.com/downloads/global/power/ps2q07-20070279-Mahmood.pdfCERN (European Organization for Nuclear Research) http://www.oracleracsig.org/pls/apex/RAC_SIG.download_my_file?p_file=1001900Insight Technology http://www.insight-tec.com/en/mailmagazine/vol136.html
DB2 Parallel Sysplex Clusters Scale far Better!
DB2 for z/OS OLTP result (ITG ‘03)14
• DB2 for z/OS - Adding nodes is close to perfect linear scaling
• Oracle inter-node communications make scaling difficult
Myth #1 Oracle RAC can scale like DB2
What about Availability?
16
zEnterprise EC12 Parallel Sysplex Availability Leads The Pack
0
0.5
1
1.5
2
2.5
3
3.5
Source: ITIC: ITIC 2009 Global Server Hardware & Server OS Reliability Survey; July 2009; http://itic-corp.com/blog/2009/07/itic-2009-global-server-hardware-server-os-reliability-survey-results/; Results are measured in minutes per year. *Note: All operating systems included in the survey are not included in this chart. Fifteen operating systems on various processor architectures were included in the survey. The chart will be updated when the full report is available.
Novell Linux on Intel x86
(modified)
IBM AIX on
IBM Power
Downtime Survey (400 participants in 20 countries)
5 minutes
Mandrake Linux on
Intel x86
Sun Solaris
on Sun SPARC
HPHP-UX
on HP PA-RISC
HPHP-UX
on Intel Itanium
MicrosoftWin2003
on Intel x86
MicrosoftWin2008
on Intel x86
Novell Linux on Intel x86
(unmodified)
IBM z/OS
Sysplex
Do
wn
tim
e H
ou
rs P
er Y
ear
System z Parallel Sysplex with
99.999% availability
Myth #2 Oracle RAC can have the same availability as DB2
Availability: Maintenance and Upgrade
DB2 for z/OS: Applications keep running during maintenance and upgrades!
Oracle RAC requires downtime to upgrade the database
Refresh in place
Maintenance in place even with mixed versions
Source: Fact that RAC required downtime to upgrade is documented in Metalink Note 244241.1
Myth #2 Oracle RAC can have the same availability as DB2
CF
Single System Sysplex
CF
CF
CF
External Coupling Facility(Can be different class server)
CF
CF
CF
Cross Connected Serverswith internal Coupling Facilities
CF
zEnterprise parallel sysplex clusters provide unmatched processing power and availability
• Clustering driven by specialty engines (Coupling Facility)
• Presents a single system image of a z/OS workload
• Potentially 2.5M MIPS
per 32-way cluster*
• Enables rolling updates• Supports continuous access
to business services and data – from anywhere, at anytime
• Designed for 99.999% availability
*Equivalent to about 240 of the largest Oracle servers
18
Business AnalyticsDeep Analytics Operational AnalyticsTransactional
Complex analytic queries
Many concurrent queries
of varying complexity
Many concurrent transactions
response time throughput throughput
Optimal Execution of Mixed Workloads
19
Real time answers cannot be derived from extracted data sources
Myth #3 Oracle Exadata Database Machine handles business analytics like DB2 + IBM DB2 Analytics Accelerator
Exadata to the Rescue?
• Exadata intended to “fix” Oracle storage bottleneck for DW
• Extreme Performance and Scalability for All Applications
• Oracle Exadata X4-8 is especially well suited for high-end OLTP workloads, in-memory or memory-intensive workloads, large-scale database consolidations, including DBaaS, and multi-rack data warehouses.
For every Oracle database server there are additional “Exadata” servers to perform the I/O, each with 12 disk drives and new Exadata software
IBM Internal Use Only
ExadataStorage Servers
DatabaseServers
Networking
Exadata is a Hardware Band-Aid for Oracle RAC
• Still uses Oracle RAC at the end of the day
Oracle is simply throwing lots of H/W at this problem to make it faster
• Another layer of servers which all need to be licensed
• Oracle needs this band-aid because they do not have an MPP solution
MPP is the proven way to properly reduce I/O (joins, aggregates, query push downs, etc.) and interconnect traffic
• Adding another layer of servers to scan and filter data still doesn’t solve RAC’s problems
Example: “large sorts cause massive performance problems with RAC”
• Quote from noted Oracle expert, Don Burleson
Internal Use Only
What They are Advertising
22
Oracle Exadata Database Machine is best for:
• ERP, CRM, data warehousing, HR• Mix OLTP, DW, batch and reporting• Large memory allows many
databases to be consolidated
Exadata Adds an I/O Layer and Complexity to RAC
Internal Use Only
Limited to predicate and column filtering for table scans and large-table-small table join processing.
Requires Oracle 11g R2 or higher Enterprise Server plus Oracle RAC software
Reality – Managing Parallel Execution of Concurrent Workloads With Oracle RAC is
EXTREMELY COMPLEX!
The Exadata Database Machine summary
• A hardware band-aid for Oracle RAC to “fix” I/O performance issues
• Is Not Smart Storage – just a bunch more servers
• Is complex under the covers – 2 layers of server clusters
• Degraded performance upon server failure
• Not Sparc and Not Solaris* (runs Oracle Enterprise Linux, which is not widely accepted in the market)
• Exadata Smart Scan disrupted when data is actively being updated
• Exadata compression enabled only for bulk loading read-only data
• Doesn’t include OLAP, data mining, business intelligence
• Newest edition has slower discs increasing I/O from 4 – 6ms
24
What Else are They are Advertising?• Oracle Exalytics In-Memory Machine X3-4
Engineered System for Extreme Analytics
Oracle Exalytics is the industry’s first engineered system for in-memory analytics that delivers extreme performance for Business Intelligence and Enterprise Performance Management applications.
Built using best in class hardware, market- leading business intelligence software and in-memory database technology, Oracle Exalytics is an optimized system that delivers speed of thought analysis with unmatched intelligence, simplicity and manageability.
Requiring no application redesign
25
ExalyticsSun Fire x4470 M2 server.
Bundle of Oracle Business Intelligence Foundation (Oracle OBI EE, Oracle publisher, and Essbase) together with Oracle’s Times Ten in-memory database
Oracle Summary
• RAC lives inside Exadata
• Data often arrives from DB2
26
Exadata exports data to Exalytics
Once the data is extracted it is old and stale unless kept in sync with replication
Hosts a whole database, data mart, result cache or cube in 1TB max memory
Exalytics
They adopt an extremely expensive ETL strategy to support analytics
OperationalData
OperationalData
A large Asian bank: One mainframe devoted
exclusively to bulk data transfers
ETL consuming 8% of total distributed core and 18% of total MIPS
A large European bank: 120 database images
created from bulk data transfers
1,000 applications on 750 cores with 14,000 software titles
ETL consuming 28% of total distributed cores and 16% of total MIPS
AnalyticalData
AnalyticalData
ETLAnalytical
DataAnalytical
Data
AnalyticalData
AnalyticalData
AnalyticalData
AnalyticalData
AnalyticalData
AnalyticalData
ETL
ETL
ETL
ETL
With this strategy, IT costs grow faster than business growthSource: IBM Eagle Studies
27
What about Security?
29
System z – Protect Critical Data End To End
System z
security breaches: 0
Privacy Rights Clearinghouse noted 621 security breaches during 2013, involving 258 million sensitive records …
Source: http://www.privacyrights.org/data-breach/newhttp://www.redspin.com/docs/Redspin-2013-Breach-Report-Protected-Health-Information-PHI.pdfhttp://www.forbes.com/sites/maggiemcgrath/2014/01/10/target-data-breach-spilled-info-on-as-many-as-70-million-customers/
30
Oracle security patches far outnumber those for DB2 for z/OS
Source: http://www.oracle.com/technetwork/topics/security
0
10
20
30
40
50
60
70
80
90
100
2010 2011 2012 2013
Num
ber o
f Fix
es
Oracle DBDB2 on z/OS
Cumulative Database Security Fixes Since 1Q10
Oracle DBDB2 for z/OS
DB2 – only 40 security patches over past 29 years
April 2014 - 104 total, 2 for the database
January 2014 – 144 total,
5 for the database October 2013 - 127 total,
4 for the database
July 2013 - 89 total, 3 for the database
Oracle: 14 security patches during the past year:
Back to Myth #3
Oracle Exadata Database Machine handles business analytics like DB2 + IBM DB2 Analytics Accelerator
IBM has the only near-Real Time Analytics!
• A workload-optimized, blade-based appliance that runs queries in seconds versus hours
Storage integrated into the hardware rack
Eliminate table indexing and query tuning
• Deeply integrated with DB2 for z/OS, and transparent to applications
Pre-load data from DB2 for z/OS into Accelerator at over 400GB/hr
Maintain a single copy of table or partition in Accelerator and update incrementally (High Performance Storage Saver)
System z workload management implemented across Accelerator
Operational Data
Operational Data
AnalyticsData
AnalyticsData
IBM DB2 Analytics Accelerator
zEC12
IBM zEnterprise Analytics System 9700
Business AnalyticsOperational Analytics Deep
Analytics
32
Oracle RAC for OLTP
Inefficient utilization of resources!Limited Scalability!
Server 1 Server 2
Transactions
`
The Analyst Community Has Taken Notice!
• “By eliminating analytic latency and data synchronization issues, hybrid transaction/analytical processing will enable IT leaders to simplify their information management infrastructure”
· “This architecture will drive the most innovation in real-time analytics over the next 10 years via greater situation awareness and improved business agility”
· Real Time Analytics that minimizes or eliminates analytics latency or synchronization issues by eliminating the divide between operational and analytical systems.
Gartner Research Note G00259033: Gartner 01-2014 Hybrid Transaction Analytical Processing Will Foster Opportunities
Hybrid Transaction and Analytics Processing(HTAP)
The best-fit solution – Move analytics closer to the data
35
DB2
z/OS
InfoSphere Information Server
z/VM
SPSS
z/VM
DataStore
ExtractTransformLoad (ETL)
Predictive Analytics
z/VM or z/OS
Analysis Tools
Cognos BI
Full function operational business intelligence AND business analytics on the same platform
IBM zEnterprise Analytics System 9700 – A comprehensive packaged solution including hardware, OS, and business analytics software
FastStart Service Pack enables quickest time to value with the least amount of impact
Data Integration Pack provides data movement and transformation, data discovery and real-time delivery
Data Analytics Pack includes QMF, Cognos and SPSS zEnterprise
IBM DB2 Analytics Accelerator
Technical Value100+ stand alone deployments into
ONE analytics environmentSupports 450,000+ global users Consolidates value from 660+ data
warehouses 500+ analytic applications across all
business processes
Business ValueProduces 5+ Million $ in yearly
efficiency savings Conservatively added 300+ Million
in business value this year
“World's Largest Cognos Deployment”
Building a “culture of performance” by Progressing the Possible to the Proven
That’s what IBM did!Blue Insight delivers incremental value across IBM
• IBM® Cognos® Business Intelligence• IBM SPSS® Statistics• IBM SPSS Modeler• IBM InfoSphere® Warehouse • IBM zEnterprise™ 196• IBM DB2 for z/OS• IBM DB2 Analytics Accelerator
Solution Components
IBM Blue Insight – Turning big data into actionable business insight – fast and at low cost
100 hours to 6 minutes acceleration for one key analytics report
“DB2 Analytics Accelerator has enabled us to change the way we do business.”—Larry Yarter, Chief Architect, IBM Blue Insight Business Analytics Competency Center
400 percent faster responses to complex queries
Game-changing insight available almost in real time
Computer ServicesIBM Software
Solution components
The transformation: Previously, analyzing huge volumes of data from hundreds of systems required the creation of multiple inflexible data marts. Today, IBM can deliver near-real time analytic insight without going through manual data extraction and preparation stages, enabling users to respond to emerging business challenges faster and make more timely, fact-based strategic decisions.Software
• IBM® DB2® Analytics Accelerator for z/OS®
• IBM Cognos® Enterprise• IBM DB2 for Linux, UNIX and
Windows• IBM DB2 for z/OS• IBM PureData™ for Analytics• IBM SPSS® Statistics• IBM SPSS ModelerHardware• IBM zEnterprise® 196 ZSP03876-USEN-02
OLTP Transactions
Operational analytics
Real time data ingestion
High concurrency DB2 Native Processing
Standard reports
Complex queries
Historical queries
OLAP
Integrate
A single workload-optimized system for accelerating decisions to the speed of business
Everything is online –
analytics in the right place!
IBM
DB
2 Analytics A
ccelerator
Advanced analytics*
DB2 11 and Big Insights provide this extended capability
System z: A Hybrid Transaction and Analytics Platform - HTAP
39
Analytics models and software. These are the tools that deliver
actionable insights from data.Predictive View
… what happens if trends continue?… what happens if <fill in the blank>?… what is likely to happen next?… how to achieve the best outcome?
Data warehouses, marts, etc. These data sources support
reporting and predictive model creation.
Historical View
… what happened?… how many, how often, where?… what the problem is, exactly?… what actions are needed?
The operational systems that house the book of record. These
data sources are critical to day-to-day business processes.
Real-Time View
ADVANTAGE
ADVANTAGE
Data is our clients’ most important resource. The more effectively and efficiently they use that data, the greater their competitive advantage.
Business-critical analytics solutions depend on where
the source data resides
40
DB2:
What is happening now or in the future analytics?
Oracle:
What happened at the time of extract analytics?
Incremental updates keepData in sync
Business
Value Business
ValueA static data environment
Compare
Exalytics
41
Leading The World For Hybrid Transaction & Analytic Processing, HTAP!
#1 Efficiency at scale
#2 Trusted resiliency
#3 Optimized for OLTP and near real-time analytics
IBM zEnterprise
zEC12 IBM DB2 Analytics
Accelerator
Acknowledgements and Disclaimers Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.
The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.
© Copyright IBM Corporation 2014. All rights reserved.
— U.S. Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
— Please update paragraph below for the particular product or family brand trademarks you mention such as WebSphere, DB2,Maximo, Clearcase, Lotus, etc
IBM, the IBM logo, ibm.com, [IBM Brand, if trademarked], and [IBM Product, if trademarked] are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or TM), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at
•“Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml
•If you have mentioned trademarks that are not from IBM, please update and add the following lines:[Insert any special 3rd party trademark names/attributions here]
•Other company, product, or service names may be trademarks or service marks of others.
42
We Value Your Feedback!
• Don’t forget to submit your Insight session and speaker feedback! Your feedback is very important to us – we use it to continually improve the conference.
• Access the Insight Conference Connect tool to quickly submit your surveys from your smartphone, laptop or conference kiosk.
43
Thank You