s001 db2 purescale power tech

33
© 2010 IBM Corporation IBM Power Systems Technical University October 18–22, 2010 — Las Vegas, NV Power up your OLTP Apps With DB2 pureScale S001 Doug Mack Power Systems Offerings Manager

Upload: henrique-tancredi

Post on 29-Nov-2014

28 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University

October 18–22, 2010 — Las Vegas, NV

Power up your OLTP Apps

With DB2 pureScaleS001

Doug Mack

Power Systems Offerings Manager

Page 2: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Customers need a highly scalable, flexible solution for the growth of their information

– with the ability to easily grow existing applications

Critical IT Applications Need Reliability and Scalability

2

� Down-time is Not Acceptable– Any outage means lost revenue and

permanent customer loss

– The Fortune 500 is built on DB2 for

z/OS for their critical systems

– Distributed databases don’t yet have

this level of reliability

� Local Databases are Becoming Global– Successful global businesses must deal

with exploding data and server needs

– Competitive IT organizations need to

handle rapid change

Page 3: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

DB2 for z/OS Data Sharing is the Gold Standard

� Everyone recognizes DB2 for z/OS as the “Gold” standard for scalability and high availability

� Even Oracle agrees:

� Why?

– The Coupling Facility!!

• Centralized locking, centralized buffer pool deliver superior scalability and superior

availability

– The entire environment on z/OS uses the Coupling Facility

• CICS, MQ, IMS, Workload Management, and more

Page 4: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 5: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

DB2 9.7 Adds Oracle Compatibility

� Easily move your applications from Oracle to DB2

� Leverage your existing skills and people without re-training

� Applications moved to DB2 run quickly with full native execution

� Simple drag and drop of schemas to

DB2

� Integrated, cross-platform tools

supporting Oracle as well

� IBM can rapidly assess your

application

"To move our application to DB2 9.5 would have taken an

estimated two-year effort. We were thrilled to see it took only

one week to move it to DB2 9.7. This represents a terrific

opportunity to expand our international community of

users, partners and developers, and we’re very excited to

partner with IBM to make new deployment options

available.”

Paolo Juvara, CTO of Openbravo (Spain)

Page 6: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

DB2 pureScale on IBM Power Systems

� DB2 pureScale is a feature of DB2 Enterprise Edition

– Exclusively exploits the new IBM PowerHApureScale technology included with DB2 pureScale

� Supported on IBM Power 550 Express or IBM Power 595 running AIX 6.1 TL3 and all POWER7 models except Power Blades

� Requires Power Systems Infiniband adapters to deliver low latency & high performance interconnect

� All IBM Storage supported by the General Parallel File System (GPFS) is available.

Page 7: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

DB2 pureScale Architecture

PowerHA pureScale technology drives the

clustering,

Runs on an LPAR or a stand alone server

Automatic workload balancing

Shared Data – IBM Storage supported

InfiniBand network

Cluster of DB2 nodes/members running on

Power servers

Members

PowerHA pureScale Servers

Page 8: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

PowerHA pureScale – the key to scalability/availability

� Efficient Centralized Locking and Caching

– As the cluster grows, DB2 maintains one place to go for locking information and shared pages

– Optimized for very high speed access

• DB2 pureScale uses Remote Direct Memory Access (RDMA) to communicate with the powerHA pureScale server

• No IP socket calls, no interrupts, no context switching

� Results

– Constant awareness of what each member is doing

• If one member fails, no need to block I/O from other members

• Recovery runs at memory speeds

• Near Linear ScalabilityGroup Buffer

Pool

CF

PowerHA pureScale

Group LockManager

Member 3Member 2Member 1

Page 9: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

The Advantage of DB2 Read and Register with RDMA

1. DB2 agent on Member 1 writes directly into CF memory with:

– Page number it wants to read

– Buffer pool slot that it wants the page to go into

2. CF either responds by writing directly into memory on Member 1:

– That it does not have the page or

– With the requested page of data

� Total end to end time for RAR is measured in microseconds

� Calls are very fast, the agent may even stay on the CPU for the response

Much more scalable, does not require locality of data

db2agent CF thread

Direct remote memory

write with request

I don’t have it,

get it from disk

I want page 501. Put into slot 42

of my buffer pool.Direct remote memory

write of response

Member 1 CF

1, Eaton, 10210, SW

2, Smith, 10111, NE

3, Jones, 11251, NW

Page 10: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 11: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

DB2 pureScale is Easy to Deploy

Single installation for all components

Monitoring integrated into Optim tools

Single installation for fixpaks & updates

Simple commands to add and remove members

Page 12: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 13: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Scaling with pureScaleScale Up, Scale Out, Scale Within

Scale WithinAdd additional cores as needed with

Capacity OnDemand

Scale OutAdd additional members, up to 128 total

Scale UpExpand each member up to 64 cores

IBM Power 770IBM Power 770 IBM Power 770

Start small

4 cores per member

Start small

4 cores per member

Scale seamlessly, effortlessly from 8 cores to 8,192 cores

Page 14: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Consolidation on DB2 pureScale

� Consolidate onto the number of servers that make sense for your business

– Purchase the most cost effective servers – not one size fits all

Power 750

12 core

Power 750

12 core

Primary CF2 cores

Standby CF2 cores

ERP

Member 26 cores

ERP

Member 16 cores

HR

Member 14 cores

HR Member 2

4 cores

Internal Use Only750 supports up to 16 cores

Page 15: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 16: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Proof of DB2 pureScale Architecture Scalability

� How far will it scale?

� Take a web commerce type workload

– Read mostly but not read only

� Don’t make the application cluster aware

– No routing of transactions to members

– Demonstrate transparent application scaling

� Scale out to the 128 member limit and measure scalability

Page 17: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

The Result

64 Members

95% Scalability

16 Members

Over 95%

Scalability

2, 4 and 8

Members Over

95% Scalability

32 Members

Over 95%

Scalability

88 Members

90% Scalability

112 Members

89% Scalability

128 Members

84% Scalability

Validation testing includes capabilities to be available in future releases.

Page 18: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

� Unique DB2 pureScale clustering design achieves near linear scaling

– No data partitioning required

– No transaction routing required

– No changes or cluster awareness required in applications

� Preserves business agility when adding or removing capacity

– Applications are not tied to database partitioning schemes

– Automatically balances workload across cluster

� Virtually unlimited capacity

– Large DB2 pureScale clusters can harness the power of a massive number of POWER7 cores and execution threads

– IBM has demonstrated near linear scaling up to 128 members

� Continuous availability during both planned and unplanned outages

DB2 pureScale Scales Efficiently And Transparently

DB2 pureScale characteristics as shown in IBM published results from internal tests

DB2 pureScale

Near Linear Scalability

1

2

3

4

5

6

7

8

9

10

11

12

1 2 3 4 5 6 7 8 9 10 11 12Data Base Nodes in Cluster

Effective Nodes

Perfect Linear

Performance

Effective

Nodes

1.98

3.90

7.54

10.33

1.98

3.90

7.54

10.33

Productive Resources

Wasted Resources

Page 19: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Without Application Changes and Extensive Database Tuning, Oracle RAC Does Not Scale

� Oracle RAC is inefficient by design

– Scaling RAC requires complex tuning, partitioning, or application changes

• TPC-C RAC results

• TPC-H RAC results

� Sacrifices Business Agility to overcome poor performance

– Partitioning schemes force changes into application business logic

� Published studies demonstrate difficult or poor scalability

– Dell (shown in chart): Poor scalability despite using InfiniBandfor RAC interconnect

– CERN: Four month team effort to tune RAC, change database, change application

– Insight Technology: Even a simple application on two node RAC requires complex tuning and partitioning to scale

Oracle RAC characteristics as shown in Dell RAC InfiniBand Study

http://www.dell.com/downloads/global/power/ps2q07-20070279-Mahmood.pdf

CERN (European Organization for Nuclear Research)

http://www.oracleracsig.org/pls/apex/RAC_SIG.download_my_file?p_file=1001900

Insight Technology

http://www.insight-tec.com/en/mailmagazine/vol136.html

10

11

12

1 2 3 4 5 6 7 8 9 10 11 12Data Base Nodes in Cluster

Effective Nodes

Oracle RAC

Poor Scalability

1

2

3

4

5

6

7

8

9

Perfect Linear

Performance

Effective

Nodes

1.692.44

Productive Resources

Wasted Resources

Page 20: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 21: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Application Servers

and

DB2 Clients

Recover Instantaneously From Node Failure

� Protect from infrastructure

related outages

– Redistribute workload to

surviving nodes immediately

– Completely redundant

architecture

– Recover in-flight transactions

on failing node in as little as 15

seconds including detection of

the problem

Page 22: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Minimize the Impact of Planned Outages

Identify MemberDo MaintenanceBring node back online

� Keep your system up

– During OS fixes

– HW updates

– Administration

Page 23: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 24: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Application Transparency

Take advantage of extra capacity instantly

– No need to modify your application code

– No need to tune your database infrastructure

Your developers don’t even need to know more nodes are being added

Your DBAs can add capacity without re-tuning or re-testing

Page 25: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM’s Distributed Platform Answer: DB2 pureScale

Leverages the architecture of z/OS:

the Gold Standard of reliability and scalability

� Simplified Installation

� Unlimited Capacity

� Near Linear Scalability

� Continuous Availability

� Application Transparency

� Flexible On Demand DB2 Licensing

Built and developed on Power servers and AIX

Page 26: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Need more… just

deploy another

server and then turn

off DB2 when you’re

done.

Issue:

All year, except for

two days, the system

requires 3 servers of

capacity.

Solution:

Use DB2 pureScale

and add another

server for those two

days, and only pay

sw license fees for

the days you use it.

Capacity On Demand Software Licensing

� DB2 pureScale has been designed to grow as big as you want

� Flexible licensing designed for minimizing costs of peak times

� Only pay for additional capacity when you use it even if for only a single day

Over 100+ node architecture validation has been run by IBM

Page 27: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation27

IBM Power Systems Technical University — Las Vegas, NV

IBM Power 770drives up to 90% server utilization with industry-leading virtualization, lowers energy consumption 70-90% with dynamic energy utilization, and provides resiliency without downtime.

DB2 pureScaleoffers superior performance and scale-out efficiency

WebSphere Application Server

on POWER7 provides 73% better performance than a

competitive application server on Nehalem

IBM pureScale Application SystemIBM pureScale Application SystemScale In, Scale Out, Scale WithinScale In, Scale Out, Scale Within

Workload Optimized System

Page 28: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

IBM pureScale Application System

� Workload Optimized SYSTEM

– A completely integrated SYSTEM for transaction processing

– Leverages DB2 pureScale and PowerHA pureScale

� Available in May 2010

– Initially only available in North America

– Additional country support in 2H 2010 and 2011

� Leverages what we’ve learned from IBM Smart Analytics System

– Packaged solution containing everything you need from IBM

– Faster “time to value”

Page 29: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

� Faster Results

� Less Risk

June Jan.

5

4

3

2

Jan.

Build “from scratch” Pre-Built

Pre-implementation System Sizing

Acquire Components

Installation & Configuration

Testing & Validation

Months versus weeks

Page 30: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Hardware Stack

- Two IBM Power 770 Servers

- 3 sizes available: 4, 8, and 16 cores, 3.1GHz proc card, activated (16 cores populated)

- 32/48/64 GB RAM activated (64 GB RAM populated)

- One Infiniband Switch

- One HMC console

- OneT42 rack

644832Memory per

server (GB)

222# of Power

770 servers

Large

16 cores

Medium

8 cores

Small

4 cores

Size

Page 31: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation31

IBM Power Systems Technical University — Las Vegas, NV

Minimize deployment and on-going administration with deeply integrated systems.

Workload-optimized

� Integrated virtualization

� Thread exploitation

� One-button setting

� One-number support

Grow Easily

� Modular design

� Add capacity as you need

� No application updates

� Buy only what you need

Lower Your Costs

� Pre-integrated and tuned

� Deploy in days

� Faster time-to-value

� Deep integration

� Easier to maintain

Page 32: s001 Db2 Purescale Power Tech

© 2010 IBM Corporation

IBM Power Systems Technical University — Las Vegas, NV

Thank you!

Ibm.com/software/db2/purescale

Page 33: s001 Db2 Purescale Power Tech

33

TrademarksThe following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.

The following are trademarks or registered trademarks of other companies.

* All other products may be trademarks or registered trademarks of their respective companies.

Notes:

Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.

IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.

All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.

This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel

Corporation or its subsidiaries in the United States and other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.

IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.

For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:

*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®

Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not

actively marketed or is not significant within its relevant market.

Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.