key note session idug db2 seminar, 16th april london - julian stuhler .triton consulting

#IDUG

London Technical seminar - 2014

A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond

Julian StuhlerPrincipal ConsultantTriton Consulting

#IDUG


2

Disclaimer

• Any mention of future features, products or overall strategic direction are purely my personal opinion,

and no reliance should be placed upon them ever coming to pass

• The user assumes the entire risk related to its use of information in this presentation. Triton Consulting

provides such information "as is," and disclaims any and all warranties, whether express or implied,

including (without limitation) any implied warranties of merchantability or fitness for a particular

purpose. In no event will Triton Consulting be liable to you or to any third party for any direct, indirect,

incidental, consequential, special or exemplary damages or lost profit resulting from any use or misuse

of this data.

• DB2 for OS/390 and DB2 for z/OS are trademarks of International Business Machine corporation. This

presentation uses many terms that are trademarks. Wherever we are aware of trademarks the name

has been spelled in capitals.

“Prediction is very difficult, especially if it's about the future” Nils Bohr, Nobel laureate in Physics

#IDUG


3

Acknowledgements

• John Campbell• Chris Eaton• Iqbal Goralwalla• Terri Jacopi• Jeff Josten• Jay Yothers

#IDUG


4

DB2 Today

“The only constant is change”

HeraclitusGreek Philosopher

(c.535 BC – 475 BC)

“Good character is not formed in a week or a month. It is created little by little, day by day.

Protracted and patient effort is needed to develop good character.”

DBAs are

DBAs.”

They are

#IDUG


5

DB2 Today

June 1 2008 Sept 24 2013

Worldles generated by Tagxedohttp://http://www.tagxedo.com

Old IBM website from Wayback Machine

http://web.archive.org http://www-01.ibm.com/software/data/

#IDUG


6

DB2 Today

#IDUG


7

DB2 Technology Themes

• Cost Reduction • High Availability • In-Memory Computing• DB2 Skills Availability• Database Commoditisation• Big Data

#IDUG


8

Cost Reduction – Today

• Ongoing focus on improving profitability and ruthlessly eliminating unnecessary costs• IT spending is a major cost component for all organisations• Gartner’s 2013 Worldwide IT Spending analysis showed growth rate of just

0.4% for 2013

• Managing hardware costs• Moore’s law is still alive and well as it approaches its 50th birthday• Compression can dramatically reduce DASD costs

• Adaptive compression in DB2 for LUW V10 can yield spectacular gains• Further savings possible via actionable compression in BLU• Overall cost savings being partially offset by move to more expensive SSD

devices (although they are getting cheaper too)

• Virtualisation and consolidation technologies are helping to improve hardware utilisation rates

• Linux on System z offers some intriguing possibilities here

#IDUG


9

Cost Reduction – Today

• Managing Software licence fees• MLC pricing on the mainframe means that CPU burned during peak period (4HRA)

directly impacts software costs• Ongoing focus within DB2 for z/OS to drive down

CPU consumption• DB2 code optimisation in DB2 10 (and now in DB2 11)• Increased use of System z speciality engines and

hybrid solutions such as the IBM DB2 Analytic Accelerator

• Aggressive new packaging options for DB2 for LUW• AWSE and AESE include lots of additional functionality

such as compression, BLU, pureScale, etc• Linux on System z can offer major software licence savings

• Managing people costs• Salary increases have been generally outstripping increase in overall IT spend, so we’re

all consuming a greater proportion of the IT budget• From ALTER to Autonomics, it’s all about improving productivity and doing more with less

#IDUG


10

Cost Reduction – Tomorrow

• Signs that pressure is easing on

overall IT budgets• Latest Gartner estimates show 3.2%

annual increase for 2014, to $3.8 trillion

• 6.9% increase in enterprise software

spending, with CRM, DBMS and data

management the major items

• However, Gartner expects a

renewed focus on implementing new

IT systems which will consume

budget• Current cost management pressures

unlikely to reduce

#IDUG


11


• Hardware• Moore’s Law under pressure, only has 6-8 years left before physics

dictate fundamental shift from CMOS to other technologies• Photonics, quantum computers

• Ongoing focus on reducing operational costs will continue to deliver benefits

• Recent Intel POC submerged high-end servers in 3M’s dielectric “Novec Engineered Fluid” to increase server density and cut cooling costs by up to 95%

• System z hardware approaching thermal limits for indirect cooling so mainframes may go this way too

#IDUG


12


• Software Licence Fees• Increased offload to zIIP, IDAA and other speciality processors and hybrid

solutions• But what happens when we approach 100% CP offload?

• New MLC models to recognise the changing role of the mainframe • IBM announcement on 8th April 2014 for new model offering up to 60% reduction on

processor capacity reported for Mobile transactions http://www-03.ibm.com/press/uk/en/pressrelease/43619.wss

• Practice of “bundling” likely to continue as a way of maintaining software revenues on distributed platforms

• People Costs• Skills shortages likely to continue to increase people costs. See skills section

later

• Continued emphasis on autonomics, ease of use and productivity features

http://www-03.ibm.com/press/uk/en/pressrelease/43619.wss



#IDUG


13

High Availability – Today

• Impact of down time in critical IT systems has never been higher• Revenue loss• Reputational damage• Remedial costs• Regulatory and Contract Compliance Impact

• How much?• A 2011 Ponemon Institute report calculated average of $5,617 per

minute for large US data centres• Amazon “went dark” for 49 minutes in Jan 2013, at estimated cost of

$66,240 per minute

• Unplanned outage is usually the most painful, but planned outage hurts too

#IDUG


14


• Relax, you’re working with IBM – DB2 on both platforms is in good shape for reducing unplanned outage• Data Sharing on DB2 for z/OS is mature and generally much

better understood by customers than it used to be• “Gold standard” for continuous availability• DB2 11 for z/OS contains some valuable new performance

enhancements

• DB2 for LUW pureScale feature implements similar architecture • Included in AWSE and AESE • Until recently pureScale supported only on IBM POWER and System

x servers, but as of DB2 10.1 FP2 or DB2 10.5 FP1, non-IBM x86 servers also supported

#IDUG


15


• Eliminating planned outage is an ongoing challenge, but news is generally good and improving all of the time• Schema change• Housekeeping• Preventative maintenance• Version upgrades

#IDUG


16

High Availability – Tomorrow

• Further data sharing and GDPS enhancements for DB2 for z/OS to re-open the gap with competitors

• Continued expansion of dynamic schema change capabilities for LUW and z/OS

• Online version upgrades• Further strides towards truly online version upgrades for DB2 for

z/OS• First steps for pureScale

#IDUG


17

In-Memory Computing – Today

• Disk access speeds are increasing, but processor speeds are increasing at an even greater rate• Therefore, relative “cost” of I/O operations is getting bigger

• Even new (expensive) SSDs are orders of magnitude slower than accessing processor storage

• Caching data in memory avoids I/O• Improves elapsed time

• Reduces CPU

• Reduces operational cost

• Allows novel access patterns to be used

• Availability of NAND / flash memory reduces impact if I/O is required• SSD

• Flash Express

• Pricing is volatile/complicated, but memory is a one-off cost

DASD - Cache

DASD - Disk

Nanoseconds (10-9)

<2 milliseconds (10-3)

>5 milliseconds

BufferPool

#IDUG


18


• OLTP• Today’s server platforms can cache large amounts of data in memory

• zEC12 can support up to 3TB per CEC (1TB per LPAR)• High-end Intel-based servers support 6-8TB per server• Average deployed server memory is increasing on both mainframe and

distributed platforms

• Specific steps being taken to allow DB2 customers to exploit larger memory footprints for OLTP workloads

• PGFIX(YES) in DB2 9• PGSTEAL(NONE) and high-performance DBATs in DB2 10• 1MB / 2GB page frames in DB2 10 / DB2 11• Large (16MB) and Huge (16GB, AIX only) OS page support in DB2 for

LUW

#IDUG


19


• Analytics• DB2 10.5 for LUW (AWSE & AESE) includes “BLU” technology - a collection of novel

technologies for optimising analytic queries,

including some specific in-memory techniques• Columnar data store with patented dynamic

in-memory optimisation for data prefetch and

retention – “treats DRAM as disk”

• Data held in compressed format in memory, while

still allowing joins and predicate evaluation –

“actionable compression”

• Very impressive query performance across a wide

variety of analytic (and even some “heavy” OLTP)

workloads• 10x – 25x elapsed time improvement is common

• Ability to more fully utilise all of the available

memory / CPU in a given server configuration

#IDUG


20

In-Memory Computing – Tomorrow

• Future zEnterprise machines likely to significantly increase maximum memory

capacity per CEC / LPAR• Cost per GB likely to continue with general downward trend

• Average installed memory per CEC will continue to increase

• DB2 for z/OS may page-fix buffer pools by default

• More common customer use of large / huge page frames

• Page fixing and large page frame support for other DB2 storage areas (e.g.

EDM pool)

• Possible use of pageable 1MB page frames supported by zEC12

• Increased autonomic capability, reduction of memory-specific system

parameters

• DB2 BLU will continue to evolve• Big push just starting on DB2 BLU in the cloud

#IDUG


21

Database Commoditisation – Today

• We’ve always lived in a heterogeneous world, but perception of databases as a commodity is increasing

• Many reasons, including• The ubiquity of SQL • The rise of packaged solutions • Java (JDBC, frameworks)• RDBMS vendor compatibility / migration initiatives• SOA• Skills availability and support team size

• The result• Lack of management awareness of business value of a specific database• Support teams and developers working with many database systems• Lowest common denominator approach

#IDUG


22

Database Commoditisation – Today

• Fight back!• Make it your mission to keep your management aware of

the unique business value of DB2• If you have to be a Jack of all trades, at

least try to become a master of one• Guess which one?

• Take pragmatic approach to lowest common denominator issue• Fight the battles worth winning• Accept the rest

#IDUG


23

DB2 Skills – Today

• DB2 is getting more complex / capable in every release• At the same time, IBM is trying to make it easier to use / understand

• Great until something needs fixing “under the hood”

• DB2 skills demographic is changing• Source: My own observations only – no scientific backup!

Skill Level

% o

f DB

2 Te

chni

cian

s

Skill Level

% o

f DB

2 Te

chni

cian

s

#IDUG


24

DB2 Skills – Today

• Source of skills is changing dramatically too

ApprenticeshipFormal Courses

ConferencesDB2-L

Manuals & Redbooks

ApprenticeshipFormal Courses

Conferences

DB2-LManuals & Redbooks

YouTube, SlideShare, etc

Blogs, online articles

MagazinesMagazines

#IDUG


25

DB2 Skills – Tomorrow

• Jury still out on longer-term impact of greying mainframe workforce• IBM making efforts with its Academic Initiative

• Training provided for 80,000 students at over 1,000 schools in 70 countries during past 7 years

• 3 mainframe Massive Open On-line Courses(MOOCs) will be made available in stages throughout the year (no cost and available to anyone, anywhere, at any time)

• Expansion of DB2’s autonomic capabilities will help, but requirement for some deeper specialist skills likely to continue for foreseeable future

Task

Co

mpl

exi

ty

Autonomics

#IDUG


DB2 Skills – Tomorrow

SQLDBA

Permanent UK jobs requiring specific skills as proportion of total demand

Performance Tuning Big Data

#IDUG


27

Big Data – Today

• Big Data and Analytics are everywhere you look• What’s a DB2 guy (or girl) to do?

• Things to keep in mind• Hadoop is not a replacement for existing infrastructure, but a tool to

augment it• Your role is still vital to your organisation!• “90% of the world’s data is unstructured, but 90% of the world’s most

important data is structured”David Barnes, IBM, 2012 IDUG Europe Keynote Speaker

• Database people have been doing big data and analytics for the past 40 years or so, just with different tools and terms (and capitalisation)

• If you have the right attitude / mind-set, a DBA background is an excellent stepping stone to becoming a wealthy “Data Scientist”

#IDUG


28

Big Data – Today

• One of the secrets to DB2’s longevity is to “embrace and extend” new technologies, and Big Data is no exception

• DB2 for z/OS• IBM DB2 Analytics Accelerator for efficiently running complex query

workloads • SQL extensions in most recent releases to improve query / analytic

workloads

• DB2 for LUW• BLU Acceleration to dramatically speed up analytics and reporting,

by multiple orders of magnitude• Part of DB2 for LUW V10.5 (included in AWSE and AESE)

• Remember that DB2 for LUW still holds Guinness World Record for Largest Data Warehouse (3PB)

#IDUG


29

Big Data – Today

• Integration between DB2 and Hadoop opens new possibilities for gaining actionable insight

#IDUG


30

Big Data – Tomorrow

• DB2 will continue with “embrace and extend” philosophy• Efficient interaction with highly optimised big data platforms such as Hadoop /

BigInsights

• Further expand internal analytic / big data capabilities

• One size does NOT fit all !

• Each approach has strengths and

weaknesses, best one is dependent

on application requirements

• NoSQL = Not Only SQL (or YeSQL)• Several NoSQL databases have

added SQL capabilities

• NoSQL for z/OS!• Simple Key / value NoSQL database for z/OS, currently freeware

• http://www.nosqlz.com

http://www.nosqlz.com/



#IDUG


31

Some Questions to Ponder

• What have you done recently to:• Reduce the operational costs of the systems you support?• Improve your personal productivity?• Make the savings that you’ve made visible to the budget holders?• Test your failover / disaster recovery arrangements?• Review your housekeeping / maintenance / upgrade procedures to

ensure you’re maximising availability?• Improve and expand your DB2 skills?• Make management aware of the business value of DB2?• Keep yourself relevant in a Big Data world?• Prepare for the future?

“The future depends on what you do today” Mahatma Ghandi

#IDUG


32

Where’s the future I was promised?

Portable fusionreactor

Self-TyingLaces

Hoverboard

Flyingcars

#IDUG


A Time Travellers Guide to DB2: Technology Themes for 2014 and beyond

Julian StuhlerPrincipal ConsultantTriton Consulting

key note session idug db2 seminar, 16th april london - julian stuhler .triton consulting

Data & Analytics

idug db2 technology

idug disclaimer

software costs ongoing

cooling costs

blu overall cost savings

operational costs

unnecessary costs

major cost component