akiko hoshikawa 12/14/2016 - baltimore/washington … · 12/14/2016 · buffer pool simulation -...
TRANSCRIPT
Please note IBM’s statements regarding its plans, directions, and intent are subject to change
or withdrawal without notice and at IBM’s sole discretion.
Information regarding potential future products is intended to outline our general
product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment,
promise, or legal obligation to deliver any material, code or functionality. Information
about potential future products may not be incorporated into any contract.
The development, release, and timing of any future features or functionality described
for our products remains at our sole discretion.
Performance is based on measurements and projections using standard IBM
benchmarks in a controlled environment. The actual throughput or performance that
any user will experience will vary depending upon many factors, including
considerations such as the amount of multiprogramming in the user’s job stream,
the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve results
similar to those stated here.
12/13/2016World of Watson 2016 2
Performance Updates
DB2 H/W Synergy Updates Recent Performance PMR Experience
Performance Topics in DB2 11
DB2 11 Performance Features in DB2 11 New Function Mode
Performance Topics in DB2 12System level Performance Feature
3
Agenda
Challenges
• Ever increasing transactions and data. Can DB2
handle?
• Yet, we need to reduce IT costs
4
”Out of the Box” CPU saving
added first 64 bit support
What Have We Done?
No more low
hanging
fruits
Finished 64 bit
conversion
PCI – Processor Capacity
Index (IBM MIPS)
141-way
Customer Processors
PCI for 1-way
1695
Memory
10 TB
System I/O Bandwidth
832 GB/Sec*
80-way
64-way
54-way
1.5
TB
512
GB1202902600
288 GB/sec*
172.8 GB/sec*
15143 TB
384 GB/Sec*
101-way
z10 EC
z9 EC
z196
zEC12
z13
IBM z13
Will larger buffer pool really help my workload?
• Depend on,
• Access pattern
• Active working set size
Buffer Pool Simulation - DB2 11 CM with PI22091
• Benefit from increasing size of buffer pools varies depending on the workload
• Data access pattern, current buffer pool configuration, etc.
• Provides accurate simulation results from increasing buffer pool size as you run your production workloads
control blocks for simulated pools
Simulation pools = SPSIZE
Buffer poolcontrol blocks
Buffer pools = VPSIZE
How To Use Simulation – Example
• Simulate BP1 additional 500,000 for BP1 with seq. prefetch threshold of 30 % instead of current 60 %
• Collect statistics data or DISPLAY BUFFER POOL DETAIL command outputs • Recommend to reset SPSIZE(0) when simulating different SPSIZE
• Recommend to take enough samples (2-3 hours ) per SPSIZE
• Cost Storage : SPSIZE * 0.02, CPU: approx 1% per Simulated Pool
- ALTER BPOOL(BP1)
SPSIZE(500000) SPSEQT(30)
- DISPLAY BUFFER POOL (BP1) DETAIL
continue to run your workloads
(>1hour)
- DISPLAY BUFFER POOL (BP1) DETAIL)
Measurement IntervalUse this output as simulation result
Simulation Output
DSNB432I -CEA1 SIMULATED BUFFER POOL ACTIVITY -
AVOIDABLE READ I/O -
SYNC READ I/O (R) =25463982
SYNC READ I/O (S) =81181
ASYNC READ I/O =15470503
SYNC GBP READS (R) =11172099
SYNC GBP READS (S) =4601
ASYNC GBP READS =1181076
PAGES MOVED INTO SIMULATED BUFFER POOL =53668641
TOTAL AVOIDABLE SYNC I/O DELAY =35321543 MILLISECONDS
Display output from –DIS BPOOL (BP1) DETAIL or statistics trace class 1, 2 for the measurement interval
Sync I/Os / interval = avoidable sync I/O per second • (25463982 + 81181)/360 = 70958 I/O per sec
Customer Example : Avoidable I/O by Member
0
1000
2000
3000
4000
5000
6000
7000
DP30 DP31 DP32 DP33 DP34 DP35 DP36 DP37 DP38 DP39 DP3A DP3B
Avoidable Sync I/O per sec
1X
2X
5X
10X
20X
40X
zHyperWrite Log Write Response Improvement with PPRC
zHyperWrite function for DB2, z/OS and DS8870 with GDPS or TPC-R HyperSwap
• Response time reduced up to 58%
• Benefit percentage varies with distance
Requirements • z/OS and DFSMS APARs
• DB2 10 and DB2 11 SPE APAR PI25747
• Set ZPARM (REMOTE_COPY_SW_ACCEL)
• IBM DS8870 Storage Subsystem MCL
• R7.4 87.4x.x.x - DS8870 242x model 961
DB2 Response Reduction with zHyperWrite
050
100150200250300350400450
Elapsed Commit Wait
tim
e in
se
c
HyperWrite Performance in Data Sharing / Multi Threads
Base PPRC HyperWrite
-22%
-40%
DB2 concurrent insert batch jobs (commit every 10 insert) in data sharing shows 40% reduction in commit response time and 22% elapsed time reduction
Additional CPU in master SRB for triggering additional I/O request
DB2 11 zIIP eligible
z13 Simultaneous Multithreading (SMT)
• SMT-2 allows instructions from two threads to execute on zIIP or IFL core
• Designed to deliver overall capacity (throughput) improvement
• Capacity gain per core will vary • z/OS team’s benchmarks observe 10 to 40% capacity
increase
• With SMT, each threads run slower but more tasks can be dispatched
• Available for tasks running under zIIPs• System parm MT_ZIIP_MODE=1|2 – active threads per online
zIIP core
15
80 50
SMT-2 Eligible = DB2 zIIP Eligible
• DB2 DRDA
• DB2 Query parallelism (parallel tasks)
• DB2 Utilities (selective phases and sort)
• DB2 System tasks running under enclaved SRBs• DB2 10 (prefetch reads and deferred writes)
• DB2 11 (most of async SRB works including in DBM1 and MSTR address spaces)
• DB2 XML parsing
• JCC T2 Application (JVM)
16
• SMT-2 shows throughput improvement of up to 20% with DRDA workload compared to SMT-1 on z13
• No elapsed time impact observed in DRDA/OLTP workload
• zIIP capacity increase
• General CPU time reduction when there are not enough zIIPcapacity
• IIPCP > 0
• Benefits likely depend on the type of workloads and configuration
• With C4Z4, zIIP Capacity factor was 1.2
17
DB2 DRDA Workload (IBM Brokerage OLTP)
(Controlled measurement environment, results may vary)
Transaction CPU time (ms)
Throughput (ITR – trx/sec)
Shared Memory Communications-Direct Memory Access (SMC-D)over Internal Shared Memory (ISM)
• zEC12 introduced Shared Memory Communications over RDMA (SMC-R)
• Using RoCE express feature
• z/OS LPAR to z/OS LPAR, could be across CECs
• Z13 GA2 introduces Shared Memory Communications-Direct Memory Access (SMC-D)
• Direct LPAR to LPAR communications within CEC
• Very similar to SMC-R (over RoCE) extending the benefits of SMC-R to same CPC operating system instances without requiring physical resources (RoCEadapters, PCI bandwidth, NIC ports, I/O slots, network resources, 10GbE switches etc.).
18
Preliminary measurements with SMC-D(z/OS to z/OS)
19
0
500
1000
1500
2000
2500
3000
3500
4000
4500
0
0.001
0.002
0.003
0.004
0.005
0.006
0.007
0.008
SMC-D HiperSockets 10Gbit ethernet
thro
ugh
pu
t p
er s
ec
tim
e in
se
con
d
DB2 CL.1 elapsed time DB2 CL.1 CPU time ETR (trans per second)
Recent Performance PMRs (1)
• Real Storage Management = AUTO/OFF/ON update by PM99575• Possible CPU increase with RSM=AUTO in DB2 master address space or DRDA
threads due to overhead of releasing real storage in z/OS
• If there are enough memory, or repeating same set of packages per thread, RSM=OFF will provide performance benefit
• If you do not have enough memory, RSM=OFF could possibly cause memory increase
• Log read through replication products • Possible CPU increase due to CLAIM request increase in DB2 11
• Solution : PI70095 design change not to use CLAIM
• Reducing Buffer pool size • Takes large amount of DBM1 CPU time to contract VPSIZE
• Working as designed, but we will look into20
Recent Performance PMRs (2)
• Slow to insert into PBG (APPEND YES) from 800 concurrent clients under non data sharing • Due to space map contention at the end of TS
• Using MEMBER CLUSTER and increasing the page size to 32K solved the problem
• DB2 12 addresses this
21
Performance Updates
DB2 H/W Synergy Updates Recent Performance PMR Experience
Performance Topics in DB2 11
DB2 11 Performance Features in DB2 11 New Function Mode
Performance Topics in DB2 12System level Performance Feature
22
Agenda
23
Extended LRSN/RBA and LRSN Spin Avoidance – NFM
• LRSN spin can be totally eliminated in DB2 11 NFM
• Requires both BSDS and objects to be extended log format to see the benefit• Log record size increase starts the point of BSDS conversion • DB2 12 requires BSDS conversion but not for catalog/user objects
-33%
-47%-15% LRSN spin is
recorded in DB2 statistics service fields
QJSTSPNN
QJSTSPNI
Expect approx.
50bytes log record
increase at BSDS
conversion
24
Not Logged DGTTs - NFM
NOT LOGGED option (default LOGGED) • ON ROLLBACK DELETE ROWS (Default, rows deleted) • ON ROLLBACK PRESERVE ROWS (rows preserved)
• Less CPU from log processing, less log volume • Faster rollback/error processing after large insert into DGTTs • Application programmers must take ROLLBACK behavior into consideration
0 10 20 30 40 50 60 70 80 90
Elapsed
CPU
Elapsed
CPU
Elapsed
CPU
Elapsed
CPU
Inse
rtU
pdat
eD
ele
teR
OLL
BA
CK
Time in Second
Without LOG With LOG
2.8x Elapsed Reduction on ROLLBACK
Indirect Reference (Overflow Records) - DB2 11 NFM
Indirect References (overflow records)
– Created during UPDATE against variable length rows or compressed rows
row-1row-2 row-3
row-100row-101
row-2Pointer to row-2
Impact caused by indirect references – Additional getpages, potentially additional I/Os to the overflow pages– Lower clustering– REORG TS is necessary to remove indirect references
Update row-2with larger data
Data Page 1 Data Page n
Reduction of Indirect References - NFM
• Insert process to reserve the space for subsequent update
CREATE TABLESPACE TS1
PCTFREE 20 FOR UPDATE 10
• DDL CREATE/ALTER with PCTFREE x FOR UPDATE y • x = % of free space to leave in each data page by LOAD or REORG • y = % of free space to leave in each data page by INSERT, LOAD or REORG• INSERT will preserve y% while REORG will preserve (x+y) %
• System parameter PCTFREE_UPD (AUTO, 0 to 99) • System default 0 : same behavior as DB2 10
• PCTFREE_UPD = AUTO and FOR UPDATE -1• DB2 determines the value using the history of UPDATE behavior based on Real Time Statistics
(UPDATESIZE is added in RTS) • Recommendation : Use FOR UPDATE -1 unless you know better
• Applicable for newly created objects as well as existing objects (PI12400)
Performance Updates
DB2 H/W Synergy Updates Recent Performance PMR Experience
Performance Topics in DB2 11
DB2 11 Performance Features in DB2 11 New Function Mode
Performance Topics in DB2 12System level Performance Feature
28
Agenda
DB2 12 Key Features Sy
stem
Per
form
ance •Exploit in
memory optimization
•Contiguous BPOOL
• Insert Algorithm
•Better Commit LRSN
•More zIIPsupport
SQL
Perf
orm
ance •Dynamic Plan
Stability
•Runstatsprofile
•Query CPU improvement in Union All, Outer Join
•Adaptive Index
•UDF Caching
An
alyt
ics,
Clo
ud
an
d M
ob
ile A
pp • IDAA
•RestAPI
•Paginations
•Piece meal wise delete
•XM, JSON improvement
•Complex Triggers
DB
A a
nd
24
*7
•Easy Migration
•Online Schema
•PBR RPN
•LOB zEDCCompression
•Security
•Async Lock Duplexing
•Profile improvement
DB2 12 Key Features – System Performance Sy
stem
Per
form
ance
• Exploit Large Real Memory • Index in memory =Fast Traverse Block • Contiguous buffer pool, PGESTEAL(NONE)
• zIIP Usage • Scalability improvement
• Insert Algorithm 2 • Latch contention reduction• EDM pool management improvement
• Better lock avoidance with long running UR
•
Index to Data: Random Keyed Access
Index IX1 with 5 levels
Fast Traverse Block contains non-leaf pages
Limitation : Unique index with size of 64 bytes or less
Turned on as default with upper limit control by user Index Memory Optimization Daemon process monitors index usage
Object level control possible through catalog table
Table
N4
N3
N2R
In Memory Structure (Fast Traverse Block)
How FTB Works ?
• Turn on/off and upper limit controlled via DB2 system parameter INDEX_MEMORY_CONTROL • AUTO, DISABLE or 500-200000 MB
• Using the default, DB2 uses up to 20% of sum of allocated buffer pools
• DB2 monitors candidate index usage and select the indexes to create the in-memory structure
• Main metric is traverse counter with other adjustments
• Users can influence the behavior through catalog table input SYSIBM.SYSINDEXCONTROL, similar to pseudo delete entry cleanup
• New display command to monitor the objects and storage usage
• New instrumentations added to record FTB usage
Using Index in Memory – Batch SELECT
6%
11%
16%
23%
2 3 4 5Index Levels
Improvement (%) from Simple Lookup with DB2 12 vs. DB2 11
0 1 2 3 4 5 6 7 8 9 10
OLTP-simple5 (IMS/DB2)
OLTP-simple2 avg (Distributed)
OLTP-simple1 (IMS/DB2)
OLTP- simple3 (CICS/DB2)
OLTP- complex (SQLPL)
OLTP- simple4 (SPROC)
OLTP CPU(%) DB2 11 vs 12
FTB=AUTO FTB=Disable
zIIP Updates
• CPU parallel queries - up to 80% -> up to 100% zIIP eligible
• REORG and LOAD utility RELOAD phase
36
141
52
60
147
V11 V12
CP
U IN
SEC
ON
D
REORG UTILITY CPU USAGE FROM ESP CUSTOMER’S DATA
zIIP
CP
Introducing New Insert Algorithm
37
Page A
Thread-2
Thread-3
Thread-1
Thread-1
Thread-2
Thread-3
Page A
Page B
Page C
In memory Structure (Insert Pipe)
A B C D
Page D
Insert Algorithm 2
• Applicable with UTS with Member Cluster (with and without APPEND)
• SYSTEM level : DSNZPARM: DEFAULT_INSERT_ALGORITHM
1 – use basic insert algorithm (algorithm 1)
2 – use new insert algorithm (algorithm 2) - Default for DB2 12 FL500
• Object level : CREATE TABLESPACE or ALTER TABLESPACE
INSERT ALGORITHM clause
0 – use subsystem default
1 – use basic insert algorithm (DB2 11 behavior)
2 – use advanced insert algorithm
>4 GB Active Log Data Sets
• Active log data set size impacts frequency of log switch and speed of recovery
• DB2 12 maximum size of active log data set is 768 GB
• SMS data class with extended addressability (EA) set to YES
• Customers may opt for size less than 768 GB
• Size of archive log data sets also a factor in choosing active log data set size
• >4 GB active logs supported After New Function Activation (FL500)
• Adding new active log data set > 4 GB can be done by
• DSNJU003 standalone utility or
• -SET LOG NEWLOG
• > 4GB and <= 4GB logs can be mixed
DB2 Latch Reduction
• DB2 internal latch contention relief • LC14 buffer manager latch
• LC19 log latch
• LC23 page latch timer
• LC23 page unlatch
• LC24 EDM latch
0
20000
40000
60000
80000
100000
120000
2 10 100 180
Log
latc
h c
on
ten
tio
n p
er
seco
nd
Number of Threads
Log Latch Reduction
DB2 11 DB2 12
• Simulated stock exchange transactions
• Utilizing DB2 12 scalability features : New insert algorithm and >4GB log, and log latch reduction
• All done with single z13 box
• 12 way DB2 data sharing with 4 way sysplex
• 2 zLinux driving 1200 clients concurrently
• 2000MByte active log I/O per second
• 11.7 million per second from 12 members without index defined
• 5.3 million per second from 12 members with a partition index defined
41
11.7 Million Inserts Per Second
DB2DB2
DB2
DB2DB2
DB2
DB2DB2
DB2
DB2DB2
DB2
Java clients On zLinux
z13 4 LPAR * 18 CPs512 GB Memory
Data base and Log DS8870 * 7
z13 2 ICF * 10 CPs, 200GB
Coupling Facility
z13 2 zLinux * 18 CPs, 40GB
Benchmark Environment
Addressing Customers Pain Points
Buffer pool simulation
Reduce the impact of long running unit of work in data sharing
Minimize the impact of Unload & Runstats in data sharing
A new keyword REGISTER NO/YES is added to UNLOAD / RUNSTATS
Peer Recovery support
Fast DRDA Load
DRDA Global Transaction support for data sharing
IMS connection Pooling
Possible Resource Planning with Default System Parameters Parameters • Increase in real storage requirement - up to 30% of DB2 11
Index in memory • Possibly up to 20% of buffer pools allocated, so far it has not reched
Insert algorithm 2 • 37KB per partition for each member • Additional buffers may be necessary (up to 2000 buffers per objects) depending on
the disk I/O performance EDM pool management change
• Up to 20% of specified EDM pool size Default zparm size increase
• EDM_SKELETON_POOL 10M->50M SCA minor usage increase - Data sharing lock avoidance improvement
• Additional 16KB * (N+1) to SCA for new Global CLSN support, where N = number of members to store commit LSN
• Increase in log record size • Additional 20-28 bytes at migration of DB2 12
DB2 12 Key Features - SQL Query Performance SQ
L Pe
rfo
rman
ce
• Access Path Stability • Support for dynamic SQL plan stability • Usability for static plan stability • Automated update of stats profile by optimizer
• Query Performance Improvement• Union all and outer join enhancements • Runtime improvements
• UDF caching • Sort improvement • Adaptive Index selection
Query Workload Results
0 10 20 30 40 50 60 70 80 90 100
Biday long
SAP BW
TPCD
TPCH-SQLPL
Customer 1
Customer 4
TPCH NPI D=Any
TPCH NPI D=1
Customer 2
Biday short
SAP SFIN
Customer 3cl
WAS portal (selective)
SAP SFIORI
DB2 12 CPU doff (%) from DB2 11 NFM
DB2 12 Beta Program
DB2 12 Cost Savings
The biggest benefit with DB2 12 comes with Index in memory optimization (Fast Traverse Block) which provides incredible costs savings with lower CPU consumption for OLTP – nearly 9-10% after Rebind. This should bring down our mainframe operating costs.
Jacek SurmaDII,Zespół Systemów Mainframe
DB2 12 - The #1 Enterprise Server for Mission Critical Data !
We are really excited about Performance Enhancements in DB2 12 especially advance "in-memory" (Fast Traversal Blocks FTB) capabilities. During testing we have seen up to 5 % CPU reduction and this clearly relates to enormous potential cost savings and positions DB212 as a leader in Enterprise Database market.
İbrahim ParlakIT ManagerGaranti Bank
DB2 12 Availability & Security
We are very pleased with many of the new DB2 12 features, especially with Transfer Ownership and Pending Alter Column feature this give our Enterprise higher availability and securitywhich are “critical” in the banking industry.
Jacek SurmaDII,Zespół Systemów Mainframe
DB2 12 – Exciting new capabilities
We love the "agile partition technology" that DB2 12 offers. This feature makes it easier for ITERGO to address "hot spots" where "new data" is inserted. This is particularly important when enterprises are looking for scale, speed and reduced costs .
Walter JanissenChief Architect ITERGO
DB2 12 rules the API Economy
The RESTful API is yet another way where DB2 is at the leading edge – and again cementing DB2’s and the mainframes position as a full capable server in the IT infrastructure of today. Using these REST-services Mobile applications can both be built faster and run faster !
Frank PetersenChief Architect BankData
DB2 12 –Offering Advanced “in-memory” technology
We are looking forward to exploiting the advanced "in-memory" technology that DB2 12 offers (Index Fast Traverse Block) this gives us an opportunity to reduce CPU resource consumption and performance cost by using more real memory. It is very cost effective trade off for enterprises like us that run DB2 12 on z13 machines. During testing we have seen up to 23% CPU reductions in "specific" test cases.
Henrik Henriksen
DB2 DBA Danske Bank
More than 50 Clients and Vendors
Very large DB2 users
“V11 migration was good (an improvement over V10) but V12 is even better!”
– Large German Insurance Company
Akiko Hoshikawa IBM Silicon Valley [email protected]
Notices and
disclaimers
Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.
Information in these presentations (including information relating to products that have not yet been announced by IBM) has beenreviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.
IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”
Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.
Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.
References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.
Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.
It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or representor warrant that its services or products will ensure that the customer is in compliance with any law.
55 12/13/2016World of Watson 2016
Notices and
disclaimers
continued
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.
The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right.
IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.
56 12/13/2016World of Watson 2016