practical db2 udb performance

Practical DB2 UDB Performance

John MaenpaaSenior [email protected]

© YL&A 1999-2003 Practical DB2 UDB Performance2

Practical DB2 UDB Performance© Copyright 1998-2003 Yevich, Lawson & Associates, Inc. All Rights Reserved

Yevich, Lawson & Associates. Inc.3900 Wood Duck Dr. Suite DSpringfield, IL 62707

TEL: 1-888-246-5049INT’L: 1-217-698-8142FAX : 1-217-698-8143

[email protected]

Developed by:John Maenpaa


Disclaimer PLEASE READ THE FOLLOWING NOTICE

The information contained in this presentation is based on techniques, algorithms, and documentation published by the several authors and companies, and in addition is the result of research. It is therefore subject to change at any time without notice or warning. The information contained in this presentation has not been submitted to any formal tests or review and is distributed on an “As is” basis without any warranty, either expressed or implied.

The use of this information or the implementation of any of these techniques is a client responsibility and depends on the client’s ability to evaluate and integrate them into the client’s operational environment.

While each item may have been reviewed for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere.

Clients attempting to adapt these techniques to their own environments do so at their own risks.Foils, handouts, and additional materials distributed as part of this presentation or seminar should be reviewed in their entirety.

This presentation may contain information about software releases that are not yet Generally Available. Material is subject to change. YL&A is not responsible for the accuracy of the information.IBM is not responsible for the accuracy of the information or delivery of unreleased features discussed in this presentation.

4© YL&A 1999-2003 Practical DB2 UDB Performance

This presentation will serve as an introduction to performance monitoring UDB databases. The target audience will be DBA’s who have little or no system or performance tuning experience. The goal of this presentation is to cut through the mounds of performance issues, and focus on the big things which can be easily addressed by applying a few practical techniques. The system monitors, snapshot monitors, event monitors, and control center monitoring will be discussed, as well as a simple and practical approach to utilizing these tools quickly and effectively.

Abstract

Practical DB2 UDB Performance© YL&A 1999-2003 5

■ Performance– Behavior of computer under a specific workload

■ Performance Measurement– Response time– Throughput– Availability

■ Performance Tuning– Iterative– Long-Term– Application Specific– Balancing Act

Define Performance Tuning


Balancing Resources

■ Processor (CPU)■ Memory■ I/O■ Network■ People■ Money


■ Collect statistics– The optimizer can’t do its job without them

■ Workload Performance Wizard– Guides that helps tune queries

■ Health Center– Provides a set of monitoring and tuning tools

■ Design Advisor Tool (db2advis)– Find out what indexes may improve query performance

■ Activate the database– ACTIVATE DATABASE command– Initializes database on all partitions– Avoid startup time on first connection

Quick-start Tips


■ Instance– Database Manager– System Administration– Communication– Attach-level

■ Database– Contains Data– Application– Connect-level

Instances and Databases


DB2 Monitors



■ Setting Defaults■ Setting Interactively■ Counter Reset

Monitor Switches


■ Get Monitor Switches■ Set Monitor Switches■ List Applications Show Detail■ db2mtrk■ db2expln

Commands


■ Get Snapshot For DBM■ Get Snapshot For All Databases■ Get Snapshot For All Applications■ Get Snapshot For Dynamic SQL on database

Snapshot Monitors


Get Snapshot>>-GET SNAPSHOT FOR---------------------------------------------> >--+-+-DATABASE MANAGER-+--WRITE TO FILE-------------+----------> | +-DB MANAGER-------+ | | '-DBM--------------' | +-ALL--+-----+--DATABASES-------------------------+ | '-DCS-' | +-ALL--+-----+--APPLICATIONS----------------------+ | '-DCS-' | +-ALL BUFFERPOOLS---------------------------------+ +-+-----+--APPLICATION--+-APPLID--appl-id------+--+ | '-DCS-' '-AGENTID--appl-handle-' | +-FCM FOR ALL DBPARTITIONNUMS---------------------+ +-LOCKS FOR APPLICATION--+-APPLID--appl-id------+-+ | '-AGENTID--appl-handle-' | +-ALL REMOTE_DATABASES----------------------------+ +-ALL REMOTE_APPLICATIONS-------------------------+ '-+-ALL-------------------+--ON--database-alias---' +-+-----+--+-DATABASE-+-+ | '-DCS-' '-DB-------' | +-+-----+--APPLICATIONS-+ | '-DCS-' | +-TABLES----------------+ +-TABLESPACES-----------+ +-LOCKS-----------------+ +-BUFFERPOOLS-----------+ +-REMOTE_DATABASES------+ +-REMOTE_APPLICATIONS---+ '-DYNAMIC SQL-----------'


Number of executions = 1 Number of compilations = 1 Worst preparation time (ms) = 10 Best preparation time (ms) = 10 Internal rows deleted = 0 Internal rows inserted = 0 Rows read = 3 Internal rows updated = 0 Rows written = 0 Statement sorts = 0 Total execution time (sec.ms) = 0.011386 Total user cpu time (sec.ms) = 0.000000 Total system cpu time (sec.ms) = 0.000000 Statement text = UPDATE ONTRACK SET TWCS_580 = '0´0´0' WHERE ONTRACKID = '1007371_CHELSEAEVANS_1'

Get Snapshot for Dynamic SQL


Event MonitorSET EVENT MONITOR

EVENT_MON_STATE(EVEMONNAME)

Catalog:

Monitor Definition

File(s)Named Pipe

Active Event Monitor

DB2EVMON

CREATE EVENT MONITOR

DROP EVENT MONITOR

SELECT

CASE

WHEN EVENT_MON_STATE

WHEN EVENT_MON_STATE

END

FROM SYSCAT.EVENTMONITORS

EVMONNAME,

(EVMONNAME) = THEN 'Inactive'

(EVMONNAME) = THEN 'Active'


■ Deadlocks■ Statements

Event Monitors


External Monitors



■ top■ ps■ Task Manager■ Performance Monitor

Processor


■ top■ ps -ef■ ps -aux■ Windows Task Manager

Looking at Processes


top - 08:37:51 up 11:15, 0 users, load average: 0.61, 0.33, 0.20Tasks: 108 total, 5 running, 103 sleeping, 0 stopped, 0 zombieCpu(s): 86.8% user, 13.2% system, 0.0% nice, 0.0% idleMem: 774608k total, 767504k used, 7104k free, 70372k buffersSwap: 1028152k total, 24776k used, 1003376k free, 471492k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ Command 3979 jmaenpa 20 0 16768 13m 11m R 82.0 1.8 0:09.58 kdeinit 4822 jmaenpa 11 0 250m 250m 250m R 7.9 33.1 42:16.16 vmware 4156 jmaenpa 11 0 9492 9472 4576 S 4.9 1.2 0:00.58 db2bp 4202 jmaenpa 11 0 7520 7512 3148 S 2.3 1.0 0:00.25 db2 4082 jmaenpa 12 0 1032 1032 808 R 1.3 0.1 0:01.86 top 2035 jmaenpa 8 0 10772 7620 7520 S 0.3 1.0 0:00.26 kdeinit 2313 jmaenpa 9 0 18176 15m 12m R 0.3 2.0 0:12.83 kdeinit 4157 db2inst1 9 0 34500 33m 32m S 0.3 4.4 0:00.16 db2sysc 1 root 8 0 512 464 448 S 0.0 0.1 0:03.47 init 2 root 9 0 0 0 0 S 0.0 0.0 0:00.42 keventd 3 root 18 19 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd_CPU0 4 root 9 0 0 0 0 S 0.0 0.0 0:00.82 kswapd

Output from "top"


USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMANDroot 1720 0.0 0.1 6072 1404 ? S Dec02 0:00 /opt/IBM/db2/V8.1/bin/db2fmcddb2as 1774 0.0 0.2 9304 2040 ? S Dec02 0:00 /home/db2as/das/bin/db2fmd -i ddb2as 2254 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmdb2as 2255 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmdb2as 2256 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmdb2as 2258 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmdb2as 2260 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmdb2as 2261 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmdb2as 2262 0.0 0.2 10248 2052 ? S Dec02 0:00 /home/db2as/das/adm/db2dasrrmjmaenpa 3982 0.0 0.1 2308 1364 pts/1 S 08:34 0:00 /bin/bashroot 4051 0.1 2.6 85876 20868 pts/1 S 08:34 0:00 db2wdogdb2inst1 4056 0.0 2.9 86132 22996 pts/1 S 08:35 0:00 db2syscroot 4057 0.0 2.6 85876 20904 pts/1 S 08:35 0:00 db2ckpwdroot 4058 0.0 2.6 85876 20904 pts/1 S 08:35 0:00 db2ckpwdroot 4059 0.0 2.6 85876 20904 pts/1 S 08:35 0:00 db2ckpwdroot 4060 0.0 2.6 85876 20908 pts/1 S 08:35 0:00 db2gdsdb2inst1 4061 0.0 2.7 86084 21164 pts/1 S 08:35 0:00 db2syslogdb2inst1 4062 0.0 2.7 86084 21236 pts/1 S 08:35 0:00 db2ipccmdb2inst1 4063 0.0 2.9 86132 22928 pts/1 S 08:35 0:00 db2tcpcmdb2inst1 4064 0.0 2.9 86132 22992 pts/1 S 08:35 0:00 db2resyncdb2inst1 4065 0.0 2.7 85876 20928 pts/1 S 08:35 0:00 db2srvlstjmaenpa 4156 2.0 1.2 27120 9472 pts/2 S 08:36 0:03 /home/db2inst1/sqllib/bin/db2bpdb2inst1 4157 0.2 4.4 123624 34456 pts/1 S 08:36 0:00 db2agent (GDMS0401)db2inst1 4160 0.0 2.7 122768 21052 pts/1 S 08:36 0:00 db2loggr (GDMS0401)db2inst1 4161 0.0 2.7 122756 20952 pts/1 S 08:36 0:00 db2loggw (GDMS0401)db2inst1 4162 0.0 2.7 122756 21340 pts/1 S 08:36 0:00 db2dlock (GDMS0401)db2inst1 4163 0.0 2.8 122760 21768 pts/1 S 08:36 0:00 db2pfchrdb2inst1 4164 0.0 2.7 122756 21472 pts/1 S 08:36 0:00 db2pfchrdb2inst1 4165 0.0 2.7 122756 21016 pts/1 S 08:36 0:00 db2pfchrdb2inst1 4166 0.0 2.7 122756 21168 pts/1 S 08:36 0:00 db2pclnrdb2inst1 4167 0.0 2.7 85880 20972 pts/1 S 08:36 0:00 db2event (DB2DETAILDEADLOCK)jmaenpa 4202 1.8 0.9 22912 7512 pts/2 S 08:37 0:01 db2

Output from "ps -aux"


UID PID PPID C STIME TTY TIME CMDroot 1720 1 0 Dec02 ? 00:00:00 /opt/IBM/db2/V8.1/bin/db2fmcddb2as 2254 1 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmdb2as 2255 2254 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmdb2as 2256 2255 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmdb2as 2258 2255 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmdb2as 2260 2255 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmdb2as 2261 2255 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmdb2as 2262 2255 0 Dec02 ? 00:00:00 /home/db2as/das/adm/db2dasrrmroot 4051 1 0 08:34 pts/1 00:00:00 db2wdogdb2inst1 4056 4051 0 08:35 pts/1 00:00:00 db2syscroot 4057 4056 0 08:35 pts/1 00:00:00 db2ckpwdroot 4058 4056 0 08:35 pts/1 00:00:00 db2ckpwdroot 4059 4056 0 08:35 pts/1 00:00:00 db2ckpwdroot 4060 4056 0 08:35 pts/1 00:00:00 db2gdsdb2inst1 4061 4056 0 08:35 pts/1 00:00:00 db2syslogdb2inst1 4062 4056 0 08:35 pts/1 00:00:00 db2ipccmdb2inst1 4063 4056 0 08:35 pts/1 00:00:00 db2tcpcmdb2inst1 4064 4056 0 08:35 pts/1 00:00:00 db2resyncdb2inst1 4065 4060 0 08:35 pts/1 00:00:00 db2srvlstjmaenpa 4156 1 2 08:36 pts/2 00:00:04 /home/db2inst1/sqllib/bin/db2bp 4089C1001 5db2inst1 4157 4062 0 08:36 pts/1 00:00:00 db2agent (GDMS0401)db2inst1 4160 4060 0 08:36 pts/1 00:00:00 db2loggr (GDMS0401)db2inst1 4161 4060 0 08:36 pts/1 00:00:00 db2loggw (GDMS0401)db2inst1 4162 4060 0 08:36 pts/1 00:00:00 db2dlock (GDMS0401)db2inst1 4163 4060 0 08:36 pts/1 00:00:00 db2pfchrdb2inst1 4164 4060 0 08:36 pts/1 00:00:00 db2pfchrdb2inst1 4165 4060 0 08:36 pts/1 00:00:00 db2pfchrdb2inst1 4166 4060 0 08:36 pts/1 00:00:00 db2pclnrdb2inst1 4167 4060 0 08:36 pts/1 00:00:00 db2event (DB2DETAILDEADLOCK)jmaenpa 4202 4089 1 08:37 pts/2 00:00:01 db2

Output from "ps -ef"


Windows Task Manager Process View


Memory Hierarchy

Database Manager

Shared Memory

Database Global

Memory

Application Global

Memory

Agent Private

Memory

Database Global

Memory

Application Global

Memory

Agent Private

Memory

(numdb)

(maxappls)

(maxagents)


Database Global Memory

Utility Heap

util_heap_sz

Database Manager

Shared Memory

Application Global

Memory

Agent Private

Memory

Database Global

Memory

Backup Buffer

Restore Buffer

restbufsz

Package Cache

pckcachesz

Database Heap

dbheap

Log Buffer

logbufsz

Catalog Cache

catalogcache_sz

Lock List

locklist

Extended Memory

Cache

Bufferpools



Log

BufferLog

Writes:

Wrap

Commit

Log

Write

Head

Services:

RDS= Relational Data Services

DMS= Data Management Services

BPS= Buffer Pool Services

LMS= Log Manager Services

Application

Program

Database

Agent

Buffer Pool Descriptive Area

Buffer Pools

I/O Servers Page CleanersChanged Pages

Threshold

Table Spaces

Logfiles



Global SQL Cache

Dynamic SQL Cache

User 1 Catalog

Tables

Static SQL Cache

Section Section

Section Section

Section Section

Section Section

Section Section

User 2

SQL

Compiler

Application

A

Application

B


■ Operating System Tools– vmstat– ps– Windows Task Manager– Windows Performance Monitor

■ DB2 Memory Visualizer– db2memvis

■ DB2 Memory Tracker– db2mtrk– Current Usage– Maximums– Watermarks

Looking at DB2 Memory Usage


procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu---- r b swpd free buff cache si so bi bo in cs us sy id wa 1 0 61260 86448 27388 436992 0 1 17 15 166 508 6 6 88 0 4 0 61260 86412 27420 436996 0 0 0 10 1190 3211 89 11 0 0 6 0 61260 86396 27436 436996 0 0 0 6 1188 3157 88 12 0 0 4 0 61260 86328 27472 436996 0 0 0 14 1343 3323 92 8 0 0 4 0 61260 86312 27488 436996 0 0 0 6 1375 3270 89 11 0 0

Output from "vmstat"


Output from "DB2 Memory Visualizer"


$ db2mtrk -i -p -w -d -vTracking Memory on: 2002/12/03 at 10:03:26

Memory for instance

Database Monitor Heap has watermark of 180224 bytes Other Memory has watermark of 5226496 bytes Total: 5406720 bytes

Memory for database: GDMS0401

Backup/Restore/Util Heap has watermark of 16384 bytes Package Cache has watermark of 327680 bytes Catalog Cache Heap has watermark of 81920 bytes Buffer Pool Heap has watermark of 4341760 bytes Buffer Pool Heap has watermark of 671744 bytes Buffer Pool Heap has watermark of 409600 bytes Buffer Pool Heap has watermark of 278528 bytes Buffer Pool Heap has watermark of 212992 bytes Lock Manager Heap has watermark of 458752 bytes Database Heap has watermark of 1540096 bytes Other Memory has watermark of 0 bytes Total: 8339456 bytes

Memory for agent 4157

Application Heap has watermark of 212992 bytes Application Control Heap has watermark of 16384 bytes Total: 229376 bytes

Output from "db2mtrk"


■ Data Placement■ Index Placement■ DMS or SMS

I/O Tuning

Data Index

Agent

LOB


Storage Distribution – Logs

■ Log Placement

Data Index

Agent

LOBLogsLogs

Log

Writer


■ iostat■ Performance Monitor

Storage


Output from “iostat”

tty: tin tout avg-cpu: % user % sys % idle % iowait 0.0 0.7 10.4 7.1 66.2 16.2

Disks: % tm_act Kbps tps Kb_read Kb_wrtnhdisk0 2.4 22.3 3.5 882928 1204548hdisk1 2.3 13.5 3.1 51513 1205556hdisk2 0.0 0.2 0.0 7926 8591hdisk3 0.0 2.7 0.1 244815 8667hdisk5 0.4 5.8 0.6 398895 141241hdisk6 1.5 9.3 1.5 507399 358925hdisk8 0.6 4.4 0.7 378227 29820hdisk10 0.4 6.2 0.5 432079 150080hdisk7 1.2 8.1 1.5 145979 610140hdisk9 0.5 6.2 0.7 443075 133559hdisk4 1.8 17.2 2.5 995893 610140hdisk11 0.4 6.1 0.5 439219 128642hdisk13 1.9 19.1 2.6 1438816 348162


Performance Monitor


■ Static SQL– Explain

■ Dynamic SQL– Snapshot– Explain

Applications


GUI Tools



Control Center


■ Better than parameter defaults■ User input

– Database description– Memory availability– Workload– Locking

■ Overrides permitted

Configuration Advisor


Visual Explain


■ Workload– Single SQL statement– SQL statements with frequencies

■ Recommends indexes for queries■ Uses optimizer to compare candidates

Design Advisor


Design Advisor


Health Center


Trademarks

■ IBM– is a registered trademark of International Business Machines

Corporation.■ DB2

– is a trademark of IBM Corp.


Cost Avoidance Through Performance Audits

■ DB2 Performance Audits– Existing or new database designs and applications– Certification of design and implementation acceptance– Evaluation of all the performance ‘points’ in a DB2 environment

■ Physical Design■ Subsystem■ Application Code and SQL

Specific to your needs!


Thank You

practical db2 udb performance

Documents