database, aix, and more

Database, AIX, and more

© 2004 IBM Corporation

Agenda

• iSeries Review

• DB2 UDB for iSeries V5R3 Overview


A Decade of 64-bit Processor Excellence

1.9 / 36MB1.4 / 32MBL2 / L3 cache

>= 1.5 GHz 1.1 / 1.3 GHzFrequency

1 TB256 GB Max memory

POWER5POWER4™

• 9th generation 64-bit processor• 5th generation POWER Architecture


Sneak Preview of UNIXPOWER5 Certification Test

1) How many layers of metal are in the POWER5 MCM?

2) What is the peak intersystem chip to chip bandwidth rate?

3) What is the size of the POWER5 L3 Cache?

4) What is the area of the POWER5 MCM?

5) How many iSeries customers care about Questions 1-4

• 89

• 26.4 GB/sec

• 36 MB

• 90.25 CM2

• 0


Why do customers like iSeries?• Because there’s real value in integration

• Because reliability is a feature, not an option

• Because it supports mixed workloads on a single server, with stability, at high levels of system utilization

• Because it practically manages itself

• Because it’s more secure by design, providing natural defenses against viruses and the vulnerabilities which they attempt to exploit

• Because it’s technology independent, allowing new technologies to be introduced with minimal disruption


Single Level StorageSystem spreads data and indexes across available I/OAutomatic rebalancingLeverage I/O Parallelism by defaultNo need for monitoring table spaces/log buffers/etc.

Object Based, Integrated OSDatabase objects treated like any other objectBenefits

– Security - Virus Protection– Administration - simplified Management (ex: H/A)

ImpactMeta Group, 3 year TCO Study

– iSeries 1/7 cost of Sun, 1/5 cost of HP, 1/2 of Windows 2000Survey.COM

– DB2 requires 50% of DBAs per Terabyte compared to Oracle IDC Server Cost of Ownership, 5 year TCO Study

– iSeries 58% less than Unix, 72% lower than Wintel

DB2 Leverages Fundamental iSeries/OS400 Architecture

M EMORY

QUERYSQL

IOP IOPIOPIOPIOPIOPIOP

Single Level Storage

Cust #1 Cust #2 Cust #3 Cust #4 Cust #5 Cust #6 Cust #7


IBM Virtualization Engine and ^ i5

This presentation contains information about IBM’s plans and directions. Such plans are subject to change without notice.

IBMVirtualizationEngine™


570 Enterprise Edition Examples Scalable On Demand Operating Environment Flexibility

0 2 4 6 8 10 12 14 16

Processors

570 1/2-way

570 2/4-way

570 5/8-way

570 9/12-way

570 13/16-way

• Flexible on demand pricing options• Mix workloads in an on demand operating environment• Mix and match i5/OS application workloads

i5/OS & EnterpriseEnabled

i5/OS

AIX 5L

Linux

No License


DB2 Leverages Virtualization Engine Technologies

• Features new POWER Hypervisor™ for ^ i5– Supports i5/OS, AIX 5L and Linux and up to 254* partitions

• Increase server utilization rates across multiple workloads

– Automatic processor balancingwith uncapped partitions

• Improve fault tolerance and lower partition management costs

– Primary partition replaced by Hardware Management Console (HMC)

• An IBM Virtualization Engine systems technology* Product Preview Up to 40 with 570 4-way. This presentation contains information about IBM’s plans and directions. Such plans are subject to change without notice.


Flexible Capacity on Demand Options

• Extend Capacity Upgrade on Demand and On/Off Capacity on Demand options to ^i5 servers

• New Memory CoD*• New Trial CoD* • New Reserve CoD*

– Automatically enable reserve capacity if processor utilization reaches 100%

• Immediate activation, no system restarts or database reconfiguration required.

• An IBM Virtualization Engine systems technology

Planned availability 3Q 2004 This presentation contains information about IBM’s plans and directions. Such plans are subject to change without notice.


IBM eServer i5 Announcements• Part 1: May 4, 2004 (GA June 11)

– Delivering the industry’s firstPOWER5™ based servers

– Exploiting a common eServer platform with eServer p5

– Completing the vision of an on demand operating environment

– Extending the value of open integration with i5/OS and WebSphere®

• Part 2: July 2004 (GA August 30)– AIX 5L™ 5.3 and Linux™– CoD Enhancements– POWER5 scalability with 16-way 570– Flexible on demand pricing


AIX Flexibility: Virtual and Direct I/O

i5/OS LPAR Linux LPARi5/OS LPAR AIX LPAR

Virtual SCSI

Virtual Ethernet

Virtual I/O Direct I/O

i5/OS provides virtual disk to AIXImproves asset utilization and ROIUses the IBM Virtualization Engine

Resources dedicated to AIXAIX management of disk, NICsAIX independent of other LPARs


DBMS Options

• DB2 UDB for iSeries

• DB2 UDB for LUW (Linux/Unix/Windows)– “Stinger”

• Other IBM Databases– Cloudscape in Linux– Informix in AIX– U2 (Universe/Unidata) in AIX

• Oracle/SQLServer/Sybase/Progress/Others?


Fang Brothers Knitting• Background

– Global textile and apparel manufacturer with headquarters in Hong Kong– Manufacturer for Gap, Ann Taylor, Tommy Hilfiger, and more

• Objectives– Provide more capacity to support company expansion– Improve customer relationship management

• Solution– Two eServer i5 520s

1. i5/OS with RPG-based Garment application to support Hong Kong users and migration from Exchange to Domino mail.

2. One i5/OS partition with Garment application for China and AIX 5L partition to run CRM application from e-Jing -- built with WebSphere and Oracle

Fang Brothers selected the eServer i5 for is scalability, stability, and its ability to consolidate application on one server. eServer i5 delivered the lowest TCO.


WindowsWindows,

Linux, PDAs

Windows,Linux, Unix, PDAsOS/400Operating Systems

No

No

No

62%

Clustering

Limited

Medium

Yes

Yes

Proprietary Transact

SQL

Yes

No

Itanium

SQLSrv2000

Proprietary Pl/SQLStandard SQLStandard

SQLStored Procedures

YesYesYesJava and .NET

NoNoYesRPG Native DB I/O

YesYes*Yes64 bit

No

Yes

Partial

72%

RAC

Limited RAC

High

Yes

Yes

Oracle 10g

YesPartialAST/MQTs

NoYesDynamic Resource Allocation Across Partitions

No

73%

MPP

SMP – 64 Way*

Medium

Yes

Yes

DB2 UDB V8

YesEVIs

98%SQL 2003 Standard: Core Element Support

MPPHorizontal Scaling

SMP – 64 WayVertical Scaling

LowDBA Support

YesWeb Services

YesXML

DB2 UDB for iSeriesCategory

The Power of DB2 UDB for iSeries compared to alternatives

DB2 UDB for iSeries– Compelling Price

•DB2 Included with OS/400

– Higher Reliability•Security•Availability with simplicity

– Lower Support Costs•Reduced DBA Costs•OS/400 Integration

– Scale with Ease•Vertical scaling •On/Off Capacity Upgrade on Demand•Technology transitions without pain

– Single RDBMS, Multiple IDEs•Native OS/400; Websphere; .NET; etc.

Technical Story Business Story


OS/400 + DB2 UDB for iSeries as the "Server"OS/400

Windows

Linux

AIX

OS/400

JDBCCLI*EmbeddedDRDANative/DDM JDBC

DRDA

JDBCODBCDRDA

JDBCODBCOLE DB.NETDRDA

* OS/400 PASE only supports CLI

iSeries Toolbox JDBCDB2 ConnectDB2 Information Integrator

iSeries Toolbox JDBCDB2 ConnectiSeries ODBC

iSeries AccessDB2 ConnectDB2 Information Integrator

DB2UDBfor

iSeries


FEDERATED ACCESS TO DB2 DataJDBC, ODBCCLI/DRDAConnection Pooling

Wide Variety of Clients

"Single point-of-connect" for end-users and applications

DB2 v8.1 for Windows

DB2 UDB for iSeries

DB2 forLinux

Informix

DB2 EE/EEE

DB2

Connect

DB2 R

un-Tim

e C

lient

Native or ODBC Data Access

Single RDBMS View

DB2 z/OSDB2 Connect


DB2 Information Integrator

Local Data Mart

SQLServer

DB2/400 Operational Data

Oracle Enterprise Warehouse

DataJoinerDB2 II

Heterogeneous SQL DML read, write, update, insert, delete

Heterogeneous ReplicationWhite Paper: http://www-1.ibm.com/servers/enable/site/education/ibo/record.html?hetdata


Agenda

• iSeries Overview

• DB2 UDB for iSeries V5R3 Overview


DB2 UDB for iSeries (OS/400) StrategyProtect customer's investment in legacy applications

ƒ Ex: Webfacing, XML Extenders for RPG, webservices, etc.

Support Open Standards Required by our ISVs and Customers

ƒ Industry consortium and defacto standards

ƒ Ex: SQL, Webservices, XML

Leverage IBM database research and development for continued database functionality and performance

ƒ Ex: EVIs, SQL Optimization, OLAP Mining

Preserve "Enterprise Computing Made Simple" initiatives while evolving into On-Demand computing

ƒ Lowest Total Cost to Own RDBMS

ƒ Autonomic Computing Features


Conformance to 2003 Core

No database vendor today has all the features of CoreDB2 Universal Database for iSeries already has shipped most of the items

DB2 UDB for iSeries V5R2

DB2 UDB for LUW Version 8

DB2 UDB for z/OS Version 8

Microsoft SQL Server 2000

Oracle 10g

0 10 20 30 40 50 60 70 80 902003 Core Items

V5R3Next ReleaseCOMPLETE


Major Features AIXSavepoints Shipped

SET SCHEMA and SQLID ShippedOrder by expression not in result ShippedIdentity Columns ShippedCommon Catlog Views ShippedEmbedded CREATE SCHEMA ShippedNested Compound ShippedITERATE ShippedFullselect in Nested and Common Table Expressions ShippedUNION in Views ShippedScalar subselect (Stage 3) ShippedUser-Defined Table Functions PartialCREATE TABLE AS( fullselect) PartialCore Standard Items Future directionROWIDs Future directionInformation Schema Views Future direction

DB2 UDB iSeries V5R2 - Major Engine Features


DB2 UDB iSeries V5R3 - Major Engine Features

Major Features AIXMaterialized Query Tables (Technology Preview) ShippedINTERSECT EXCEPT DISTINCT ShippedLATERAL correlation ShippedROW Expressions in INSERT ShippedRETURN TO CALLER and RETURN TO CLIENT ShippedProcedure enhancements ShippedEncryption PartialSEQUENCEs PartialNew scalar functions PartialUTF-8 and UTF-16 PartialImplicit character to numeric conversions Future directionLocal Partitioning Future directionBINARY and VARBINARY Future directionGET DIAGNOSTICS Future directionDECLARE CURSOR and PREPARE enhancements Future directionCore Standard Items Future direction


Major Features iSeriesRoutine Enhancements Shipped

except ALTERHeterogeneous Two-phase Over TCP/IP ShippedOnline Table Load ShippedLogging Enhancements (Dual, 256 GIG, Infinite Active Log) ShippedNew Built-in Functions ShippedDECLARED GLOBAL TEMPORARY TABLE enhancements ShippedCatalog views ShippedPackage Versions ShippedOnline Table Reorganization ShippedMaterialized Query Tables V5R3 Tech PreviewINSTEAD OF Triggers Near-term directionXML Support Enhancements Future directionINSERT through UNION ALL Views Future directionInformational Constraints Future directionMDC Clustering Future direction

DB2 UDB AIX Version 8 - Major Engine Features


Sequence Object

• Another DB2 construct that supports the automatic generation of column values

• Viewed as a superset of V5R2 identity columns• Generated values easily shared across tables• Can create constant sequence to be used as Global DB2 variables• Example:

CREATE SEQUENCE order_seqSTART WITH 1 INCREMENT BY 1 NO MAX VALUE

INSERT INTO orders(ordnum,custnum) VALUES (NEXT VALUE FOR order_seq, 123)

VALUES NEXT VALUE FOR order_seq INTO :hostvar

UPDATE orders SET ordnum = :hostvarWHERE custnum = 123


Column Level Encryption

• Requires the IBM Cryptographic Access Provider 128-bit product• Column Requirements:• Data Type Requirements: BINARY/VARBINARY, CHAR/VARCHAR FOR BIT DATA,

BLOB, and DDS CHAR/VARCHAR with CCSID(65535)• Length Requirements: • Extra 8 bytes & total length must be rounded to 8-byte boundary

(replace 8 with 16, if BLOB or double-byte CCSID)• 32-byte hint can optionally be stored with encrypted value• Example: 6-byte employee id with no hint needs to be stored in a VARBINARY(16)

CREATE TABLE emp(id VARCHAR(16) FOR BIT DATA,name VARCHAR(50))

SET ENCRYPTION PASSWORD = 'protect'

INSERT INTO emp VALUES(ENCRYPT('112233'), 'BOB SANDERS' )

SELECT DECRYPT_CHAR(id), name FROM emp• Native program access:

– Encryption: Use Before triggers to intercept write requests and then have the trigger execute the Encrypt function against sensitive columns

– Decryption: Define SQL View containing decrypt and then open SQL View as a logical file to read unencrypted data


IBM's DB2 UDB Development Center

V5R3Additonal object support

Java ProceduresExternal Procedures

Run an deploy

Current supportSQL procedures

Coming AttractionsEclipse frameworkFunctionsDebug


Support for .NET

V5R3 Functionality Includes:Connection PoolingStored ProceduresSQL Naming UnicodeIsolation Level/Commitment CtlTracingCompression

Restrictions:System Naming (*SYS)Package Support (Ext Dynamic)LOB & Datalink ColumnsUDT ColumnsRecord Level AccessCMD/PGM callData Queues

Native .NET Managed Provider


DB2 Connect Plug-ins for Visual Studio .Net

Toolbox

DB2 Output Message Pane

IBM Explorer

DB2 Projects

Properties

Dynamic Help

Intellisense

SQL Editor


DB2 Migration Toolkit

Migrate Other Databases to DB2 UDB for iSeriesNo chargeAutomates the Migration Process

– Builds SQL DDL from Oracle Meta Data– Converts Scripts– Migrates Tables, Indexes, Views – Handles Data Type differences– Converts Procedures, Triggers, Functions

V5R3Support for coming attractions

(for example, sequence objects)SQL ServerSybaseInformix

Download:ibm.com/servers/enable/site/db2/porting.html

Custom Technology Center Services RECOMMENDED– Contact Mark Even: [email protected]


Parallel Methods– Parallel table scan– Parallel index scan– Parallel hash join– Parallel hash group by– Parallel index build– Parallel data load– Parallel index ANDing/ORing of

dynamic bit maps – Parallel index maintenance– Parallel Encoded Vector Index – Parallel I/O– Parallel recovery

QUERYSQL

M EMORY

IOP IOPIOPIOPIOPIOPIOP

Single Level Storage

Cust #1 Cust #2 Cust #3 Cust #4 Cust #5 Cust #6 Cust #7

V5R3– Parallel reorganize

Performance/Scalability

V5R2 – SQL Query Engine


Loosely Coupled - Massively Parallel– Shared Nothing Architecture– Partitioned Database, Table is spread across nodes– User-Defined partitioning or random partitioning– SINGLE TABLE VIEW to the application– Data Warehousing, OLAP, Data Mining, DSS Reporting– Performance and Capacity Scalability virtually unlimited– Single Table can be spread across up to 32 systems

– over 54.4 Terabytes in Size

Local Partitioned tables - V5R3– Hash and range partitioning – Fast roll-in and fast roll-out– SINGLE TABLE VIEW to the application– Scalability (if you cant fit in 1.7 TB or 2 gig rows)

– over 435.2 Terabytes in Size

DB2 UDB Multisystem for iSeries

PARTHASH

PART000001 PART000002

PART000003

PART000004

Table Members


SQE CharacteristicsParallel to Normal Release EnhancementsObject Oriented DesignEnhanced Performance Enhanced Optimization EngineEnhanced Statistics Encoded Vector Indexes Enhancements

SQE Delivery– First Wave V5R2 GA– Second Wave mid-V5R2 (Check APAR II13486)– Third Wave V5R3 GA– Fourth Wave tentatively scheduled for mid-V5R3

SQL Query Engine (SQE)


Response Time Comparison - V5R2 to V5R3

337 queries exercising a wide range of function.

All longer running queries and most short running queries performed better

13 short running queries (under 3 seconds) performed slightly worse

V5R3 vs V5R2 - SMP *OPTIMIZE

0

20

40

60

80

100

120

140

160

180

>100 >75 >50 >25 >10 >0 0 >0 >10 >25 >50 >75 >100 >150 >200 >250 >300 >350 >400 >500

Percent Difference

Num

ber o

f Que

ries


SQE Enhancements• Star Join Recognition (ie, Lookahead Predicate

Generation)• Check Constraint Awareness • SQE Stats Manager can use constraints to improve

accuracy of Filter Factors and Cardinality

• SQE Optimizer will rewrite query to avoid execution when input data is out of rangeConstraint Def: CHECK(col1 BETWEEN 1 AND 100)Original Query: SELECT * FROM t2 WHERE col1=:hv

Rewritten Query: SELECT * FROM t2 WHERE (:hv BETWEEN 1 AND 100)

AND col1 = :hv• RI Constraint Awareness• SQE Optimizer can rewrite query to eliminate join

combinations• Immediate on-demand statistics generation• Result Set Caching• Customized Visual Explain for SQE access methods

Remaining SQE restrictions:

LIKE Predicate

LOB columns

Sort sequences

ALWCPYDTA(*NO) & SENSITIVE Cursors

Logical File References

Select/Omit Logical Files

Non-SQL interface


• Database reorganization – Restart & monitoring

improve operational flexibility

• Rapid Checkpoint Save-While-Active – New save-while-active option improves performance when

applications have open commitment control transactions

• RAID 5 across SCSI buses extends fault tolerance

• Concurrent I/O tower and IXA add/remove with eServer i5 servers*

• Automatic conversion of IFS directories to improve performance

• System Time Base is Now Coordinated Universal Time (UTC)

• Enable support for System Time Zone with daylight saving time

Planned availability 3Q 2004 This presentation contains information about IBM’s plans and directions. Such plans are subject to change without notice.

V5R3 Availability Enhancements


Cross Site Mirroring (XSM)

• Create a simpler disaster recovery or high availability (HA) solution

– Should be combined with an HA solution in the datacenter

• Mirrors all objects in an Independent Auxiliary Storage Pool (IASP)

• New support for spool files in IASP


Trademarks and Disclaimers© IBM Corporation 1994-2004. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.The following terms are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both:

Lotus, Freelance Graphics, and Word Pro are registered trademarks of Lotus Development Corporation and/or IBM Corporation.Domino is a trademark of Lotus Development Corporation and/or IBM Corporation.

C-bus is a trademark of Corollary, Inc. in the United States, other countries, or both. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ActionMedia, LANDesk, MMX, Pentium and ProShare are trademarks of Intel Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries.SET and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC. Other company, product and service names may be trademarks or service marks of others.

Information is provided "AS IS" without warranty of any kind.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information in this presentation concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Contact your local IBM office or IBM authorized reseller for the full text of the specific Statement of Direction.

Some information in this presentation addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Photographs shown are of engineering prototypes. Changes may be incorporated in production models.

xSeriesRationalPOWER5iSeriese(logo)serverDB2POWER4POWEROS/400NotesMQSeriesLotus

WebSphereQuickplaceIBM(logo)e(logo)businessAS/400eTotalStoragepSeriesIBM Virtualization Enginee business(logo)AS/400

i5/OSTivoliPOWER6IBMDominoAIX 5L (logo)400ThinkPadPOWER HypervisorHipersocketsDataPropagatorAIX 5LzSeriesS/390Power EverywhereEnterprise Storage ServerDB2 OLAP ServerAIX/Lz/OSRS/6000Power ArchitectureeServerDB2 UniversalAIX


Virtualization Engine Enhancements for POWER5

i5/OSLinuxAIX 5L

i5/OSOS/400Linux

Operating Systems

HMCPrimary Partition Management

64 TB2 TBMaximum Virtual Disk per partition

409416Maximum # of Virtual Ethernets

StaticDynamicAutomatic

StaticDynamic

Processor Movement

Up to 10Up to 10Partitions per Processor

25432Maximum # of partitions

eServer i5iSeries

IBM Virtualization Engine Systems Technologies


What is it?

Cross-platform performance monitoring toolOne central IBM Director server, many monitored systemsAccessed through IBM Director client for Windows, LinuxPart of IBM Virtualization Engine, “system service”Integrated with iSeries PM

What is it used for?

System inventory collectionPerformance monitoringPerformance alertsAutomatic actions upon meeting utilization criteria

Server Management: IBM Director*

*Product preview


Backups for Hosted AIX 5L: BRMS

Backup Recovery Media Services

i5/OS LPP

Centralized, automated backups

Supports i5/OS, and Virtual I/O for AIX 5L and Linux partitions, IXA/IXS

GUI management through iSeries Navigator

Simple backup policy creation

Tasks before backup: shut down hosted partitions (AIX 5L, Linux)

During backup: what to back up, when, where

After backup: start hosted partitions


Scorpion Studies: Sampling of four customers

database, aix, and more

Documents