infrastructure modernization by dr. wolfgang rother, ibm germany

European Tour 2015 DUSSELDORF- ZURICH - VIENNA - PARIS - STUTTGART Oct 27th – Nov 5th, 2015

Dr. Wolfgang Rother IBM Deutschland GmbH Nahmitzer Damm 12 12277 Berlin Email: [email protected]

Hardware …

Virtualization …

Operating System(s) …

Middleware …

Modernizing your IBM i Infrastructure

IBM Power Systems

IBM PowerVM

IBM DB2 on i HTTP, iAS, …


Power Processor Technology Roadmap

© 2014 International Business Machines Corporation

2004 2007 2010 2014

POWER7/7+ 45/32 nm

POWER822 nm

POWER6/6+ 65/65 nm

POWER5/5+ 130/90 nm

POWER9

12 Cores per Socket 8 threads per core (SMT8) L4 cache support 2 integrated memory controllers CAPI for FPGAs/GPUs …

7

Power E870

Power E880

Power S822

Power S814, S824

4Q 2015 POWER8 Portfolio

Power

S824L Power

S812L ,S822L

Scale-out servers

Scale-up Servers

Power

S822LC Power

S812LC

Power E850

Upgrades

• No same-serial-number upgrades from Power 7xx to Power S8xx

POWER6

520

POWER7

720

POWER8

S8x4

2/4-core

6/8-core

Same serial

number Migrate to new serial number

Only the Power 770/780 D models have an same-serial-number upgrades (passes financial/accounting test)

Power 795

Withdrawal from Marketing

Power 770+

Power 780+

Power 750+ / 760+

Power 710+/730+

Power 720+/740+

P460+ IBM PureFlex Nodes

p260+ PowerLinux 7R4+ PowerLinux

7R1+ / 7R2+

Withdraw 30 Nov 2015 * Withdraw 19 Feb 2016 **

x240

Withdraw 20 May 2016 **

* announced 24 Feb 2015 ** announced 29 Sept 2015

IBM Power Systems

IBM PowerVM



Refreshed rack-mounted HMC –  For POWER6 and later servers –  7042-CR9 --- follow-on to CR8

New HMC virtual appliance (vHMC) –  For POWER6, POWER7, POWER8 servers –  Same functionality as traditional HMC (version 8) –  Runs as virtual machine on x86 server

HMC Options

11

One or two HMCs One vHMC and one HMC One or two vHMCs

Options for attachment to a server

Traditional Data Center Cloud

Layer 2 Switches

Storage Fibre

Switches

Storage Fibre

Switches

File Servers

Web Servers

Security Gateway

WebSphere Application

Servers

Network Servers

Application Servers

Security Servers

Application Servers

SAN

Layer 4-7 Switches

Public Internet/ Intranet Clients

Routers (L3 Switches)

Firewalls

Delivery Models for IT Services

IBM i and PowerVM Virtualization

Consolidate via Virtual Images

Dynamic Resource Sharing

IBM i Virtualized

I/O

Network Install

Suspend Resume

Storage-based Virtual Image Deployment

Live Partition Mobility

7.1 TR2

12/10 – 6.1 & 7.1

6.1 & 7.1

7.1 TR3

7.1 TR4

VIOS is required

VIOS is required

VIOS is required

VIOS is required

Smart Cloud Entry

7.1 TR5

IBM Power VC - Managing Virtual Images

Virtualization

Compute Memory

§  Capture a Virtual Machine

-  The bootable (and multiple data) disk is copied as an image file and saved into the image repository .

-  Image meta-data describing the Virtual Machine container is captured and included as part of the virtual image.

§  Import/Export a Virtual Appliance

-  A virtual image may be imported to the image repository and cataloged by PowerVC.

-  A virtual image can be exported from a repository and easily distributed to other systems and environments.

Virtual Machine

IO / Network

Virtual Machine

View In Animation Mode

Image Repository

meta-data

SW

OS

meta-data

SW

OS

meta-data

SW

OS

meta-data

SW

OS

SW

OS

meta-data

SW

OS

SW

OS

meta-data

SW

OS

Import

Export

SW

OS

IBM PowerVC - Deploying Virtual Images

Virtualization

Compute Memory

Virtual Machine

IO / Network

Virtual Machine

View In Animation Mode

Image Repository

meta-data

SW

OS

meta-data

SW

OS

meta-data

SW

OS

meta-data

SW

OS

SW

OS

meta-data

SW

OS

SW

OS

SW

OS

SW

OS

SW

OS

SW

OS

Virtual Machine

SW

OS

VIOS using SR-IOV greatly improves performance and efficiency Oct. 15: Adding live partition mobility (LPM) to SR-IOV adapters under VIOS

–  Requires PowerVM 2.2.4 and Firmware 840 and latest levels of AIX or IBM i

SR-IOV Virtualization Enhanced . VIOS - A

LPAR #2

LPAR #3

Min of x% Min of y%

VIOS - B

Min of z%

QoS

SR-IOV Ethernet Adapter

IBM Power Systems

IBM PowerVM



IBM i Architektur

Integration

Single Level Store Object Based Architecture

Work Management

Technology Independent Machine Interface

Provides built-in application virtualization Integrates business components, e.g. database

Enables integrity, security, virus-resistance Automates & optimizes storage management

Ensures application compatibility across multiple technology generations

IBM i Support

•  Clarification of September 9, 2014 announcement –  IBM i 6.1 withdrawn from Marketing Dec 14, 2014 –  IBM i 6.1 withdrawn from Support Sept 30, 2015 –  IBM i 6.1 INCLUDES IBM i 6.1.1 –  Extended Service Option available (Ann. April 20, 2015)

** All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

IBM i System Support

1 – IBM i V5R4 and IBM I 6.1 are no longer marketed or supported other than through extended service contracts 2 – POWER7+ 750/760 do not support native I/O. 6.1 in PureFlex not available as primary operating environment 3 – Requires Technology Refresh 8 4 – no IOP or HSL support

1 Servers IBM i 5.4 IBM i 6.1 IBM i 7.1 IBM i 7.2

POWER8 ü 3 ü  POWER7/7+ PS700/701/702/730/704, Power 710, 720, 730, 740, 750, 760, 770, 780, 795, Pureflex p260/460

ü 2 ü  ü  POWER6+ JS23/43, 550*, 560 POWER6 JS12/22 ü  ü  ü  4

POWER6+ 520* POWER6 520*, 550*, 570, 595 ü  ü  ü  ü  4

POWER5/5+ 515, 520, 525, 550, 570, 595 ü  ü  ü  800, 810, 825, 870, 890 ü  ü  270, 820, 830, 840 ü 

http://www-947.ibm.com/systems/support/i/planning/upgrade/osmapping.html

…

2010 2011 2013

7.1 7.2

i next

7.1 TRs


2014 2012

……… i next+1

… …

IBM i 7.1 TR11 and

IBM i 7.2 TR3

2015

IBM i Roadmap

IBM i 7.2 TR3 or IBM i 7.1 TR11 on Power S822 Special terms/conditions

Power S822 & IBM i

22

Mobile – the next step

Traditional in-house …

… rich client or browser …

… mobile

Mobile Technology §  Plumbing §  Tools §  Applications

Client Connectivity

IBM i Access for Windows •  Windows Only •  Difficult to install •  Difficult to Manage

•  Supports Todays Devices

•  Simple Install & Mgmt •  Improved Function

IBM Navigator for i IBM i Access Mobile

Access Client Solutions Application Runtime Expert

Enhancements in IBM i 7.2:

•  Performance & Usability •  PTF management •  Message Queue monitor •  System monitors •  Batch Model •  Database

IBM Navigator for i

25

This web browser based solution has been optimized for reduced screen footprint environments.

IBM i Mobile Access

26

•  Easy to deploy and get running

•  Robust IBM i OS system interaction

•  System Management Views •  Printing, Database, IFS, Commands, Messages •  5250 Interface

•  Accessible from any Web enabled Mobile device

Access Client Solution – 5733-XJ1 •  Run SQL Scripts •  SQL Performance Center •  Direct Connect to Navigator •  Improved 5250 Emulator •  Full Windows 10 Support

•  Plus Mac & Linux

Manage and Access your System

Tool to verify runtime attributes of an application to help resolve situations where application is not starting or working properly •  Creates a template for well running application •  Performs health check against current

environment •  Identifies differences between template and

actual runtime attributes •  Provides the option to fix many of the

differences found

Application Runtime Expert for i

28

IBM Power Systems

IBM PowerVM



Enabling Solutions For Your Business

30

PASE

RPG Cobol

Open Source on IBM i Linux Solutions IBM i Native Solutions

Expanded Linux ecosystem of solutions for

CAMSS

Built by IBM to Exploit POWER8 IBM 32-bit & 64-bit Java™ Virtual Machine

–  Technology shared with AIX, IBM i and Linux –  Improves performance & portability

Exceptional Java environment and performance Support for Java 5 and Java 1.4.2 is ending

–  We no longer will be able to provide fixes for these older versions

To be compliant, need to be on the latest version of Java

Java

Apache HTTP Server

5770DG1

Web- And Integrated Application Server

Web Server

STG LWI Web

Container

HTTP(S)

System 1

Apache HTTP Server v2.4.12

5770DG1

Integrated App Server

5770SS1 option3 WAS Liberty Web

Container Plugin Module

Plugin Config XML File

HTTP(S)

Integrated Web Services Server

JSON/REST

Many nuances & limitations eliminated •  Nested output array support •  Improved processing of very large output character fields •  Preserve case sensitivity of identifiers •  Preserve field ordering •  Allow RESTful services to return user defined media types •  New transport metadata values •  Install web service script updated for SOAP services •  Allow Java-based web services

http://www-03.ibm.com/systems/power/software/i/iws/

Embracing Open Source New LPO created in 4Q 2014

–  Open Source for IBM i (5733-OPS) Options Determine Environments:

–  Option 1 – Node.JS (GA December 2014) –  Option 2 – Python (June 2015) –  Option 3 – GCC (October 2015)

Partnerships provide additional key open source technologies

–  Zend – PHP •  Shipped with IBM i

–  PowerRuby – Ruby on Rails support for i

Open Source for IBM i

http://www-03.ibm.com/systems/power/software/i/iws/

DB2 for i – Open for business 7.1

XML Support Encryption enhancements (FIELDPROCs)

Result set support in embedded SQL

CURRENTLY COMMITTED

MERGE

MQ Functions Global variables

Array support in procedures

Partition table enhancements

Three-part names and aliases

SQE Logical file support

SQE Adaptive Query Processing

EVI enhancements

Inline functions

V5R4 WebQuery SSD Memory Preference

On Demand Performance Center

Health Center Completion of SQL Core

Scalar fullselect Recursive CTE

INSTEAD OF triggers Descriptor area XA over DRDA

DDM 2-phase Scrollable cursor

2M SQL statement 1000 tables in a query

SQE Stage 5

Implicit journaling enhancements

V5R3 Partitioned tables UFT-8 and UTF-16

ICU sort sequence MQTs Sequences

Implicit char/numeric BINARY/VARBINARY

GET DIAGNOSTICS DRDA Alias DECIMAL(63)

SQE Stage 3 Ragged SWA

QDBRPLAY Online Reorganize

6.1 Omnifind MySQL storage engine

DECFLOAT Grouping sets /supergroups INSERT in FROM

VALUES in FROM Extended Indicator Variables

Expression in Indexes

ROW CHANGE TIMESTAMP

Statistics catalog views

CLIENT special registers

SQE Stage 6 DDM and DRDA IPv6

Deferred Restore of MQT and Logicals

Environmental limits

V5R2 SQE Stage 1 IASPs

Identity columns Savepoints UNION in views

Scalar subselect UDTFs

DECLARE GLOBAL TEMPORARY TABLE

Catalog views JDBC V3.0

DRDA Kerberos Journal Standby

V5R1 SQL triggers Java Functions

DRDA DUW TCP/IP 2 GB LOBs 1 Terabyte Table

Journal Minimal Data Two-phase over TCP/IP

DDL Journaling Database Navigator Generate SQL

7.2 Row and Column Access Control

XMLTABLE

CONNECT BY

OLAP Extensions

Regression Functions/Covariance/Correlation

TRANSFER OWNERSHIP

Named arguments and defaults for parameters

Obfuscation of SQL routines

Array support in UDFs

Timestamp precision

Multiple-action Triggers

Built-in Global Variables

Record movement between partitions on UPDATE

SQE support for Query/400 and OPNQRYF

1.7 Terabyte Indexes

Health Center – Non-database limits

Navigator Graphing and Charting

Comprehensive support for ‘Keep In Memory’

New IBM i 7.2 Services for these commands:

•  Work with System Status Work with System Activity

•  Work with License Information

•  Work with Output Queue

•  Work with Media Library Status •  Work with TCP/IP Network Status

MEMORY_POOL() MEMORY_POOL_INFO SYSTEM_STATUS() SYSTEM_STATUS_INFO LICENSE_INFO OUTPUT_QUEUE_INFO OUTPUT_QUEUE_ENTRIES MEDIA_LIBRARY_INFO NETSTAT_INFO NETSTAT_JOB_INFO NETSTAT_INTERFACE_INFO NETSTAT_ROUTE_INFO

WRKSYSSTS WRKSYSACT

WRKLICINF

WRKOUTQ

WRKMLBSTS

NETSTAT

IBM i DB2 Services

A complete list can be found at https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/IBM%20i%20Technology%20Updates/page/DB2%20for%20i%20-%20Services

DB2 for i - 7.2 Role-Based Security Security & DB2 for i

–  Column Masks è Deploy “need to know” logic

–  Row Permissions è Simpler, faster security

–  Violation clause for CHECK constraints è Protect data integrity

–  Secure remote journal using SSL è Achieve HA & DR objectives without exposure

–  SQL alternative to CHGOBJOWN è Embrace separation of duty, using SQL

–  Use adopted authority identity within business logic è “Who am I?” conditional code using SQL

Analytics Options

38

IBM Cognos IBM DB2 WebQuery

DB2 for i

Encoded Vector Index (EVI) Vector

1 17 5 9 2 7

49 49 5 …

Symbol Table Key Value Code First

Row Last Row Count

Arizona 1 1 80005 5000 Arkansas 2 5 99760 7300 … Wisconsin 49 7 30111 340 Wyoming 50 252 83000 2760

§  Symbol table contains information for each distinct key value -  Each key value is assigned a unique code (key compression) -  Code is 1, 2, or 4 bytes depending on number of distinct key values

§  Rather then a bit array for each distinct key value, use one array of codes

RRN 1 2 3 4 5 6 7 8 9 …

SELECT * FROM EMPLOYEE WHERE STATE = ‘MINNESOTA' AND WORKDEPT IN ( 'B01', C01, 'E01')

Intermediate RRN list

Intermediate RRN list

EVI

Final RRN list

AND (Merge)

State Workdept

State Workdepts

EVI

3 5

10 15

1000 1005 1007 3001 3050

3 7

10 27

1000 1010 2035 3001 4100

3 10

1000 3001

Index ANDing / ORing Example

Represents all the local

selection

Without MQT... Scan and aggregate 6,000,000 rows With MQT...

Scan 36 rows

SELECT year, quarter, month, SUM(revenue_w_tax) AS srevenue_w_tax, SUM(revenue_wo_tax) AS srevenue_wo_tax, SUM(profit_w_tax) AS sprofit_w_tax, SUM(profit_wo_tax) AS sprofit_wo_tax, SUM(quantity) AS squantity, COUNT(*) as number_items_per_group FROM ITEM_FACT GROUP BY year, quarter, month;

Base table(s) replaced by

MQT

Before...

After...

Materialized Query Tables (MQT)

Highlight In V5R4!

© 2013 IBM Corporation

2010 2009 2008 2007 2006 2005

Product SALES

US

Brazil

China

What is the revenue for red shoes sales in Brazil for 2008

Grouping Sets and Super Groups •  Since V6R1: Grouping and OLAP capabilities allow data to be grouped in

multiple ways with a single SQL request

•  GROUPING SETS •  ROLLUP •  CUBE

Set Object Access (SETOBJACC) command

CL Command level memory control (added in 7.1) –  CHGPF/CHGLF … KEEPINMEM(*YES|*NO)

SQL KEEP IN MEMORY memory-attribute (new in 7.2)

–  Target new or existing SQL tables & indexes CREATE TABLE … KEEP IN MEMORY NO or YES Once set, behavior matches KEEPINMEM

DB2 for i & In-Memory controls

Blog thread: In Memory… http://db2fori.blogspot.com/2013/10/in-memory.html

…

2010 2011 2013

7.1 7.2

i next

7.1 TRs


2014 2012

……… i next+1

… …

We are just here!

2015

Don’t Forget the IBM i Roadmap

Questions?

Thank You

Merci

Danke