ibm storage update - gse...
TRANSCRIPT
IBM Storage Update
Nick Clayton
IBM Systems Development
3rd November 2015
Session DA
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Agenda
• Introduction
• DS8880 Storage System Family
• Spectrum Scale and Linux on z
• Other Recent Storage Enhancements
2
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 Family – R8.0 Announcement Summary
� Announcement date: October 20, 2015
� Planned Availability date: December 04, 2015
– IBM POWER8 processor technology
– Two models - DS8884 and DS8886 – preview of DS8888
– Scalable system memory and scalable processor cores in the controllers
– New rack power system
– New I/O bay interconnect
– Improved I/O enclosure bays
– Standard industrial rack packaging
– Small form factor Hardware Management Console (HMC)
– Model conversion from DS8870 Enterprise Class to DS8886 will be available
� Introduces a new advanced function license packaging
– Base functions license
– Copy Services license
– z-synergy license
3
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8 Advanced F(X)
2 – 3 Times 8870 Perf
19” Rack
2 TB Cache (DRAM)
128 Ports
1536 HDD/SDD’s
Introducing the new DS8880 family
Preview
DS8884 DS8886 DS8888
Fast
Starting Price <$50K
256 GB Cache (DRAM)
64 Ports
768 HDD/SSD + 120 flash cards
19”Standard Rack
Faster
2X Performance
2 TB Cache (DRAM)
128 Ports
1536 HDD/SSD’s + 240 flash cards
19” Standard Rack
Fastest
Industry’s Fastest T1 Subsystem
2 TB Cache (DRAM)
128 Ports
Flash Cards Only
19” Standard Rack
4
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8886 Hardware
Base Frame Expansion Frame
SSD/DDM Media Enclosure
High Performance Flash Enclosure
I/O Bay Enclosure
DC-UPS
P8 Servers
SSD/DDM Media Enclosure
High Performance Flash Enclosure
I/O Bay Enclosure
DC-UPS
1 or 2 HMC
5
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 New IO Bay
• PCIe x8 Gen 3 I/O fabric
• 4x IO Bay bandwidth
• 2 dedicated PCIe x8 connections on each IO bay for High Performance Flash Enclosure (HPFE)
• Frees up slots in the IO bay for Host Adapter usage
• Up to 32*4-port 16Gb Host Adapters
• Maximum of 128 16GB ports on DS8886
• Maximum of 64 16Gb ports on DS8884
Same maximum of 128 ports with 8-port 8Gb Host Adapter
DA
HA
HA
DA
HA
HA
HPFE HPFE
6
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Extendable Top Rack for DS8886
• Adjustable top enables rack to stretch from 40U to 46U once rack is in place– Can be performed by a single SSR – no heavy components
– Top is never removed from the rack
– Extension to the front and rear door to cover
Base 40U rack Remove bolts to release top. Extend top up, one end at a time.
Add side panel/EIA rails and secure with bolts. Release extension corner posts and lock down.
Final assembly with top extended to 46U
7
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 density with 19” rack
• 30% reduction in minimum footprint
• 25% increase in drive density for typical configurations
• 12% reduction in maximum footprint
0 50 100 150 200 250 300 350 400
Driv
e
De
nsit
y
Width of DS8000
DS8870 DS8880
240 2.5”120 Flash
336 2.5”120 Flash
480 2.5” 480 2.5”
192 2.5”432 2.5”432 2.5”288 2.5”120 Flash
192 2.5”120 Flash
8
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Keyboard/Display and HMC
New Mini HMC allows for 2 HMC’s to be integrated into base Rack.
Keyboard / display slide out from side of rack
Small HMC allows for 1 or 2 to be installed under DC-UPS
Configuration Options:
•DS8880 can support one or two HMCs in the base frame. Second HMC can be concurrently installed after initial install if desired.
9
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 Remote Support Options
Call Home (Outbound)
Used for
– Problem Reporting
– VPD/MRPD transmission
– Bulk Data (StateSave/PE Package) transmission
Available Connections
– Internet SSL
– Assist OnSite (AOS)
– Internet VPN
– Modem (AT&T)
– FTP (for Bulk Data only)
Remote Access (Inbound)
Used for
– Support Center/DPFE/Development Dial-in
Available Connections
– Modem (Dial-In not through AT&T, RPQ only)
– Internet VPN
– Internet SSL – AOS
The IBM AOS redbook at http://www.redbooks.ibm.com/abstracts/redp4889.html?Open provides additional information on AOS as a secure remote service solution.
10
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 – Advanced Function Licensing
• Simplified license structure
– Base function license
– Copy Services license
– System z synergy license
• Base is required and will be included on all DS8880s
– OEL, Thin Provisioning, Easy Tier, Database Protection, Encryption, I/O Priority Manager
• Copy Services license optional
– FlashCopy, Metro Mirror, Global Mirror, Metro/Global Mirror, Multi-Target PPRC, z/OS Global Mirror (XRC) and z/OS Global Mirror Resync
• System z synergy license optional
– FICON, System z High Performance FICON (zHPF), PAV, HyperPAV, IBM z/OS Distributed Data Backup
11
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 Family - z/OS OLTP Performance
0
1
2
3
4
5
6
0 200000 400000 600000 800000 1000000 1200000 1400000 1600000 1800000
Re
sp
on
se
Tim
e (m
s)
IO Rate (KIO/s)
DS8800 p6 4 core 768 HDD DS8870 p7+ 16 core 1536 HDD
DS8870 p7+ 16 core 8 HPFE (240 Flash Card) DS8884 p8 6 core 4 HPFE (120 Flash Card)
DS8886 p8 24 core 8 HPFE (240 Flash Card)
1.5X Faster
12
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
DS8880 Family - z/OS OLTP Performance
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0.5
0 200,000 400,000 600,000 800,000 1,000,000 1,200,000 1,400,000 1,600,000 1,800,000
Re
sp
on
se
Tim
e (m
s)
IO Rate (KIO/s)
DS8870 p7+ 16 core 8 HPFE (240 Flash Card) DS8884 p8 6 core 4 HPFE (120 Flash Card)
DS8886 p8 24 core 8 HPFE (240 Flash Card)
1.5X Faster
200us response time with HPFE for this workload10% reduction compared to DS8870
13
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
16Gb vs 8Gb HA – CKD zHPF
0
50
100
150
200
250
Single Port Read Hit Single Port Write Hit Single HA Read Hit Single HA Write Hit
KIO
Ps
zHPF - 4KB Read/Write IOPs
16Gb Channel/16Gb HA 8Gb Channel/16Gb 8Gb Channel/8Gb HA
3X
3.3X
14
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
0
5
10
15
20
25
30
35
40
45
DS8800 p6 4 core DS8870 p7+ 16 core DS8884 6 core DS8886 16 core DS8886 24 core
GB
/s
Read GB/s Write GB/s
DS8880 Family - Sequential Performance
15
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Model Conversion from DS8870 to DS8886
• Move Disk Enclosure and HDD/SSDs
• Move Flash Enclosure and Flash Cards
• Move Device Adapters• Move Host Adapters
DS8870
DS8886
Model conversion is a disruptive activity. See IBM System Storage DS8880 Introduction and Planning Guide, GC27-8525
16
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
IBM Spectrum Scale
Enterprise or Commodity Hardware
Non-disruptive data
migration
Flash
Acceleration
Network performance
monitoring
File Placement
Optimization
Native Encryption
And Secure Erase
Global Active File
Management
Advanced Mirroringand Caching Services
Common Management
Cloud Ready
High speed
scanning engine
Policy baseddata migration
Multiple platform support
17
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Spectrum Scale and Linux on z
18
• Spectrum Scale support for Linux on z is being rolled out in a controlled manner
• Functions are currently limited to the Express and Standard Editions
• A number of features are not supported including :– TSM/HSM
– Asynchronous Disaster Recovery
– NFS and Clustered NFS
• Application support is limited to WebSphere® Application Server (WAS) MQ, or similar workload infrastructure environments, WebSphere based OLTP workloads (Bookstore Application, DayTrader, TPC-C) Sterling Connect:Direct and FileNet®P8/ECM5.2.1.
• Heterogeneous clusters are supported without local storage access but are limited to client-only POWER or x86 servers running the RHEL, or SLES, and POWER with AIX.
• Supported storage is IBM Systems Storage DS8000, IBM Storwize V7000, IBM FlashSystem, IBM XIV, or IBM SVC
• Scaling is limited to 128 nodes.
• Support for stretched cluster with synchronous mirroring utilizing block-level replication with distances of less than 40 km
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Spectrum Scale for clustered applications
• A common use-case for Spectrum Scale is with a clustered application where multiple OS require access to the same data
• Oracle and DB2 both use Spectrum Scale on distributed platforms to provide a shared filesystem to members of the database cluster
• MQ and WebSphere running on Linux for z were highlighted as uses cases in the announcement materials
• This avoids the need to use NFS which is the other common method of providing this type of capability
Linux
SS-Server
App
Linux
SS-Server
App
CKD or FB volumes
Linux
SS-Server
App
19
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Linux
SS-Server
App
Linux
SS-Server
App
Using Spectrum Scale NSD clients
• Spectrum Scale supports a topology where not all users of the filesystem have direct access to the underlying storage devices (NSDs)
• NSD server instances provide access to the filesystem for NSD clients with TCP/IP connectivity between the server and clients
• Hipersockets can be used to provide high speed connectivity in a z environment
• Multiple servers provide redundancy for access with up to 8 NSD server instances for any particular disk device
• Linux instances with high IO activity might use SAN connectivity while less IO intense instances could use client/server access
Linux
SS-Client
App
Linux
SS-Client
App
CKD or FB volumes
20
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Dedicated NSD server guests• One possibility for a configuration with NSD
clients is to have a set of dedicated NSD servers which have the sole purpose of serving the Spectrum Scale filesystem to clients
• These could either be dedicated guests in a z/VM environment, dedicated Linux LPARs or special purpose KVM LPARs
• This would provide a degree of separation of the infrastructure services and end-user applications and simplify management in environment with a large number of guests.
• This is similar to the Power VIOS LPAR concept
Linux/KVMLinux/KVM
21
Linux
SS-Client
App
Linux
SS-Client
App
SS-ServerSS-Server
CKD or FB volumes
21
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Heterogeneous and Multiple cluster environments• Spectrum Scale supports access to
filesystems between different Spectrum Scale clusters
• This allows the use of a consolidated Spectrum Scale filesystem in environments with a large number of guests
• With NSD-client access there is no requirement that all members or clusters are on the same operating system
– Distributed Spectrum Scale clients could access data stored on Linux on z or vice versa
• Full heterogeneous and multiple cluster support is planned for future releases
– NSD-Client support is available today for RHEL and SLES clients on Power and x86
Linux/KVMLinux/KVM
Linux
SS-Client
App
SS-ServerSS-Server
CKD or FB volumes
Linux
SS-Client
App
Linux
SS-Client
App
Linux
SS-Client
App
AIX/Windows
SS-Client
App
22
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Spectrum Scale Quorum
• Spectrum Scale supports a quorum capability as a tiebreaker in failure situations
– Quorum must be failure isolated for a high availability configuration
• Both server (quorum node) and storage (tiebreaker disk) quorums are supported
Linux
SS-Server
App
Linux
SS-Server
App
Linux
SS-Client
Quorum disk
23
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
HA/DR configuration with z/VM
Linux
SS-Client
Metro Mirror secondary
Metro Mirror primary
Global Mirror secondary
• Metro Global Mirror with HyperSwap provides HA and DR
– z/OS systems omitted for clarity
• Spectrum Scale Quorum instance in Disaster Recovery location
24
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
• ICM integration of DS8870•OpenStack Kilo Based
• DS8870 Microcode supported R7.0 – R7.5•Based on ESSNI/Java Cinder driver (1.5.1)
• Introduction to zKVM with DS8870 Cinder support
• Q3 2015 with ICM 4.3FP3
zKVM Support - DS8000 and IBM Cloud Manager
25
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Optimized for enterprise-scale data from multiple platforms and devices
� FICON Express16S links reduce latency for workloads such as DB2 and can reduce batch elapsed job times
� Reduce up to 58% of DB2 write operations with IBM zHyperWrite and 16Gb links – technology for DS8000 and z/OS for Metro Mirror environment
� First system to use a standards based approach for enabling Forward Error Correction for a complete end to end solution
� zHPF Extended Distance II provides multi-site configurations with up to 50% I/O service time improvement when writing data remotely which can benefit HyperSwap
� FICON Dynamic Routing uses Brocade EBR or CISCO OxID routing across cascaded FICON directors
� Clients with multi-site configurations can expect I/O service time improvement when writing data remotely which can benefit GDPS or TPC-R HyperSwap
� Extend z/OS workload management policies into FICON fabricto manage the network congestion
� New Easy Tier API removes requirement from application/administrator to manage hardware resources
z13 / DS8000 Intelligent and Resilient IO
26
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
zHyperWrite
� DB2 performs dual, parallel Log writes with DS8870 Metro Mirror
– Avoids latency overhead of storage based synchronous mirroring
• Improved Log throughput
• Reduced DB2 log write response time up to 43 percent
� Primary / Secondary HyperSwap enabled
– DB2 informs DFSMS to perform a dual log write and not use DS8870 Metro Mirroring if a full duplex Metro Mirror relationship exists
� Fully validated with GDPS and TPC-R
Client benefits
• Reduction in DB2 Log latency with parallel Log writes
• HyperSwap remains enabled
27
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
zHyperWrite Benefits
� DB2 Log write latency improved by up to 58%* with the combination of zHyperWrite and FICON Express16S
Client benefits
• Gain better end user visible transactional response time
• Provide additional headroom for growth within the same hardware footprint
• Defer when additional DB2 data sharing members are needed for more throughput
• Avoid re-engineering applications to reduce log write rates
• Improve resilience over workload spikes
Client Financial Transaction Test
-43% -43%
* With {HyperWrite, z13, 16 Gbs HBA DS8870 and FICON Express16S} vs {EC12, 8 Gbs DS8870 HBA and FICON Express8S}
0.000 0.100 0.200 0.300 0.400 0.500 0.600 0.700 0.800 0.900
zEC12 FEx8S zHPF Write 8Gb HBA
z13 FEx8S zHPF Write 8Gb HBA
z13 FEx16S zHPF Write 8Gb HBA
z13 FEx16S zHPF Write 16Gb HBA
PEND CONN
-23%
-14%
-15%
FICON Express16s
28
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DA
Session feedback
• Please submit your feedback at
http://conferences.gse.org.uk/2015/feedback/DA
• Session is DA
29