ibm ds8880: world-class data systems made for the future of business brian sherman ibm distinguished...

IBM DS8880: World-class data systems made for the future of business

Brian Sherman

IBM Distinguished Engineer

[email protected]

| 2IBM Systems

IBM Commitment to Storage - Investment

Cloud – $1.2 Billion Investment to expand Global Cloud FootprintJanuary 2014

HybridArrays

8% 2014-18 CAGR

Cloud and SDS – IBM acquisition of CleversafeNovember 2015

SW DefinedInfrastructure

25% 2013-18 CAGR

Software Defined Storage - $1 Billion Investment to develop Next-generation technology in SDSFebruary 2015

SW DefinedStorage

>20% 2014-18 CAGR

All Flash Arrays 12% 2015-19 CAGR

Flash – $1 Billion Investment in R&D April 2013

Integrated Infrastructure – IBM and Cisco Announce VersaStackDecember 2014

IntegratedInfrastructure

20% 2014-18 CAGR

IBM Systems | 3| 3

*Source: IDC Tracker 2014, 2015

Solutions Providers Recognize IBM as a Best-in-Class Channel Provider of Enterprise Network Storage

IBMFlashSystem Ranked #1

2015 All Flash Array**

IBM Ranked #1

2015Largest revenue share

for z Systems*

IBM Ranked #1 –

2015Largest revenue in

Branded TapeSystem*

IBM Ranked #2 –

2015Largest revenue in External Storage

Systems*

IBMRanked #1 -

2015 IDC Software

Defined StoragePlatforms*

IBMFlashSystem

Leader

2015 Gartner Magic Quadrant

Solid State

Arrays

** in both unit shipment and capacity shipped

IBM Storage – Industry Leadership

IBM Systems

IBM Systems | 4IBM Systems | 4

The world is changing; data is evolving…

growth expectedfor mobile-driventransactions through 20171

35%Transforming

how we act,

interact and

transact

“

” 63%of speed-driven analytics organizations created a significant positive impact on business outcomes2

1. Gartner Press Release, June 4, 20132. Analytics: The widening divide, IBM Institute for Business Value, 2011 3. IBM Market Intelligence, STG NDB Study n = 1,206, 2014

70%organizations have at least one cloud integration activity planned for 20153

IBM Systems | 5| 5

Integrated Solutions

Storage Systems

Tier 0 Acceleration FlashSystem family

Enterprise Storage Systems

XIV

Midrange and Entry Storage Systems

Tape and Virtual Tape Systems

Tape Library and Automation

Virtualization Engine TS7700

Tape drives for Enterprise and LTO7

ProtecTIERDeduplication

FlashSystem V9000

IBM Elastic Storage Server

Software Defined Storage

IBM Spectrum Control

IBM Spectrum Protect

IBM Spectrum Virtualize

IBM Spectrum Accelerate

IBM Spectrum Scale

IBM Spectrum Archive

VersaStack

Storwize V7000 Unified

V7000 Unified

V7000 Unified

V7000 Unified

V7000 Unified

Storwize V5000

Storwize V3700

Storwize V7000

PurePower

DS8000

Infrastructure Matters: IBM Storage Portfolio

| 6IBM Systems

Accelerate analytics and boost productivity with the new DS8880 family of hybrid data systems

IBM Servers and DS8880 Integrationz Systems, Power i and pAvailable years ahead of competitors

OLTP and Batch PerformanceHigh Performance FICON (zHPF) advantages and DB2 integrationCache efficiency and optimization algorithmsEasy Tier advancements and DB2 integrationQoS - IO Priority Manager (IOPM), FICON priority and Workload Manager (WLM)

Proven AvailabilityBuilt on POWER8 technology, fully non-disruptive operationsDesigned for highest levels of availability and data access protection

State-of-the-art Remote CopyLowest latency with Metro MirrorBest RPO and lowest bandwidth requirements with Global MirrorSuperior automated failover/failback with GDPS / Copy Services Manager (CSM)

Ease of UseCommon GUI across the IBM storage platformSimplified creation, assignment and management of volumes

Total Cost of OwnershipLonger hardware and software warrantiesBandwidth and infrastructure savings through Global Mirror (GM) and zHPF

Business Critical Storage for the World’s Most Demanding Clients

IBM Systems | 7| 7

IBM DS8880 family

World-class data systems made for the future of business

New!

| 8IBM Systems

Replication and Microcode Compatibility

2010

POWER6+

DS8800

DS8800

2004

POWER5

DS8100DS8300

DS8100DS8300

2009

POWER6

DS8700

DS8700

2006

POWER5+

DS8300 Turbo

DS8300 Turbo

2012

POWER7

DS8870 DS8870

2013

POWER7+

2015

POWER8

DS8870

DS8870

DS8880

DS8880

2014 Flash optimized

DS8000 Family – Seven Generations of Evolution


19” rack40 to 46U

The story of an architecture evolutionDS8300 DS8700 DS8800 DS8870 DS8880

Disk FC FC SAS SAS SAS

Power Bulk Bulk Bulk DC-UPS DC-UPS

CEC p5/p5 p6 p6 p7/p7+ p8

IO Bay RIOG PCIe-1 PCIe-1 PCIe-2 PCIe-3

Adapters 4Gb/2Gb 4Gb/2Gb 8Gb/8Gb 16Gb/8Gb 16Gb/8Gb

33” rack40U

Rack 33’’ 33’’ 33’’ 33’’ 19’’

| 10IBM Systems

DS8880 Family – R8.0 Announcement Announced Oct 20, 2015; General Availability Dec 04, 2015

IBM POWER8 based processorsDS8884 Model 980 and Model 98B Expansion UnitDS8886 Model 981 and Model 98E Expansion UnitPreview of DS8880 All Flash Array

Scalable system memory and scalable process cores in the controllers Repackaged rack power system for standard 19” rack Improved I/O bay interconnect using PCIe Gen3 Integrated Hardware management Console (HMC) Power VC integration with DS8880 (Open Stack Liberty based) IBM Cloud Manager support of zKVM Simplified licensing structure

Base functions licenseCopy Services (CS) licensez-Synergy Services (zsS) License

Business Critical Storage for the World’s Most Demanding Clients

IBM Systems | 11| 11

Layer 1: Up to 32 distributed PowerPC / ASIC Host Adapters (HA)

Manage the 8/16Gbps Fibre Channel host I/O protocol to servers and perform data replication to remote DS8000s

Layer 2: Centralized POWER8 Servers

Two symmetric multiprocessing processor (SMP) complexes performing concurrent operations, manage cache and advanced functions

Layer 3: Up to 16 distributed PowerPC / ASIC Device Adapters (DA); up to 8 dedicated Flash enclosures

DA’s manage the 8Gbps FC interfaces to internal HDD/SSD storage devices

Flash Enclosures leverage PCIe Gen3 for performance and latency of Flash cards

Both manage RAID protection and sparing

Up to 1TB cache Up to 1TB cache

DS8880 ‘Three Layer’ Architecture

IBM Systems | 12IBM Systems | 12| 12IBM Systems

DS8884 DS8886 DS8888

DS8884 - 980/98B

256 GB Cache

64 Ports

768 HDD/SSD + 120 flash cards

19” Rack

DS8886 - 981/98E

2X Performance

2 TB Cache

128 Ports

1536 HDD/SSD’s + 240 flash cards

19” Rack

DS8888 - All Flash Array

Industry’s Fastest T1 Subsystem

2 TB Cache

128 Ports

480 Flash Cards

19” Rack

IBM is introducing a family of business-critical hybrid data systems that span a wide range of price points. The family is powered by the next generation of IBM's proven DS8000 platform and delivers critical application acceleration, uncompromising availability and industry-leading capabilities

Introducing the new DS8880 family of data systems1H/2016


DS8880: Mission critical architecture

SSD/DDM Media Enclosure

High Performance Flash Enclosure

I/O Bay Enclosure

P8 Servers

DC-UPS

SSD/DDM Media Enclosure

High Performance Flash Enclosure

I/O Bay Enclosure

DC-UPS

Single or Dual HMC

Base Rack Expansion Rack


DS8884 Model 980/98B 12 cores Up to 256GB of system memory Maximum of 64 8/16Gb FCP/FICON ports Maximum 768 HDD/SSD drives Maximum 120 Flash Cards 19”, 40U rack

DS8886 Model 981/98E Up to 48 cores Up to 2TB of system memory Maximum of 128 8/16Gb FCP/FICON ports Maximum1536 HDD/SSD drives Maximum 240 Flash Cards 19”, 40U - 46U rack

All Flash DS8888 (Preview for 1H16 GA) Up to 96 cores Up to 2TB of system memory Maximum of 128 8/16Gb FCP/FICON ports Maximum 480 Flash Cards 19”, 40U rack

DS8880 Family – Built on POWER8


IBM DS8884 and DS8886 Platforms

DS8884Model 980

Expansion racks are 98BMaximum of 3 racks (base + 2 expansion)

19” 40U rackBased on Power 8

6 core processors at 3.891 GhzUp to 64 host adapter portsUp to 256 GB processor memory

Up to 768 drivesUp to 4 Flash enclosures – 120 Flash drives

2 Flash enclosures in base rack with 2 additional in first expansion rack

Option for 1 or 2 HMCs installed in base frameSingle phase power

DS8886Model 981

Expansion racks are 98EMaximum of 5 racks (base + 4 expansion)

19” 46U rack40U with a 6U top hat that is installed as part of the install

when requiredBased on Power 8

Options for 8 / 16 / 24 core processors at 3.525 or 3.891 GhzUp to 128 host adapter portsUp to 2 TB processor memory

Up to 1536 drivesUp to 8 Flash enclosures – 240 Flash drives

4 Flash enclosures in base rack with 4 additional in first expansion rack

Option for 1 or 2 HMCs installed in base frameSingle phase power


DS8880 Configuration Summary

Model Processor Cards per CEC

Processor Speed

Available Threads

System Memory

NVS Expansion Frame

Max DA Pairs / Max HA's

Max Flash / Max DDM’s SSD’s

DS8884 Model (R8.0)

980 1x6 core 3.891 GHz 24 64 4 0 2 / 8(32 ports) 60 / 240

980 1x6 core 3.891 GHz 24 128

256

8

16

0 to 2 4 / 16(64 ports) 120 / 768

DS8886 Model (R8.0)

981 1x8 core 3.891 GHz 32 128

256

8

16

0 4 / 16(64 ports) 120 / 192

981 2x8 core 3.891 GHz 64 256

512

16

32

0 to 4 8 / 32(128 ports) 240 / 1536

981 2x12 core 3.525 GHz 96 1024

2048

64

64

0 to 4 8 / 32(128 ports) 240 / 1536


Base 40U rack

Remove bolts to release top. Extend top up, one end at a time from 1U to 8U.

Add side panel/EIA rails and secure with bolts. Release extension corner posts and lock down.

Final asm with top extended. 41U to 46U

Adjustable top from 40U to 46U on DS8886 Model 981/98E

1 SSR adjustable - no heavy components

Top is never removed from rack

Extension to the front and rear door to cover added 6U

Can be added as MES w/o disruption

DS8880 Extendable top rack


IBM DS8880 IO bay

PCIe x8 Gen 3 I/O fabric4x IO Bay bandwidth

2 dedicated PCIe x8 connections on each IO bay for High Performance Flash Enclosure (HPFE)Frees up slots in the IO bay for Host Adapter usage

Up to 32*4-port 16Gb Host AdaptersMaximum of 128 16GB ports on DS8886Maximum of 64 16Gb ports on DS8884Same maximum of 128 ports with 8-port 8Gb Host AdapterCan mix 8Gb and 16Gb adapters in IO bay (maximum of 16 ports per IO bay)

HA

HA

DA

HA

HA

DA

HPFE HPFE

DS8884/DS8886 IO Bay Configuration

HA

HA

HP

FE

HA

HA

HP

FE

HPFE HPFE

DS8888 IO Bay Configuration


Keyboard/Display and HMC

New Mini HMC allows for 2 HMC’s to be integrated into base Rack.

Keyboard / display slide out from side of rack

Small HMC allows for 1 or 2 to be installed under DC-UPS

Configuration Options:DS8880 can support one or two HMCs in the base frame. Second HMC can be concurrently installed after initial install if desired. No cross coupling of HMCs allowed in DS8880


DS8880 Drive Technology Flash – 1.8” in High Performance Flash Enclosure

400 GB drive

SSD – 2.5” Small Form Factor Latest generation with higher sequential bandwidth 200/400/800/1600GB SSD

2.5” Enterprise Class 15K RPM Drive selection traditionally used for OLTP 300/600GB drives

2.5” Enterprise Class 10K RPM Large capacity, much faster than Nearline 600GB and 1.2TB drives

3.5” Nearline – 7200RPM Native SAS Extremely high density, direct SAS interface 4TB drives

Performance


DS8880 Encryption – Security for data at rest The DS8880 uses a special class of drives, known as Full Drive Encryption (FDE) to encrypt data at rest

Applies to HDD, SSD and Flash

Data is always encrypted on write to the drive and then decrypted on read. Data stored on the drive is encrypted

Drives do the encryption at full data rateNo impact to disk response times Uses AES 256 bit encryptionProtection for disk removal (repair, replace or stolen)Protection for disk subsystem removal (retired, replaced or stolen)

Requires authentication with key server before access to data is granted Key management is via IBM Security Key Lifecycle Manager (SKLM)


DS8880 Easy Tier - Optimizes performance and costs across tiers Easy Tier measures and manages activity

Every five minutes: up to 8 extents movedNew allocations placed initially on fastest HDD

Extent Pools can have mixed media1.Flash / Solid-State Drives (Flash / SSD)2.Enterprise HDD (15K and 10K RPM)3.Nearline HDD (7200 RPM)

As little as 3% Flash can dramatically reduce response times and increase IOPS

No charge, no additional software needed

Storage Tier Advisory Tool can estimate benefits of adding Flash before purchase!

Heat Map and IO density reports available

FLASH/SSD RAID Array

SAS RAID Array(s)

Nearline RAID Array(s)


Cache space efficiency with 4K segmentsSignificantly improved cache utilization per GB

SARC (Sequential Prefetching in Adaptive Replacement Cache)Self-learning algorithms

Adaptively and dynamically learn what data should be stored in cache

Improves cache hits by up to 100% and improve I/O response time by 25%

AMP – Adaptive Multi-Stream Pre-fetching Dynamically decides what/when to pre-fetch

Two-fold increase in RAID-5 array sequential read

IWC - Intelligent Write CachingBetter write cache management and de-stage order

Up to 2 x throughput for random write workloads

Cache

Experience has taught meShould I keep this data?What data is needed next by the Host?

050

100150

200250

300350

400450

Before AMP With AMP

Th

rou

gh

pu

t (M

B/s

ec)

6+P Raid-5

7+P Raid-5

DS8880 Caching Optimization – Delivering higher cache hit ratios


1.5x faster on z/OS: 1.6M IOPS

on z/OS OLTP

1.6x faster: 1.8M IOPs with sub-

millisecond response time on

Open OLTP

Multi-thread optimization helps

to scale with more

cores/threads

I/O Performance – CKD zHPF OLTP

IBM DS8880 Performance - OLTP


2x bandwidth for sequential

write workloads

1.9x bandwidth for

sequential read workloads

PCIe Gen 3 I/O fabric

increases bandwidth

DS8886 24 core

DS8886 16 core

DS8884 6 core

DS8870 16 core

DS8800 4 core

>2x Faster

DS8880 Performance – Sequential Write


Simplified licensing structureBase function (BF) LicenseCopy Services (CS) License z-synergy Services (zsS) License

Base function (BF) license: provides logical configuration support for distributed systems FBSingle license includes: Operating Environment License (OEL), Thin provisioning, Easy Tier, Database protection, Encryption Authorization, I/O Priority Manager License is equal or greater than total physical capacity of the storage system

Copy Services (CS) licenseSingle license includes: FlashCopy, Metro Mirror, Global Mirror, Global Copy, Metro Global Mirror, Multi-Target PPRC, z/Global Mirror (XRC) and z/Global Mirror ResyncLicense can be equal or less than the total physical capacity of the storage system

Z-synergy Services (zsS ) license: provides logical configuration support for CKD/z SystemsSingle license includes: FICON, z High Performance FICON (HPF), zHPF Extended Distance, zPAV, HyperPAV, zHyperWrite, FICON Dynamic Routing, Forward Error Correction, Read Diagnostic Parameters, zDDBLicense can be equal or less than the total physical capacity of the storage system

Simplified license structure with new Advanced License packages


Next generation user interface providing unified interface and workflow for IBM storage products

Enhanced functionality including System health status reporting Monitoring and alerting Logical configuration Performance monitoring and export ability Streamlined enabling of encryption

through the GUI

https://www.youtube.com/watch?v=5RS9IGbm9NI

https://www.ibm.com/developerworks/community/blogs/accelerate/entry/new_ds8000_storage_management_gui_february_26th_2015?lang=en

Goal is to have a DS8880 fully configured in under an hour

DS8880 Enhanced User Interface

https://www.youtube.com/watch?v=5RS9IGbm9NI

https://www.ibm.com/developerworks/community/blogs/accelerate/entry/new_ds8000_storage_management_gui_february_26th_2015?lang=en


Model Conversion from DS8870 to DS8886

• Move Disk Enclosure and HDD/SSDs

• Move Flash Enclosure and Flash Cards

• Move Device Adapters• Move Host Adapters

DS8870

DS8886

Model conversion is a disruptive activity. See IBM System Storage DS8880 Introduction and Planning Guide, GC27-8525


Servers Storage

IBM z Systems, POWER and DS8880 Integration

Joint IBM Storage and Server effort Design, Development, Test, SupportOnly IBM storage is positioned for earliest support of new IBM servers/OssFunction located where it makes the most sense

Beyond connectivity…

z Systems Hardware

z/OS (IOS, etc.), z/VM, Linux for z Systems

DFSMSdfp: Device Services, Media Manager, SDM

DFSMShsm, DFSMSdss

DB2, IMS, CICSGDPS

DS8880

POWER Hardware

Multi pathing / Easy Tier

AIX / IBM i

DB2

PowerHA

DS8880


Accelerate transactions with DS8880 zHyperWrite with z13 FICON Express16s by reducing DB2 commit times by 66% while improving scale and reducing costs

Enhanced resilience for FICON and FCP channels with Forward Error Correction (FEC) codes for 300x reduction in link errors

Improved application and middleware I/O performance for up to 32% reduction in batch elapsed times for I/O bound jobs

Self Healing, self tuning FICON channels with 58% improved reliability, fabric priority for deeper integration with WLM, FICON Dynamic Routing for up to 62.5% better throughput and 2x I/O rates

z13

zHPF FICON

DS8880

z Systems and Storage Leadership with DS8880Unparalleled Resilience and Performance for z Systems


HyperSwap / DB2 / DS8880 Integration – zHyperWrite

DB2 performs dual, parallel Log writes with DS8870/DS8880 Metro Mirror

Avoids latency overhead of storage based synchronous mirroring

Improved Log throughput

Reduced DB2 log write response time up to 66 percent

Primary / Secondary HyperSwap enabled

DB2 informs DFSMS to perform a dual log write and not use DS8880 Metro Mirroring if a full duplex Metro Mirror relationship exists

Client benefits

Fully integrated with GDPS and TPC-R

Reduction in DB2 Log latency with parallel Log writes

HyperSwap remains enabled


DB2 / Easy Tier Integration – Proactive notification on reorgs

Software Defined Storage API between z Systems and DS8880 Easy Tier Enables easy integration between application and storage system through new

API

Client benefits Allows DB2 to proactively instruct Easy Tier of application intended use of the

data Map application data usage to appropriate tier of storage

Removes requirement from application/administrator to manage hardware resources directly

Through the API, the application Hint will set the intent and EasyTier will move the data to the correct tier

Provides applications a direct way manage Easy Tier temperature of application datasets

z/OS

Media Manager

DB2


T10 DIF for AIX/Linux 16Gb HBA and DS8880

SANSAN

DATA DIF

DATA

DATA DIF

DATA DIF

DATA DIF CHK

Provides advanced, end-to-end data integrity for Power systems running AIX and Linux T10-DIF support available since DS8000 microcode R6.3.1

Enhanced support checks data integrity to and from the host bus adapter through the SAN fabric and the DS8000

The following option on the mkfbvol DSCLI command will create a T10-DIF format volume mkfbvol -dev storage_image_ID -extpool extentpool_ID … -t10dif volume_ID

T10-DIF volumes are created using the custom option with the GUI

Checking done by hardware and no performance impact**

** Note that even without T10 DIF the DS8000 still provides native internal end-to-end data integrity checking


HyperSwap Support by AIX - PowerHA HyperSwap coordination across hosts and sites

Planned or unplanned HyperSwapMulti host synchronizationTypical swap times less than few seconds

Consistency group management across DS8000 systems

HyperSwap support for critical system disksRootvg, paging and dump devices, Repository disk

Disk grouping supportGroups disks and establish consistency groups

Support for both AIX LVM and Raw disksDisk or VG preparationDisk Error handlingOracle can be deployed with LVM or ASM disks

Synchronous

Mirroring

Application

HyperSwap

Cluster

Primary DS8000

Site 1

Secondary DS8000

Site 2Legend:

Active Path

Passive Path

HA/DR

Brings together AIX, PowerHA and DS8000 to provide a comprehensive application and data availability solution


Capabilities in Liberty Cinder Driver (1.6.0) Create/Delete Volume Volume Attach/Detach (via Nova Compute) Snapshots, Clones (FlashCopy with background copy) Backups (Copy Volume Images to Object Store)

Swift, Ceph and TSM Support Volume Types, Volume Retype Quotas Consistency Groups for FlashCopy Volume Retype – Ability to change the type of an existing Cinder volume to a new

tier, add capabilities, etc. Volume Replication – Ability to do synchronous replication of cinder volumes

between two storage subsystems

DS8880 OpenStack Cinder – Capabilities

http://docs.openstack.org/liberty/config-reference/content/ibm-xiv-driver.html

Download and install the package available at: http://www.ibm.com/support/fixcentral/swg/selectFixes?parent=Enterprise%2BStorage%2BServers&product=ibm/Storage_Disk/XIV+Storage+System+%282810,+2812%29&release=All&platform=All&function=all

http://www.ibm.com/support/fixcentral/swg/selectFixes?parent=Enterprise+Storage+Servers&product=ibm/Storage_Disk/XIV+Storage+System+(2810,+2812)&release=All&platform=All&function=all

http://www.ibm.com/support/fixcentral/swg/selectFixes?parent=Enterprise+Storage+Servers&product=ibm/Storage_Disk/XIV+Storage+System+(2810,+2812)&release=All&platform=All&function=all


DS8880 REST API

Allows for web services to communicate, configure and control the DS8000 using industry standard HTTPControl plane applications, Mobile, custom software and more

Secure Authentication: HTTPS, ESSNI authentication

Ability to upgrade/extend REST API concurrently

Supported REST API constructs:System Information

Logical Configuration – Query, Create, Delete, Modify

Events with Notification support

Performance – IOPS, Latency


Out of Region

Site C

Metro / Global MirrorThree and four site cascaded and multi-target synchronous and asynchronous mirroring

FlashCopy

Point in time copy

Within the same

Storage System

Out of Region

Site B

Global Mirror

Asynchronous mirroring

Primary

Site A

Primary

Site A

Metro distance

Site B

Metro Mirror

Synchronous mirroring

Primary

Site A

Metro

Site B

DS8000 Copy Services fully integrated with GDPS and Copy Services Manager to provide simplified CA and DR operations

DS8880 Advanced Copy Services Capabilities


IBM DS8880 Family: Bulletproof hybrid data systems made for the future of business

Mission critical acceleration with 2x accelerated response time with next-generation design and enterprise-class flash

Uncompromising availability with greater than 6-9’s availability for 24x7 access to data and applications with bulletproof data systems and industry-leading capabilities

Unparalleled integration with z Systems to enable your systems for insight and cloud environments with unparalleled integration with IBM® z Systems™ and Power® servers

Transformational efficiency with streamlined operations and 30% reduction in floor space with next-generation data systems in a wide range of configurations


Do you need more information ? Contact us!

Brian Sherman

IBM Distinguish Engineer

[email protected]

Marisol Diaz

IBM Marketing Manager

[email protected]

www.ibm.com/DS8000

http://www.ibm.com/DS8000

Thank You!

ibm ds8880: world-class data systems made for the future of business brian sherman ibm distinguished...

Documents