© 2014 ibm corporation sds05 - performance optimization is easy with ibm easy tier brian f. sherman...

43
© 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

Upload: laurence-garrison

Post on 11-Jan-2016

217 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

sDS05 - Performance Optimization is Easy with IBM Easy Tier

Brian F. Sherman – Distinguished Engineer

19 May 2014

Page 2: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Accelerate with ATS Storage Webinars

The Free IBM Storage Technical Webinar Series Continues in 2014...

ATS Technical Experts cover a variety of Storage topics

Audience: Clients who are either currently have IBM Storage products or considering acquiring IBM Storage products. Business Partners and IBMers are also welcome.

How to sign up?

To automatically receive announcements of the Accelerate with ATS Storage webinar series, Clients, Business Partners or IBMers can send an email to [email protected]

Information, schedules, and archives:

Located in the Accelerate with ATS Blog:

https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en

Upcoming webinars:May 28th 12:00 ET/9:00 PT Accelerate with ATS: OpenStack - Storage in the Open Cloud Ecosystem

June 10th 12:00 ET/9:00 PT Accelerate with ATS: Linear Tape File System Enterprise Edition (LTFS EE)

June 26th 12:00 ET/9:00 PT Accelerate with ATS: DS8000 Announcement Update

2

Page 3: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier - Introduction

Easy Tier provides automatic and manual volume management capabilities– Automated sub-volume/LUN drive tiering (DS8000/SVC/Storwize family)– Automated drive performance and capacity utilization balancing to remove hot spots or populate

new, empty ranks (DS8000 and SVC/Storwize R7.3+)• Prior to R7.3, SVC/Storwize family required manual rebalance script for capacity changes

– Manual command based volume relocation and pinning to specific tiers • SVC/Storwize family have always had these capabilities• DS8000 provides volume pinning with R7.1

Easy Tier interfaces– A command line interface and a GUI for setup and management– Storage Tier Advisor Tool (STAT) for I/O analysis and projected benefits– Support for all server platforms with no additional software or host configuration

Easy Tier feature– DS8700 / DS8800 / DS8870

• No charge licensed advanced function feature• Have to order the feature and activate the license• DS8870 default is to include Easy Tier feature vs. DS8800 have to specifically select it

– SVC / Storwize family• No charge and no license is required (included in base code for SVC/V7000/FlexSystem V7000) prior to R7.3• Optional licensed feature on V3700/V5000 and with R7.3 for V7000• Storage Pool Balancing available on all platforms without a license and is enabled by default

3

Page 4: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier Tiering – Basic Operations

Monitors and collects real time performance of each extent to determine how busy (heat) each extent is

– SVC/Storwize extent size on can be 16MB-8GB with default of 1GB (R7.1+ - previous default of 256MB)

– DS8000 extent size is 1GB

– Only small I/O is considered when prioritizing extents to be moved to Flash/SSDs

• Read and write I/Os 64K and greater are considered sequential

– Batch and sequential workloads do not interfere with Easy Tier performance optimization

– Easy Tier can move large IO to different HDD tiers to optimize sequential throughput

– Performance data continually collected every 5 minutes

Migration plan for optimal data placement is generated based on approximately 24 hours of gathered performance statistics

– Cost of the data movement is considered when performing and migrating data leveraging daily/weekly data

• Cost/benefit analysis to only move data for noticeable benefit

• Objective is to use resources to optimize client workload performance and not constantly just moving data

– Movement of extents is scheduled

• Limited number of extents are chosen

– SVC/Storwize up to 2TB/day

– DS8000 up to 10TB/day

• Migration continually occurs throughout the next 24 hours according to the established migration plan

• Warm demote keeps Flash/SSD from becoming overloaded and is independent of the migration plan

4

Page 5: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

SAS/NL-SAS Flash/SSD

DPAIOM DMP DM

The I/O Monitor captures access patterns and generates usage statistics sending them to

the Data Placement Advisor

The Data Placement Advisor identifies hot extents and outputs potential data migrations

to the Data Migration Planner

The Data Migration Planner performs analysis to deliver recommended data

migration plan to the Data Migrator based on the physical storage characteristics

Data Migrator confirms and schedules data migration activity based on the data migration

plan using built in function to seamlessly relocate the data to higher performing storage

without any application interruption

A “hot extent” exists on a HDD when an application makes frequent use of the same

area or extent of a volume

Virtualization LayerVolume

Easy Tier Code

Example:Two-tier Storage Pool

Easy Tier - Process

5

Page 6: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier – Automated Data Relocation Improves Performance

Improve performance up to 3x with as little as 3-10% Flash/SSD

Flash/SSD Array

SAS Array10K/15K HDD

Hot ExtentsMigrate Up

Cold ExtentsMigrate Down

Logical Volume

6

NL-SAS Array7200 HDD

Hot ExtentsMigrate Up

Cold ExtentsMigrate Down

Page 7: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier Terminology - Heat and Skew

Hot data– Hot data is simply extents that have more I/O workload, relatively

speaking, when compared to other extents within the pool and tier

Cold data– Cold data either has low (or no) I/O workload. Cold data would not

benefit from a higher tier and thus is not promoted and is considered for demotion

Warm data– Warm data is the rest of the workload that is not considered hot or

cold. Warm data could be promoted – but that would depend on the workload level and available resources

– Hot and Warm data will reside on Flash/SSD to maximize capacity

Skew– Highly skewed workload has a small number of hot extents – Low skewed workload has a more even distribution of workload to

extents

Skew

7

Page 8: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Continuous Easy Tier Evolution

Easy Tier 1 (DS8700 R5.1 and SVC/Storwize prior to R7.3)– Automated cross-tier performance management for SSD/HDD hybrid pools– Manual mode management support for dynamic extent pool merge and dynamic volume relocation (DS8000)

Easy Tier 2 (DS8700/DS8800 R6.1)– Automated cross-tier performance or storage economics management for

hybrid pools with any 2 tiers (SSD/ENT, SSD/NL or ENT/NL) – Automated intra-tier performance management (auto-rebalance)

in hybrid pools – Manual mode management support for rank depopulation and optimized volume restriping within non-managed pools (manual

volume rebalance)

Easy Tier 3 (DS8700/DS8800 R6.2 and SVC/Storwize R7.3)– Automated cross-tier performance and storage economics management for hybrid pools with 3 tiers (SSD/ENT/NL) – Automated intra-tier performance management in both hybrid (multi-tier) as well as homogenous (single tier) pools (auto-rebalance)– Thin Provisioning support for Extent Space Efficient (ESE) Volumes (DS8000)

Easy Tier 4 (DS8800 R6.3 / DS8870 R7.0)– Support for encryption capable environments

• DS8800 and DS8870 have FDE capable SSD and nearline drives

Easy Tier 5 (DS8870 R7.1)– Server– Application– Heat map transfer

Usability improvements in DS8870 R7.2 and SVC/Storwize R7.3 Easy Tier 6 (DS8870 R7.3)

– Optimization of DS8870 Flash

8

Page 9: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier - Extent Migration TypesDS8000 R6.2+ and SVC / Storwize R7.3+

9

Promote / Swap– Move hot data to higher performing tiers

Warm Demote– Prevent performance overload of a tier by

demoting warm extent to the lower tier– Triggered when bandwidth or IOPS thresholds are

exceeded

Cold Demote• Identify coldest data and move it to lower HDD tier

Expanded Cold Demote– Demotes appropriate sequential workload to the

Nearline tier to better utilize NL tier bandwidth

Auto-Rebalance / Storage Pool Balancing– Re-distribute extents within a tier to balance

utilization across ranks for maximum performance and capacity

– Move and swap capability

SSD RANK 1

SSD RANK 2

…SSD

RANK n

WarmDemotePromote

HighestPerformance

Tier

Swap

Auto Rebalance

Auto Rebalance

Migrations happen

between adjacent tiers

Migrations happen

between adjacent tiers

ENT

NL SAS

Flash/SSD

ExpandedCold Demote

Page 10: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation10

Auto rebalance applies to Single or Multi-tier Pools

Flash / SSD orEnterprise Disk or Nearline Disk

2

1

3

Extents migrated to balance workload across ranks – Performance and

Capacity balancing

Array 1 Array 2 Array 3

Easy Tier – Intra-tier Auto Rebalance / Storage Pool BalancingDS8000 R6.2+ and SVC / Storwize R7.3+

Extents moved between array/ranks of the same tier to balance workload

Balances IO skew and capacity utilization– Workload performance– Additional capacity added to the Pool

Proactively avoids hot spots

Eliminates need to manually re-stripe extents

Performance rebalance begins after 6 hours by default

– Adding capacity triggers Auto Rebalance to start within minutes

Enabled by default on SVC / Storwize– Do not need an Easy Tier license on any

Storwize system to utilize Storage Pool Balancing

Page 11: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier – Automatic Mode

Extent Migration Plan built based on I/O statistics collected (heat)

Dynamically relocates a logical volume’s extents– Hot/warm extents relocated to higher performance class of disk (NL SAS

-> Enterprise Flash/SSD)– Cold extents relocated to lower performance class of disk (Flash/SSD ->

Enterprise NL SAS)

Extent level promotion/demotion requires mixed technologies in a merged extent pool (between any two or three tiers), for example:

– Flash/SSD + Enterprise + NL SAS– Flash/SSD + NL SAS or– Enterprise + NL SAS

DS8000 Extent Size– 1GB for FB– 3390 Mod 1 (0.94 GB) for CKD

11

Page 12: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier – Manual Mode

Easy Tier Manual Mode allows a user to perform the following actions:– Dynamic Volume Migration

• User can change a logical volume’s storage technology by dynamically relocating between extent pools

• User can change a logical volume’s extent allocation algorithm (EAM) (e.g. can re-rotate extents within the target extent pool)

– Dynamic Extent Pool Merge• User can merge two existing extent pools without moving data

– Consolidate extent pools with equivalent disks

– Merge extent pools with to create a mixed technology extent pool for Automatic Mode

– Rank Depopulation• Storage Administrator can ask that a rank be removed from an extent pool• Automatic, non-disruptive and transparent to host access, the used extents will be

reallocated to other ranks in the pool and rank freed– Manual Volume Rebalance

• Redistributes a volume’s extents within a non-managed single-tier pool• Same pool and can change EAM

12

Page 13: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier 5 - Easy Tier Server Overview

IBM POWER AIX / DS8000 integration

Easy Tier Server is an architecture: – A Host flash-cache based on IBM research technology

using IBM flash hardware (Easy Tier Caching Client) – Easy Tier based algorithms for automatic application

aware system-wide optimization (Easy Tier / Easy Tier Caching Server)

– A proprietary protocol provides in band (SAN) communication and coherency

Hosts (Caching Clients)– Work independently to cache their applications IO

streams providing real-time performance enhancement– Use the Cooperative Caching protocol to have

cooperative system-aware caching that interfaces with IBM Storage running the Cooperative Caching Server

13

HostCaching

Client

IBM Server IBM Server

HostCaching

Client

Easy Tier

Caching Server

DS8870

Flash Cache

SANSAN

Flash Cache

SSDHDD

Page 14: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier 5 – Easy Tier Application

Easy TierEasy TierApplicationApplication

Data PlacementData Placement

Easy TierEasy TierApplicationApplication

Data PlacementData Placement

Databases and ISV solutions will be able to provide performance tips to Easy Tier

– Will guide what, when, where and how data is placed across the server and storage systems dynamically

Enables Administrators to direct data

placement based on business

knowledge and application knowledge– Provide volume level pin / unpin capability– Tier placement

15

Page 15: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Technology Prototype Demonstration: zEC12 + DB2 for z/OS + DS8000 Directive Data Placement

Use CaseDB2 for z/OS integration of Directive Data Placement capability in REORG Demonstrate DB2 is able to control the data placement of a Shadow data set based on

the storage tier of a REORG Target data setCustomer Value: Performance Assurance On Demand Just-In-Time Data Placement

– Based on unique knowledge about data processing task and data classification, application can timely choose data placement decision

– Easy Tier function continues to manage the rest of data placement decisions in a coordinated fashion

Storage Performance Assurance– Ensure a newly created Shadow dataset is placed at the same tier as the existing target dataset

during a typical database operation such as REORG– Assure new dataset is performance optimized immediately after the reorganization

Demonstration Execution Apply special DB2 utility, DFSMS, and storage prototype support in demonstration

environment Perform DB2 for z/OS REORG Confirm the storage tier assigned for a newly reorganized data matches original data

storage tier

16

Page 16: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier 5 - Heat Map Transfer

WorkloadWorkloadHotspotHotspotAnalysisAnalysis

WorkloadWorkloadHotspotHotspotAnalysisAnalysis

MM/GC/GM ReplicationMM/GC/GM ReplicationMM/GC/GM ReplicationMM/GC/GM Replication

17

Page 17: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier 5 - Heat Map Transfer Learning

Primary site:– Optimize the storage allocation according to the customer workload– Save the learning data– Transfer the learning data from the Primary site to the Secondary site

Secondary site: – Without learning, only optimize the storage allocation according to the Replication work load – With learning, Easy Tier can apply the checkpoint learning data from the primary site– Following Primary storage data placement to optimize for the customer workload

Heat Map Transfer Utility– Available on

• Windows• SLES11+/RHEL4+

– TPC-R and GDPS supported• TPC 5.1.1+• SPE for GDPS3.10 for CKD• Included in GDPS3.11 for FB and CKD

18

PRIMARY SECONDARY

Remote Mirroring(MM, GM, GC)

Page 18: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 Easy Tier - Enabling

License– Order Easy Tier feature code #7083

– Download license key from DSFA and apply it to the DS8000https://www-03.ibm.com/storage/dsfa/ds8000/selectMachine.wss

Enable Easy Tier – Storage Image Properties (DS GUI)

– chsi –Etautomode all | tiered | none storage_image_id• Auto Mode

› all Automatically manage all single and multi-tier pools› tiered Automatically manage multi-tier pools only› none Do not automatically manage any pools

– chsi –Etmonitor all | automode | none storage_image_id• Monitor

› Automode Only volumes managed by Easytier auto mode are monitored› all All volumes in the system are monitored › none No volume is monitored.

19

Page 19: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Flash / SSD Technology in DS8870

Up to 384 SSDs on DS8870– Recommended minimum of 16 SSDs– 200/400/800GB SSDs – Utilizes existing 2.5” enclosures

Hybrid DS8870– 1 to 4 1U High Performance Flash Enclosures in base (A) frame

• Up to 30 400GB eMLC encryption capable Flash Cards• Up to 9.2TB usable RAID 5 per enclosure

– Supports up to 120 Flash cards + 1536 2.5” HDDs – Easy Tier Auto Rebalance will distribute the workload among

traditional SSDs and Flash Enclosure according to their IOPS capacity

All Flash DS8870– 1 to 8 1U High Performance Flash Enclosures in base (A) frame

• Up to 30 400GB eMLC encryption capable Flash Cards• Up to 9.2TB usable RAID 5 per enclosure

› Up to 73TB usable in all Flash DS8870– Supports up to 240 Flash cards

20

Page 20: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Flash / SSD Technology in SVC / V7000

SVC optimizes scalable FlashSystem family or traditional SSD – FlashSystem 840 provides 4TB – 40TB usable RAID5

• Integrated bundle available as IBM FlashSystem V840

– Traditional SSD with CG8: Up to 4 SSDs per node• Up to 8 nodes for a maximum capacity of 32 SSDs• RAID level options are 0,1,10 only

– Traditional SSD with DH8: Up to 48 SSDs per node pair• Up to 2 Expansion enclosures per IO Group• RAID level options are 0, 1, 5, 6, 10

Storwize V7000 / FlashSystem family– FlashSystem 840 provides 4TB – 40TB usable RAID5– Previous V7000: supports up to 240 drives per I/O Group (up to 960 in a cluster)

• Plan for maximum capacity of around 24-32 SSDs (depending on workload)

– New V7000 with R7.3: supports up to 504 drives per I/O Group (up to 1056 in a cluster)• Plan for maximum capacity of around 48-64 SSDs (depending on workload)• First 24 drives in the Control Enclosure are on a dedicated SAS chain. Ensure remaining drives in Expansion

Enclosures are split across the two other SAS chains for optimal SSD performance• 200/400/800GB option• RAID level options are 0,1,5,6,10

21

Page 21: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Update on SVC prefetch

SVC has a prefetch algorithm to improve cache hit ratios especially for sequential workloads

With some real world client workloads this algorithm can result in excessive prefetch with significantly higher MB/s from the backend than is read by the host

Especially with Flash or Enterprise disk subsystems behind SVC it can be better to rely on the backend storage and to disable SVC prefetch

– Available with 6.4.1.3 and later using the chsystem command

• Only use at direction of SVC support

– R7.3 cache changes address prefetch concern

0

100

200

300

400

500

600

700

00:0

0:00

02:0

0:00

04:0

0:00

06:0

0:00

08:0

0:00

10:0

0:00

12:0

0:00

14:0

0:00

16:0

0:00

18:0

0:00

20:0

0:00

22:0

0:00

00:0

0:00

02:0

0:00

04:0

0:00

06:0

0:00

08:0

0:00

10:0

0:00

12:0

0:00

14:0

0:00

16:0

0:00

18:0

0:00

20:0

0:00

22:0

0:00

Time

MB

/s

0

0.5

1

1.5

2

2.5

3

3.5

Rat

io

Read Data Rate Write Data Rate Backend Read Data Rate Backend Write Data Rate Backend to Frontend ratio

22

Page 22: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

SVC and DS8000 - Easy Tier Deployment Scenarios

With SVC R7.3, use Easy Tier at the SVC level as the default in these scenarios:

– Utilize DS8000 Flash, FlashSystem or new enclosures with DH8/R7.3 as they can benefit multiple SVC storage pools

– Requirement to pin a VDisk to a specific tier– Able to exploit three tier and auto rebalance– Plan on utilizing SVC Compression

Use Easy Tier on DS8000 in these scenarios:– zOS and IBM i environments– Requirement for Easy Tier Application, Easy Tier Server, Heat Map

transfer capability– SVC environments prior to R7.3

You must have free extents for Easy Tier to function– For DS8000, plan on approximately 10 free extents per rank in the pool– For SVC/Storwize, plan on a minimum of 10 free extents per MDisk

Use Easy Tier on SVC R7.3 for all other configuration implementations

– This is likely the most popular choice once at SVC R7.323

Page 23: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

0

10

20

30

40

50

60

70

80

90

100

0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Percent of extents

Per

cen

t o

f w

ork

load

Percent of small Ios Percent of MB

Workload skew drives Easy Tier benefits

50% of the extents do 10% of the MB and virtually no random

IOPS!

58% of the random IOPS and 33% of the MB from about 5% of

the extents!

24

Page 24: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Drive Selection in an Easy Tier Environment

10-20% Flash/SSD, 80-90% Enterprise– Provides performance similar to Flash/SSD only solution at

significantly reduced costs– All data guaranteed to have at least enterprise

performance

3-5% Flash/SSD, 95-97% Enterprise – Provides improved performance compared to single tier

solution– Removes requirement for over provisioning for high access

density environments– All data guaranteed to have at least enterprise

performance

3-5% Flash/SSD, 25-53% Enterprise, 40-70% NL SAS– Provides improved performance and density to a single tier

solution– Significant reduction in environmental costs

20-50% Enterprise, 50-80% NL SAS– Provides reduced costs and comparable performance to a

single tier Enterprise solution

25

Nearline

Enterprise

SSD

FlashSystem family

Page 25: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

SVC / V7000 Easy Tier Implementation

Prior to R7.3, Easy Tier supported two tiers:– Generic SSD which is tier 0– Generic HDD which is tier 1

With R7.3, Easy Tier supports any three tiers and Storage Pool Balancing

By default if multiple tiers of storage are present in a storage pool then Volumes in that pool will be measured and managed

External MDisk performance setting defaulted by controller type– New setting - easy_tier_load for external MDisks displays the expected

performance capability of the MDisk within its particular tier26

Tier 0 Tier 1 Tier2

SSD Enterprise Nearline

SSD Enterprise ---

SSD Nearline ---

--- Enterprise Nearline

SSD --- ---

--- Enterprise ---

--- --- Nearline

Page 26: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

V7000 Tier Selection for Internal Flash

By default, a Storage Pool with two or three tiers will be Easy Tier Active. Easy Tier can be disabled using CLI

– svctask chmdiskgrp –easytier off <Storage Pool/MDisk Group ID or name>

• Auto, on, off and measure supported settings

• With R7.3, On is the default and activates Storage Pool Balancing in single tier pool

27

Page 27: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

SVC/V7000 Easy Tier Operational Considerations

Volume can have Easy Tier set to on/off/measure (default is on)– Image and Sequential Volumes can be measured but not managed by Easy Tier

Pool can have Easy Tier set to on/auto/off/measure (default is auto) External MDisk performance control

– Low, medium, high, very high

– Set by default based on type of external controller and can be changed via CLI

Easy Tier is supported for FlashCopy source and target and Metro or Global Mirror primary and secondary Volumes

– MM or GM secondary Volumes do not inherit characteristics of primary

• Example: If secondary becomes primary and usage changes the Easy Tier will have to adjust the extents over time to accommodate the new access patterns

Easy Tier is supported for Thin Provisioned Volumes– Only the real storage will be subject to management

Easy Tier manages extents of Compressed Volumes with R7.1+ Volume migrate

– Management of the Volume will be disabled during a migration

– Measurement of the Volume will reflect the status of the source storage pool until the migration completes

28

Page 28: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier on Compressed Volumes

Previously support for Easy Tier with compression volumes was disabled– Compression I/O looked random to Easy Tier and this prevented Easy Tier being able to

detect hot extents• The IOs generated by compression are never greater than 32 kb. Therefore all IOs seen by

Easy Tier are “hot” IOs

Resolved by adding extra metadata to internal I/O to give Easy Tier hints as to source I/O size, allowing Easy Tier to work correctly

Easy Tier for compressed volumes will not count write IOs – only reads

Support enabled in R7.1+

29

Page 29: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Thin Provisioning and Easy Tier on SVC/V7000

Thin Provisioned Volumes in Storage Pools using EasyTier must use a grain size of 64 KB or greater

– If grain size is default of 32K then all I/Os to TP volumes will be considered by ET algorithms since even large sequential I/Os from host will be broken up into 32K I/Os resulting in odd ET behaviour and performance issues

– See flash for more details • http://www-01.ibm.com/support/docview.wss?uid=ssg1S1003982

R6.4 changed default grain size of a Thin Provisioned Volume to 256KB rather than 32KB

30

Page 30: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier – Supported Environment and Restrictions

Supported in SVC R6.1+, SVC R7.3, DS8700 R5.1+, DS8800 R6.1+ and DS8870 R7.0+

Can merge any two extent pools on DS8000 except:– Both must be same extent type (CKD or Fixed Block)– At most, one of two extent pools can have a space efficient repository– At most, one of one of two extent pools can have virtual capacity– Not allowed if one extent pool is homogeneous with Flash/SSD disks and additionally has

space efficient repository or virtual capacity configured

You must have free extents for Easy Tier to function– For DS8000, plan on having approximately 10 free extents per rank in the pool

– For SVC/Storwize, plan on 10 free extents per MDisk

31 31

Page 31: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier – Modeling Tools

Storage Tier Advisor Tool (STAT)– Extracts heat data collected by Easy Tier for volumes that are being monitored

Disk Magic– Supports 5 predefined skew levels for prediction with Easy Tier– Can utilize detailed Easy Tier data to generate actual client skew chart– Tiered Solution Advisor available in V9.12.1 (open) / 9.13.0 (zOS and IBM i) – Utilizes either predefined or actual skew to predict the number of I/Os

• Higher skew results in a more aggressive sizing

FLASHDA (z/OS only)– Identifies what datasets and devices have the highest accumulated read-only disconnect

time

IBM Tivoli Storage Productivity Center (TPC)

32

Page 32: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Storage Tier Advisor Tool (STAT)

System Summary Report– Support pool configurations with up 3 tiers (Flash/SSD – ENT – NL SAS) – Tier status: Existing Tier Flash/SSD-ENT-NL SAS is IOPS/BW overloaded/skewed

Storage Pool Performance Statistics and Improvement Recommendation– Existing Tier Status showing rank utilization for each tier– Recommended Flash/SSD, Enterprise, NL Configurations

• Expanding 1-tier HDD and any 2-tier configurations to 3-tier configurations• Expanding existing tiers when tiers are BW or IOPS overloaded

– Volume Heat Distribution• Showing capacity and heat distribution by tier (hot data - warm data - cold data)

Systemwide Recommendation– Recommended Flash/SSD Configuration– Recommended Enterprise Configuration– Recommended NL SAS Configuration

33

Download STAT (no charge) and run on Windows https://www-304.ibm.com/support/docview.wss?uid=ssg1S4000876&wv=1

Page 33: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 STAT – System Summary

34

System Summary– Pools/volumes monitored– How much hot capacity– Current configuration of the pools

• Flash/SSD, Enterprise, NL or any combination– Tier Status

• IOPS overloaded, BW overloaded – Data Management Status

Page 34: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

SVC/Storwize R7.3 STAT: System Summary

35

System Summary– Pools/volumes monitored– How much hot capacity– Current configuration of the pools

• Flash/SSD, Enterprise, NL or any combination– Tier Status

• IOPS overloaded, BW overloaded

Page 35: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 STAT - Intra-tier Rebalance

36

Intra-tier Status– Ranks monitored for IOPS

• Current IOPS, utilization of the rank and projected

Page 36: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier Workload CategorizationNew workload visuals help clients compare activity across tiers within and across pools to help determine optimal drive mix for current workloads

Easy Tier Data Movement Daily Report New Easy Tier summary report every 24 hours illustrating data migration activity (5-min. intervals) can help visualize migration types and patterns for current workloads

Easy Tier Workload Skew CurveShows skew of all workloads across the system in a graph to help clients visualize and accurately tier configurations when adding capacity or a new system

Clients can import data into Disk Magic

Page 37

Intuitive Easy Tier reporting Simplifies Storage AdministrationDS8000 R7.2 and SVC / Storwize R7.3

37

Page 37: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

DS8000 STAT - Performance Improvements

STAT provides estimated performance improvements for adding different amounts of solid state drives

This figure is related to the backend latency for both read and write IOs

– It does not translate directly into a host performance improvement

It is based on the skew of the workload and a set of simple assumptions regarding the response time improvement of Flash/SSDs

It is based on the 24 hour workload not any particular interval

This figure can be useful to get a feeling for effective Easy Tier could be but needs to be considered with other information such as cache hit ratios, sequential percentages during batch etc.

38

Page 38: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

SVC/Storwize R7.3 STAT- Performance Improvement Recommendation

Focus on response time improvement Give suggestions how many hot data should be migrated to Flash/SSD tier

and how many new Flash/SSD MDisks should be added

39

Page 39: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation40

STAT – Volume Heat Distribution UpdatedDS8000 R6+ and SVC / Storwize R7.3

Page 40: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Easy Tier - Summary

Easy Tier operations– DS8000– SVC/Storwize family

IO Skew and drive selection guidelines

Storage Tier Advisor Tool

41

Page 41: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

IBM Systems Lab Services and Training

Deep skills driving client satisfaction and technicaleffectiveness for smarter computing

IBM Systems Lab Services and Training infuses intelligence into howglobal information technology works. is composed of experts who develop and deploy solutions across IBM’s systems family offerings.From in-depth product expertise, to training, to platform-specific hardware and software solutions, we’re here for you!

IBM Systems Training

IT infrastructure training that enables a Smarter Planet

IBM’s award-winning classes and industry-renowned technical eventshelps you fully exploit the power of your IBM technology investment.Our comprehensive portfolio of skills and career accelerators aredesigned to meet all your training needs – individual, departmentaland organizational.

Visit uswww.ibm.com/training Partnered with

IBM selected global training providers

click to explore our offerings

42

Page 42: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation

Thank YouThank You

43

Page 43: © 2014 IBM Corporation sDS05 - Performance Optimization is Easy with IBM Easy Tier Brian F. Sherman – Distinguished Engineer 19 May 2014

© 2014 IBM Corporation44

Trademarks and DisclaimersAdobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

© IBM Corporation 2014. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

ZSP03490-USEN-00ZSP03490-USEN-00