emc disk library for mainframe - think global 1000-2000-6000... · remote replication compression...

EMC Disk Library for MainframeAugust 2012

1

1© Copyright 2012 EMC Corporation. All rights reserved.

EMC DISK LIBRARY

FOR MAINFRAME

A complete suite of solutions to meet any mainframe tape requirement

Carlo Dioos BRS EMEA TC [email protected]


EMC Mainframe Solutions in the News


2


Typical Mainframe Tape Challenges

• Performance of tape applications

• Service level agreements

• Batch and backup windows

• CPU consumption

• 100% disaster recovery compliance

• Lost or stolen tapes

• Operating costs (tapes, power, etc.)

• Data loss (multiple tapes)

• Personnel inefficiencies


EMC Disk Library For Mainframe (DLm)

Scalable Capacity13 TB – 4.0 PB

Storage EfficiencySupports Regular & Deduplication Storage

Flexible DeploymentSingle Solution For All Mainframe Tape Workloads

Including Backup, HSM, Archiving & Work Tapes

Simplified OperationsManaged From z/OS Console

Tape & DASD ConsistencyTape Data Consistency with DASD at primary and DR

site(s) with DLm8000 and SRDF/S

Tape Replacement For Mainframe Environments


3


DLm8000: Ultra-high ResiliencyEvolution of DLm for mainframe tape

March 2008DLm4020 & DLm4080 debut as “tapeless” MF tape & superior DR

June 2010DLm960 with Data Domain dedupe option

Aug. 2012DLm8000 Gen-3 based on EMC VMAX, SRDF, and Consistency Groups

Aug. 2011DLm6000 Gen-3 with massive scale, integrated dedupe and GR v3

Sept. 2009DLm120 & DLm960 Gen-2 with highly scalable storage and GR v2

1st Generation

2nd Generation

3rd Generation


Disk Library for Mainframe Components

� Virtual Tape Emulation Controller (VTEC)

– Emulates IBM 3480/3490/3590 tape drives

▪ 256 tape drives per VTE (DLm2000, DLm6000 & DLm8000)

▪ 32 or 128 per VTE (DLm1000)

▪ Stateless

– FICON connectivity

– Virtual cartridge size up to 16 TB

– HW compression per VTE engine

– Supports deduplication

– >=2VTE : HA, NDU

� Back-end storage

– Stores all tape images as files

– Shares all tape volumes among all VTEs

– Disk consumption is based on data written

– Supports Symmetrix VMAX storage

– Supports VNX NFS storage

– Supports Data Domain deduplication storage

– Supports VNX and DD concurrently (DLm6000 only)

VTE

VTE

VTE

VTE

VTE

VTE

EMC Disk Library

for mainframe

VTEC

Back-end

storage


4


EMC Mainframe VTL Architecture

Virtual Tape Engine

340 MB/s – 256 dev

(340 ) 680 - 2700 MB/s

Up to 2048 devices

Up to 2.5 PB usable disk

Up to 5.7 PB logical Dedupe

Mainframe

Web Console

Dedup and/or Non-dedup

backend storage

Tape on Disk

zOS Console

Virtual Tape Engine

340 MB/s – 256 dev

Virtual Tape Engine

340 MB/s – 256 dev

Virtual Tape Engine

340 MB/s – 256 dev

Virtual Tape Engine

340 MB/s – 256 dev

Virtual Tape Engine

340 MB/s – 256 dev

Virtual Tape Engine

340 MB/s – 256 dev

Virtual Tape Engine

340 MB/s – 256 dev


Remote Replication

� Compression or Deduplication

yields less data– Less bandwidth needed for

replication

� Reduce current tape RPO/RTO– From days to hours or minutes

� No performance penalty on

mainframe host

� Back-end storage replication– On DD, only changes are replicated

� Flexible replication

configurations– Prioritize data for replication

– Replicate to one or two sites

Multiple Remote Sites

Source

Target 1

Target 2

Single Remote Site

Source Target

WAN/IP

Bi-directionalreplication


5


Typical Mainframe Tape Solutions

IBM z/OS mainframe

Physical

tapeVirtual tape Deduplication

BACKUPHSM

MIGRATIONDATA

ARCHIVEWORKTAPES

Two or three different tape platforms (and code bases)

would be needed to satisfy the requirements of all use cases


EMC Mainframe Tape SolutionIBM z/OS mainframe

EMC satisfies the needs of all use cases in a

single, manageable solution

EMC Disk Library for mainframe

BACKUPHSM

MIGRATIONDATA

ARCHIVEWORKTAPES


6


VMware

Microsoft SQL

Microsoft Exchange

Application Server

IBM i (aka AS400)

Others...

Backup Clients Mainframe

z/OS ,

VM, VSE

Unisys OS2200

Archive

NAS, SAN, DAS

NetWorker

NetBackup

Backup Exec

Backup Application

Primary

Storage

(X)GbE

Archive

Apps

Protocol :

CIFS/NFS, DD-BOOST: Ethernet

VTL / Fibre Channel

FICON DLm

EMC Data Domain

Deduplication Storage

LAN

Data Domain

Replication

DLm1000

Data Domain Infrastructure and Ecosystem

FC

Dis

aste

r R

ecovery


Solution classes to meet recoverability requirements

Traditional

� Batch, HSM, Archive, Backup

� Traditional virtual tape environment

� Large SYSPLEX, multiple LPARs

� Guaranteed replication (sync)

Data Domain VNX VMAX

SME LRG Ent

Ultra

HAStandardDedupe

Ent

Backup

� Data dedupe for efficient storage utilization

� Mixed support for mainframe, IBM-i and open systems

� Incremental delta guaranteed replication (async)

Mission-Critical

� Critical operational tape data (HSM)

� Very short RTO

� Synchronous/Asynch replication

� Consistency between primary and tape data

� Automated recovery

Mainframe Tape Requirements

DLm1000, DLm6000 DLm2000, DLm6000 DLm8000


7


DLm8000 Value Propositions

• Single solution for all tape needs• Excellent performance

– Elimination of latencies with tape robotics, load and seek times

– Reduce batch windows

• Extremely reliable– “Tape” volumes inherit RAS characteristics of RAID disk

• Operation efficiencies– Eliminate tape handling and errors (lost tapes, etc.)

• Optimal for Disaster Recovery– SRDF/S and Guaranteed replication


DLm8000 Features

� Integrates Symmetrix VMAX

storage

� EMC Symmetrix Remote Data

Facility (SRDF/S) replication

� Consistency of tape data at

production and disaster

recovery sites

� Increased performance– Up to 2.7 GB/s throughput

� Increased scalability– Scales up to 6 PB of logical

capacity

� Enterprise manageability– EMC z/OS Storage Manager

(EzSM)

� z/OS console support

� Selective replication– Set replication at file system

level


8


EMC’s Mainframe Virtual Tape Solutions EMC Disk Library for mainframe

� Enterprise solution (DLm8000)

– Highest availability for critical tape

recovery

– Leverages Symmetrix VMAX storage

and SRDF/S replication

– Data consistency between production

and recovery sites

� Enterprise solution (DLm6000):

– Scalability and flexibility

– Both deduplication and

non-deduplication storage

� Commercial solution (DLm2000):

– Enterprise performance

– Primary storage only

� Gateway solution (DLm1000):

– Connecting Data Domain storage to the

mainframe

– Shared mainframe/open systems

IBM mainframe EMC DLm8000/6000/2000

EMC DLm1000

DLm1000


DLm6000 Features

� Integrates both VNX7500 and/or

DD890 storage systems

– In a single, manageable

platform

� Increased performance

– Up to 2 GB/s throughput

� Increased scalability

– Scales from 40 TB to 5.7 PB of

logical capacity


– Centralizes Disk Library for

mainframe operations at z/OS

console

� Selective replication

– Set replication at file system

level

� Support for RSA Data Protection

Manager

� Write once, read many (WORM)

tape

– Enterprise

– Compliance

� Enhanced guaranteed replication

– File remains mounted until file

data is replicated to target site


9


DLm2000 Features

� Integrates VNX storage systems

� Increased performance

– Up to 680 MB/s throughput

� Increased scalability

– Scales from 13 TB to

143 TB of usable capacity




console

� Selective replication

– Set replication at file system

level

� Write once, read many (WORM)

tape

– Enterprise

– Compliance

� Enhanced guaranteed replication

– File remains mounted until file

data is replicated to target site


DLm1000 Features

� Available in two models

– DLm1010 w/single FICON and

32 drives

– DLm1020 w/dual FICON and

128 drives

– Flexibility to meet specific

customer requirements

� Integrates with Data Domain

storage systems

– DD630, DD640, DD670, DD860,

DD880, DD890 or DD990

� Data Domain storage can be

shared with open system

servers, including IBM i




console

� Deduplication reduces storage

and replication costs

� Flexible RPO and RTO

� Supports z/OS, z/VM and z/VSE

operating systems


10


DLm Family

DLm8000 DLm6000 DLm2000 DLm1000

Number of VTEs 2 - 8 2 - 6 1 or 2 1/2

Connectivity FICON FICON FICON FICON

Number of channels to host 4-16 4-12 2 or 4 1/2

Number of virtual tape drives Up to 2,048 Up to 1,536 Up to 512 Up 32/128

Maximum capacity (usable non-dedupe) 56 TB -1.792 PB 40 TB -2.4 PB 14.5 TB – 159.5 TB

Depends on DD

Performance Up to 2.7 GB/s Up to 2.0 GB/s Up to 700 MB/s 174/340 MB/s

Deduplication storage N/A Yes – DD890 (2) N/A Yes – current DD

Deduplication capacity N/A Up to 5.7PB(a) N/A Up to 2.8(b)

Number of Cabinets 3-13 2-16 1 N/A

Replication Yes (SRDF) Yes Yes Yes

(a) – assuming a DD890 and 10:1 compression(b) – assuming a DD670 and 10:1 compression


Customer Validation (EMC World 2012)Measured 1 Year Later after Replicated DLm960 Implementation (same 30 day period)

Daily Backup

55% reduction in

clock time

27% reduction in CPU

usage

HSM Migrations


usage

9% more data

HSM Recalls

2,000 recalls per day

From 120 sec. to <1 sec.


usage

HSM Recycles

Migration Data

58% reduction in

CPU usage

38% reduction in

clock time

HSM Recycles

Backup Data


usage

41% reduction in

clock time


11


Why EMC Virtual Tape for Mainframe?

� Eliminates all issues related to traditional tape handling

– Eliminates manual intervention, physical movement of tape

cartridges, robotic issues, and single points of failure

� Works seamlessly with existing applications

– No Job Control Language (JCL) changes are required and works with

your existing tape management system

� Significantly improves performance

– Reallocates all of the data to disk and uses smart I/O buffering,

allowing potentially significant reductions in batch windows

� Extends disaster recovery capabilities to the tape workload

– Utilizes array-based replication process over IP to seamlessly move

tapes offsite

� Enhanced data protection with encryption and RSA Data

Protection Manager

– For data at rest or during transmission

� Easily scales as the workload increases

– Add throughput performance and storage capacity as needed


Technical Features

The following optional slides show the technical

detail of:• “WORM” tape

• RSA Data Protection Manager

• Guaranteed replication

• Mapping the DLm to the mainframe

• High performance

• High availability

• HSM migration

• Disaster recovery vaulting and testing

• Management reporting

• Professional services

• Support


12


WORM Tape

Enterprise

� Provides for retention periods per file

� Enables adherence to good business practices

– Tamper-proof clock

– Activity logging

Compliance

� Meets SEC Rule 17a-4(f) compliance requirements

– Prevents file system deletions with locked files

– “Hard” default retention periods

– Data verification to validate committed content

� Retention periods cannot be modified

� File systems can only be deleted when retention

period has expired

� Third-party compliance validation paper


RSA Key Management

� VTEs will always include the RSA client

� RSA Data Protection Manager requires a

separately licensed RSA server

� Individual drives will be configured for

encryption (as they are today)

� When a new tape is written to a drive

configured for encryption, a call to the RSA

Data Protection Manager is made

� The Data Protection Manager returns two

keys: a clear key and an encryption key

� RSA client uses the encryption key to store

the clear key on the volume

� Support for DLm6000 with VNX7500

storage only

RSA

Key Server

VTE

Access

Control Point

Corporate network

RSA Client with

Software Encryption

RSA Client with

Software Encryption

RSA Client with

Software Encryption

RSA Client with

Software Encryption


13


Guaranteed Replication

� DLm replication starts based on RPO

� Backup job starts

– Backing up 100 GB dataset (will create a 30 GB tape)

� Next DLm replication cycle starts based on

RPO

– Backup tape is being replicated

– First 25 GB of tape are replicated

� Backup job ends

– “Rewind unload” command is sent to the DLm

– DLm forces replication

– Last 5 GB of the backup tape are replicated

� Replication is complete

– Return control to the mainframe host to finish the

backup job

2:00 AM 2:12 AM 2:30 AM 2:35 AM 2:40 AM

Remote SiteProduction Site


R/W

MainframeDisk Library for mainframe

Production Site

Remote replication is uninterrupted

Testing the Disaster Recovery EnvironmentTwo ways to conduct disaster recovery testing from copy of production data

Mainframe

Remote Site

WAN/IP

Bi-directionalreplication

Disk Libraryfor mainframe

R/OR/W

Snapshots

• Disk arrays allow creation of “read-write” snapshot

• Confirm operation at the disaster recovery site

• Some incremental storage capacity required

Read-only mounts

• Disk arrays allow instant “read-only” copies

• Confirm that tapes can be mounted and all required data can be accessed

• No incremental storage capacity required


14


How DLm6000 Maps to Mainframe Host

� The mainframe host views Disk Library

for mainframe as tape drives

� Data for different use cases is directed to

the appropriate storage type

� Drives are managed as mainframe tape

libraries (MTLs) under System Managed

Storage (SMS)

� Tape administrator will map specific range

of tape drives to a specific VTE

� Each VTE can access any tape dataset in

the library

� Each tape VOLSER is kept on disk as a

file – No wasted media

IBM z/OS

mainframe

EMC DLm6000

VNX storage

Batch

HSM

Fixed content

Data Domain storage

Backup

Archive


Disk Library for mainframe

Physical tape

Batch processing

Disk Library for Mainframe Performance vs. Tape

Disk Library for mainframe

Mount Seek Stage

Time to first byte:

13 seconds

5 Sec 3 Sec5 Sec

Job completion

Batch processing at disk speed

Mount

Job completion

Provides…

� Faster time to first byte

– One second mount time on

average

� Faster batch processing

– Over 300 MB/s per VTE

– Up to six VTEs


15


• Tape mark locations

• 5 MB block boundaries

AWSTAPE

File name = Tape VOLSER

Tape image on disk

Improved Response Time

� Fast locate provides additional

performance benefits– Response times drop from 15–40 seconds to less

than one second on average

– Improves service level agreements

– Immediate major benefit to fixed content

applications such as:

▪ IBM ImagePlus

▪ ASG-ViewDirect

� When Disk Library for mainframe writes to

tape, it builds an index for fast locate– Index is stored at the end of the volume’s disk file

– Contains a pointer to:

▪ Each tape mark location

▪ Each 5 MB block boundary

– On read, the VTE can go directly to any tape mark

Index


No Single Point of Failure

� All VTEs can see all tape volumes

� If a VTE fails…

– Job will fail with tape error (same

as with regular tapes)

– Tape volumes are still available

through alternate VTE

– VTE does not contain metadata

� Disk drives are RAID 6 protected

– 8 + 2 protection

– (Global) Hot spare drives

Parity HotSpare

Any VTE can access any

tape volume in the library

IBMmainframe



16


Tape Drive Sharing

� Up to 2,048 emulated tape drives

� Eliminates the need for automated

tape device sharing software

� VTE provides full multiple image

support

– Devices dynamically learn paths to

attaching to up to 64 LPARs

� Support for Autoswitch

� Support for cascading directors

Disk Library for mainframe individual tapes across LPARs

External software required for tape sharing across LPARs


Reduce HSM CPU Cycles

� Reduce/eliminate DFHSM ML1– Move directly from L0 to ML2

– Save the mainframe CPU compression cycles

– ML2 information is compressed and kept on disk in the DLm

– Recalls at disk speed

� DFHSM recycle time optimized– DFHSM will continue to perform tape recycling

▪ Recycling at disk speed

▪ User-settable virtual cartridge size

▪ No contention for tape drives

– Hours of savings potential

Production DASD Disk Library

for mainframe

Virtual tapereclaimed on disk

ML0ML0ML0ML0 ML2ML2ML2ML2


17


Management Reporting (Batch or Console)

� Easy to manage the Disk

Library for mainframe from the

mainframe host

� Retrieve the following

information:

– Space

– Compression

– Configuration

– Paths

– Paths assigned

– Channel adapters

– Rejected paths

– Performance information

– Slowest mounts

//COMMAND EXEC PGM=DLMCMD

//STEPLIB DD DISP=SHR,DSN=user.apf.loadlib

//DLMCTRL DD UNIT=/xxxx,DISP=SHR,LABEL=(,SL),

// DSN=DLM.CMDPASS.EXAMPLE,VOL=(,RETAIN,SER=zzzzzz)

//SYSUDUMP DD SYSOUT=*

//DLMLOG DD SYSOUT=*

//DLMCMD DD *

RUNWAIT (600) 501 'DLm command' 'output destination path' 'output

file'

/*


Discover and View Configuration of DLm Systems (EzSM)

1

Discover and Monitor DLm Devices•Import and Export Tapes

1

2

2 Set Configuration Options •Display Configuration Information


18


EMC Mainframe Global Services

Assessment

Design and Implementation

Migration

Integration

Optimization and Validation

• Plan, deploy and optimize EMC

Technology into Mainframe environments

• Proven Mainframe expertise and services

• Best practices, proven delivery and

project management methodologies

• Access to proven reference architectures

and interoperability results


Disk Library for Mainframe SupportEMC Secure Remote Services and ConnectEMC

EMC Internal EMC Internet Customer Customer Internal

Database(primary)

Database(backup)

Enterprise Site 1

Enterprise Site 2

Enterprise Site 3

Enterprise Site 4

Enterprise Site 5

Future access

server islands

Enterpriseservers

SupportAnalystwebsite

EMCSupport

Access servers

Web servers

Access servers

Web servers

Registrationauthority

Registrationauthority

EMC Disk Libraryfor mainframe


Gateway 1

Gateway 2

Policymanager

Enterpriseservers


19


Why EMC for Mainframe Tape?� Tiered Product Offerings– One size and technology does not fit all

– Leveraged platforms: Data Domain, VMAX,

and VNX

� Breakthrough Disaster Recovery– VMAX using SRDF and SRDF/A

– VNX with Guaranteed Replication

� Best TCO– Better performance and recoverability with

lower TCO

– Reduced power, cooling, datacenter footprint

� Demonstrated Commitment – Continued investment in mainframe

– Strategic partnerships

emc disk library for mainframe - think global 1000-2000-6000... · remote replication compression...

Documents