16757: agile, available, and recoverable - demystifying ... · insert custom session qr if desired....

30
Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman Hitachi Data Systems Rebecca Levesque 21st Century Software March 5, 2015 4:30-5:30pm Sheraton Issaquah B RS

Upload: others

Post on 27-Mar-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Insert

Custom

Session

QR if

Desired.

16757: Agile, Available, and

Recoverable - Demystifying Time to

Data

Ros Schulman – Hitachi Data Systems

Rebecca Levesque – 21st Century Software

March 5, 2015

4:30-5:30pm

Sheraton – Issaquah B

RS

Page 2: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

2

About the SpeakersRos Schulman is Director, Data Protection at Hitachi Data Systems with over 35 years experience in

the IT business both on the vendor and customer side including systems programming, operations,

technical support and sales support. Ms. Schulman has worked at Hitachi Data Systems for over 22

years. She currently works in the Global Solutions Strategy and Development organization with

responsibility for Data Protection Software and Mainframe Management software including disaster

recovery and backup software. She spends much of her time with customers, discussing their unique

Data Protection challenges. She has also co-authored many white papers in the area of Business

Continuity.

Rebecca M. Levesque is Chief Executive Officer of 21st Century Software and responsible for

shaping the company’s product strategy and vision. She has over 20 years experience helping hundreds

of companies establish resiliency and recoverability strategies from any disruptive event. Her knowledge

and depth of experience is offered as a speaker at SHARE, IBM Systems Magazine, ACP, and DRJ.

She is a published author in trade journals, white papers, and industry forums. Additionally, Rebecca

has helped executives, storage managers, and technical architecture professionals leverage their

existing storage technology investments while ensuring efficiencies across the enterprise.

About this SessionWhether you currently use storage-based replication, or are considering it, this session demystifies

long-standing (and often misguided) assumptions made around high availability and, more

importantly, time to data. Crashes create inconsistent data, and the scheduler may be unaware of

backup copies available for the restoration of interrupted application jobs. Learn how other

companies have faced these challenges, and combined storage-based replication and host-based

software to lower their RPO and RTO, delivering a robust and effective recovery solution.

Page 3: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Misunderstandings of Mainframe

Availability

• Myth 5: Distributed systems are down much more

often than mainframes

• Myth 4: As long as I replicate my critical data, it

should be easy to restart my critical applications

after a disaster

• Myth 3: Storage Systems are bulletproof

• Myth 2: App owners & storage folks understand

interplay of technology and effect on recovery

• Myth 1: HA technologies like GDPS negate the

need for other forms of Data Protection

3RS

Page 4: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Establish Problem and Appropriate Solution

• Square expenditure and focus with expectation

– Too much focus on DR and not enough on resiliency

– Does not solve operational recovery issues

– Suitable solutions for smaller, local failures

• High availability does not solve everything

• Establish SLA’s to meet business, not rely on RTO/RPOs

– Use the right technology

– Application uptime is the name of the game

• Most replication technologies can create crash consistent data

– May be ok for databases

– What about open or stranded datasets

– Non-database application recoverability requires different approach

for both operational recovery and DR

4RS

Page 5: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

5RS

5

Data Protection

What are we protecting against?

5

It matters less whether the root cause of an operations disruption is a

significant disaster event or minor malfunctioning of one or pieces of data center

equipment. The disruptive effect on business operations is the same.

Actual DR events 3-4%

Page 6: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Traditional Recovery Time Slots

Industry Requirements RTO RPO SLA

(maximum)

Top Tier Financial Services,

Healthcare, Utilities, Telecom

15 seconds –

2 hours

15 seconds –

4 hours

5 minutes

Media, IT, Manufacturing, Federal

Government, Financial Services,

Retail, Distribution, Biotech

2 – 8 hours 2 – 4 hours 4 hours

Insurance, Transportation,

Energy, Education, State & Local

Government

8 – 24 hours 24 hours 8-16 hours

Hospitality, Food & Beverage,

Wholesale Distribution,

Constructions, Publishing, Non-

profit

>24 hours 24-36 hours 24 hours

Data courtesy of Gartner, 2012

6RML

Page 7: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

SLA Tiers

7

• Determine SLA per application

− Tier 1 - continuous availability requirement,

maximum four minutes downtime a year

− Tier 2 - high availability, maximum of one

outage per year, maximum four hours outage

per year

− Tier 3 - recovery essential within 24 hours,

maximum three outages per year

− Tier 4 - recovery required within three days,

maximum four outages per year

− Tier 5 - delayed recovery, all other services

(Hiles, Continuity Central, 2015)

7RS

Page 8: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Operational or DR … or Both?

• Continuous availability enables 24/7 access to IT-

enabled business functions, processes and applications

• Continuous availability involves two strategies: high

availability (minimizing unplanned downtime) and

continuous operations (minimizing planned downtime)

• Sometimes, continuous availability architectures embody

disaster recovery strategies

– IT service processing continues despite disaster events

– Gartner refers to this as "multisite continuous availability“

(Gartner, Donna Scott, 2014)

8RML

Page 9: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Top Down Recommended

• Achieving 100% or near-100% availability requires a top-down

approach to engineering availability into the application,

infrastructure and operating architectures.

• The greater the availability requirements, the more customization

and integration are required across multivendor components of a

solution.

• Achieving continuous availability is an expensive proposition and

has, in the past, generally been reserved for only the most critical

business and IT services.

(Gartner, Donna Scott, 2014)

How do legacy apps play in ?

9RML

Page 10: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Criticality Levels Define IT Resiliency

Criteria - BIA & business cost of downtime analysis

Criticality User Group Uptime Availability

Mission Critical External

(customer revenue

producing)

24/7

scheduled

uptime

99.95% (22 min/mon)

15 min RTO

0 RPO

Critical Internal

(ERP, email)

24/6.5 days

per week

99.9% (41 min/mon)

4 hrs RTO

4 hrs RPO

Important Internal

(financial systems)

24/6 days per

week

99.5% (3 hrs/mon)

48 hrs RTO

24 hrs RPO

Non-critical Internal

(departmental

systems, R&D)

24/5 days per

week

98%

1 week RTO

24 hrs RPO

Data courtesy of Gartner, 2012

10RML

Page 11: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Information Potentially Over 2 Days Old

Rea

dy

To

Go

??

Traditional RTO Estimate ~24 Hours

Restore

Data /

Information

Restore

Applications,

Prog. Prod.

Restore

Operating

System(s)

Rollover to

Side B or

Tapes,

Disk

Triage -

Response

Time

Daily Business & Operational Processes

Communication

&

Notification

2 - 6+ Hours 2 - 8+ Hours 6 - 8 Hours 4 - 6 Hours 14 - 20+ Hours

Relocate

Non-DP

Support

Restore Data & Voice Network

Relocate

Business

Functions

Recreate &

Reenter

Lost Data

Reenter

Manually

Tracked Data

Production?

Can Business

Use 2 Day +

Old Data ?

Systems Cleanup:

Synchronization,

Performance,

Capacity,

Configuration

BU

SIN

ES

S A

S U

SU

AL

On-Line /

Batch Cycle

VTL or traditional tape

On-Line /

Batch Cycle

Technology Recovery Process

ACTUAL RTO In Excess Of 34 Hours (Conservative)

Recovery

Point

(RPO)

Po

int O

f La

st Ba

cku

p

Or R

eplica

tion

Brea

k

Business

Recovery

Process

Operational Resiliency Timeline

RTO or SLA?

Availability

Replication

11RS

Page 12: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

12

UptimeMaximum

Downtime/Year

Six nines 99.9999% 31.5 seconds

Five nines 99.999%

Four nines 99.99% 52 minutes 33 sec

Three nines 99.9% 8 hours 46 min

Two nines 99.0% 87 hours 36 min

One nine 90.0% 36 days 12 hours

Percentage Uptime Achieved Per Year

From http://www.continuitycentral.com/feature0267.htm

% Missed*

63%

34%

25%

*Continuity Software

Survey (10/2014)

5 minutes 35 sec

RS

Page 13: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

3/5/2015 13

*BMC 2014 Mainframe Survey

RS

Page 14: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Issues with Backup

1

AM

2

AM

3

AM

5

AM

10

PM

1

PM

12

PM

6

AM

7

AM

8

AM

9

AM

10

AM

11

AM

12

PM

1

PM

2

PM

3

PM

4

PM

5

PM

6

PM

7

PM

8

PM

9

PM

4

AM

DA

TA

GR

OW

TH

1

AM

2

AM

3

AM

5

AM

10

PM

1

PM

12

PM

6

AM

7

AM

8

AM

9

AM

10

AM

11

AM

12

PM

1

PM

2

PM

3

PM

4

PM

5

PM

6

PM

7

PM

8

PM

9

PM

4

AM

Successful

backup

Data Loss

Disruption

strikes

Backup Window1

RPO2

RTO3

AvailableNeeded

1

AM

2

AM

3

AM

5

AM

10

PM

1

PM

12

PM

6

AM

7

AM

8

AM

9

AM

10

AM

11

AM

12

PM

1

PM

2

PM

3

PM

4

PM

5

PM

6

PM

7

PM

8

PM

9

PM

4

AM

Disruption

strikes

Full backup Incr 1 Incr 2 Incr 3 Incr 4

Data

Restored

Incr n

RS

Page 15: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

15

What is your recovery point?

1

AM

2

AM

3

AM

5

AM

10

PM

1

PM

12

PM

6

AM

7

AM

8

AM

9

AM

10

AM

11

AM

12

PM

1

PM

2

PM

3

PM

4

PM

5

PM

6

PM

7

PM

8

PM

9

PM

4

AM

1

AM

2

AM

3

AM

5

AM

10

PM

1

PM

12

PM

6

AM

7

AM

8

AM

9

AM

10

AM

11

AM

12

PM

1

PM

2

PM

3

PM

4

PM

5

PM

6

PM

7

PM

8

PM

9

PM

4

AM

Successful backup

Data Loss

Disaster Strikes

Backup Window1

Data Recovery

Objective2

AvailableNeeded

1

AM

2

AM

3

AM

5

AM

10

PM

1

PM

12

PM

6

AM

7

AM

8

AM

9

AM

10

AM

11

AM

12

PM

1

PM

2

PM

3

PM

4

PM

5

PM

6

PM

7

PM

8

PM

9

PM

4

AM

Disaster Strikes

Full backup Incr 1 Incr 2 Incr 3 Incr 4

Data Restored

Incr5

DA

TA

GR

OW

TH

RTO3

What about the problems interdependencies between apps cause?

App

App

App

App

App

App

App

App

App

App

App

App

App

App

App App

RML

Page 16: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Data Protection Technologies and Recovery Time

16RS

TechnologyRPO

Range

RTO

Range

MAX

Downtime

per year

SLA

Archive Static Depends Hours

Traditional Backup to Tape/Disk

including VTL or PBBA

24-168

hours1-24 hours

1d 19h 49m

44.8s

Hours

99.5%

Disk PIT/CDP

With or without Application Awareness

Minutes –

36 hours

15 mins –

12 hours

4 Hours 22

minutes

Minutes

99.95%

Synchronous Replication 0-2 mins 1-4 hours4 Hours 22

minutes99.95%

Synchronous Replication with Failover 0-2 mins 5-60 mins52 mins – 5

mins

99.99%-

99.999%

Asynchronous Replication0-60 mins

1 – 8

hours

4 hours 22

mins99.95%

Asynchronous Replication with Failover 0-60 mins 30 mins –

4 hours52 mins 99.99%

3 DC (Sync/HA and Async) 0-60 mins5 mins –

4 hours

4 hours 22

mins -5 mins

99.95%-

99.999%

Page 17: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Other Considerations

• Storage replication, software replication alone doesn’t automate and guarantee failover

• Failover waits for “go ahead” – or automate and roll the dice

• Corruption

• Tape/DASD speed differential

• SLA achieved through approach

• What about GDPS?– Batch has to be restarted even with GDPS

– Potential for transactions to have been stranded in the failed site

“Attempts to apply the stranded changes to the data in the active site may result in an exception or conflict, as the before image of the

update that is stranded will no longer match the updated value in the active site” (IBM Share - August, 2012)

17

RML

Page 18: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Operational Recovery (restore a file, folder, volume, system)

Disaster Recovery (restore operations at/from another location)

Recovery Classes and Performance

0 Secs Mins Hours Days

CDP Snapshots BackupRPO

RTO

0 Secs Mins Hours Days

Sync & Async Mirror Backup Replication Off-Site TapeRPO

RTO Disk TapeVirtual Tape

Disk TapeVirtual Tape

18RS

Page 19: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Balancing Risk, Costs and Volume of Data

Data Protection

Service Level

Business

Service Level

Optimize Risks and Costs

Cost of Risk

Data Loss

Availability

Cost of

ProtectionCAPEX

OPEX

RS

Page 20: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Resiliency Requires Focus on 95% Problem

• Emphasis on system vs. application

• Plenty of data – where is generational – which

data to use?

• How designed – for active/active?

• Backups for applications – where and when

• Intertwined dependencies are not known

• High availability solutions are not DR

• Jobs write at conclusion – interruption midstream

create unknown status

• Corruption copied and not detected

20RML

Page 21: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Different Data Classes…

Require Different Data Management

Mirroring or synchronous replication, and continuous

data protection (CDP) for point-in-time recovery

Storage-based snapshots and replication to

increase availability (RPO and RTO)

Standard backup processes (full +

incremental) and replication for DR

Migrate to archive tier, manage

retention, and enable discovery

21RS

Page 22: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Gartner on Key Challenges of Current Backup

Solutions (Dave Russell)

The convergence of backup and disaster recovery technologies has occurred largely because

snapshot, replication and virtualization have made it possible to recover from a disaster without the

need for a traditional data restoration. The methods involved in this convergence seek to minimize

storage cost, while also allowing for instant recovery. (Posey, 2014)

22

Page 23: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Time to Data…

The amount of time required to restore application access to a businessis what separates a temporary CRISIS from a full-blown DISASTER

… is the ultimate determinant of recovery strategy effectiveness

Slide courtesy of Jon Toigo

23RML

Page 24: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Questions to Ponder

• Is the data you recover useable, what does it

take to make it useable

• Are business SLAs achievable currently and do

they match your RTO/RPO’s?

• Are you using the right technology to map to you

SLA’s

• What do you test from a recovery standpoint

• DR

• Data Corruption

• Have you ever tested month end, quarter end,

or year end and determined how recoverability

was affected

24RML/RS

Page 25: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Summary - where are the gaps?

• Any type of availability solution

• Highly available configurations do not

equate to 0 downtime

• High availability does not replace DR

• Resiliency is a process

• Recovery of systems (infrastructure) can

easily disregard

– Applications involved

– Interdependencies

– Type of interruption (crash, corruption,

deletion) and effect on data/jobs

• No single answer

• Ask us – we can help

25RS

Data

Protectio

n

Service

Level

Business

Service Level

Optimize Risks and Costs

Cost of

Risk

Cost to

Protect

Page 26: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

In-System Replication

Solutions

Remote Replication

Solutions

Replication

Management SolutionsIN-SYSTEM REPLICATION

SOLUTIONS

REMOTE REPLICATION SOLUTIONS REPLICATION MANAGEMENT SOLUTIONS

ShadowImage® In-System

ReplicationFor full volume clones of business data

with consistency

(ATTIME split with HUR)

Hitachi TrueCopySynchronous, consistent clones at remote

location up to 300km (~180 miles)

Hitachi Business Continuity Manager (BCM)Replication management in z/OS environments

IBM-Compatible FlashCopyPoint-in-time volumes and datasets via

IBM command set in z/OS environment

Hitachi Universal Replicator (HUR)Any distance, unique use of ‘Pull’

technology and Journal Volumes to

accommodate link outages or interruptions

Hitachi Replication Manager with mainframe

BCM

“Enterprise-wide” GUI replication management

and monitoring for mainframe and open systems

IBM-Compatible FlashCopy/SEPoint In Time volumes with virtual

volume pool as target vs. whole volumes

IBM-Compatible XRC*Asynchronous remote replication via

compatible with IBM XRC in z/OS

environment

* Note: Only available as a migration tool to HUR

IBM Basic HyperSwap, GDPS HyperSwapcertification and/or integration

High-availability storage for z/OS environments

Replication Assessment, Migration and Implementation Services Best practice designs that ensure results and lower risks in implementation

Replication Score Card (Health Check) ServicesPeriodic checkups that ensure continued solution value

Hitachi Mainframe Business Continuity Portfolio

RS

Page 27: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

In-System Replication

Solutions

Remote Replication

Solutions

Replication

Management Solutions

Data Resiliency Storage Management & Usage Tape Migration

VFI

• Slashes recovery time objectives

and assures SLAs

• Erases recoverability gaps,

ensures resiliency, and reduces

storage

• Enables recovery to job/dataset

level through real-time

architecture and patent pending

software code (InstaSnap,

InstaRestore, and Timeliner)

• Focuses on intricate, application-

level dependencies

• Protects InFlight data and

maximizes snap copies sync’ed to

application backups

• Cross-application dependencies

Total Storage

• True knowledge for storage and

management class

• Insightful reporting for JCL coding to

avoid policies

• Tier data based upon usage,

reference, and criticality (from VFI)

• Data modeling for new purchase or

improving allocation and utilization

SpaceFinder

• Intelligent resource management

tools

Tape/Assist

Migration in Place

• Reduces cost of managing tape

resources while providing continuous

availability

• Director and high speed copy utilities

• Backend utility processes assure

referential data

• Portability, disaster recovery, and backup

copies for data resiliency

• Consolidation of data

• Expertise to assist in migration

management

Recovery Resiliency, Storage Management and Modeling, Tape Migration and Implementation Services

21st Century Software z/OS Portfolio

RML

Page 28: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Questions?

28

Thank you!

Page 29: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Final Thought

The lifeblood of almost every organization is data, and

the requirements to protect, maintain, and access the

systems that store that data are absolutely essential

to support business operations. With the sheer amount

and varying types of information that must be stored, the

complexity of managing the data can grow as quickly as

the amount of data itself.

In this fast-moving day and age, businesses cannot

afford to wait for anything — if they do, they risk, at

best, losing sales to the competition, or, at worst, falling

behind the competition and being pushed out of

business.

(Storage Economics for Dummies - Hitachi Data Systems, 2012)

RS

Page 30: 16757: Agile, Available, and Recoverable - Demystifying ... · Insert Custom Session QR if Desired. 16757: Agile, Available, and Recoverable - Demystifying Time to Data Ros Schulman

Thank You!

For additional 21st Century Software

information, please contact:

Rebecca Levesque

21st Century Software, Inc.

940 West Valley Road

Suite 1604

Wayne PA 19087

U.S.A.

610 971 9946 x 200

610 659 6521 (cell)

[email protected]

For additional Hitachi information,

please contact:

Ros Schulman

Data Protection Technologies

Global Solutions Strategy and

Development

Hitachi Data Systems

973 207 4138 (cell)

[email protected]

30

RS