hosted by seven step plan for building and scaling storage networks richard scannell bill peldzus

Hosted by

Seven Step Plan for Building and Scaling Storage Networks Richard ScannellBill Peldzus

Hosted by

Building a Solid Foundation

Building and Scaling Storage NetworksBuilding and Scaling Storage Networks

• If you bypass just one pitfall at the end of this

session, then we’ve been successful!

Richard Scannell• VP of Strategy and Co-founder

Bill Peldzus• Sr. Storage Consultant

Hosted by

But First, Some Housekeeping…

Workbooks available for taking notes

• Outlines key questions and considerations for you and your

company going forward

Presentation flow

• Richard will address the high-level stuff

A.k.a. How to sell this to your boss

• Bill will address the techie stuff

What works, what to watch out for, design considerations

• We’ll both address the customer stuff

Hosted by

What’s the Agenda?

Topics include• What to plan for

• Budget/ROI/TCO

• Non-technical considerations

• Application effect

• Getting from here to there (a.k.a. migration)

• Up and running – what’s next?

• Planning for Q2, Q4, 2004

Hosted by

Audience Feedback Please

IT End User

•No privileged access•Victim of policy

IT Worker

•Has Privileged access•Enforcer of policy

IT Manager

•Grants Privileged access•Defines policy

Executive

•Privileged in general•There’s a policy?

Hosted by

What to Plan for When Building a Storage Network

Hosted by

Why is this Important? The intersection of Network, Storage and Database is

creating complex new technologies and three problems

for the CIO – Technology, Business, Organization.

Hosted by

DECNet, Appletalk, Token Ring, ATM, Frame Relay, TCP/IP, Gigabit Ethernet

Complex Today and Getting Worse

85% of those who have not yet implemented a SAN have heard “horror stories”about complexities/compatibilities.

Enterprise Storage Group

89% of organizations that have already implemented one major SAN would usean outside firm for their subsequent design and implementation.

Enterprise Storage Group

Fibre Channel, iSCSI, Infiniband, Virtualization, SRM, Virtual Tape

Hosted by

Balanced Business Approach

Hosted by

Storage Product Landscape

Disk Drives Tape Drives

Arrays Libraries

Storage Networking

Hardware

Virtualization Continuity Replication

Software

Storage System Management

Storage Resource Management

Storage Policy Management

Application ManagementServices

Application Integration Application Management

Hosted by

Interoperability – Why is it <still> an issue?

5+ Fibre Channel Switch/Director Vendors

Tape Library Tape Drive

Tape Drive

Tape Drive

Tape Drive

HBA

LAN

Disk Storage

HBA HBAHBA

SANSAN

5+ Server Vendors

4+ HBA Vendors

4+ Tape Library Vendors

3+ Bridge/Router Vendors

8+ Tape Formats

7+ Large and Small Disk Array Vendors

Bri

dg

e

AND: Multiple software options, multiple operating systems, multiple

firmware and microcode levels...

Tape Drive

Hosted by

Interoperability - more…

The last slide didn’t even touch on the multiple PRODUCTS from each of the noted vendors

Only counting vendors, there were over 67,000 possible product combinations for that “simple” storage area network

That’s going to the extreme, BUT, do you really think every configuration has been tested?

Hosted by

Your Vision May Not be Your Vendor’s Vision

Customer’s Overall Storage Vision

Disk Storage Vision

Tape Storage Vision

Fabric Storage Vision

Enterprise BackupStorage Vision

Storage ManagementVision

HA Storage Vision

DR Storage Vision

•Technology•Process•Policy•Measurability







Hosted by

Storage NetworksBudgets…ROI…TCO…

Hosted by

Justifying a Storage Network

In 2003 and beyond, the trend is

“Spend to SaveSpend to Save”

Can’t put in a SAN because it’s “cool”

• You put in a SAN because it saves money!

Justifications are difficult – let’s look at

some approaches…

Hosted by

Data Lifecycle

Data has a discrete value to the business and that value changes over time

Drivers that affect data value• Product/Service lifecycle

• Regulatory requirements

• Customer expectations

Hosted by

Align Value with Cost

Apply appropriate infrastructure to protect the data

and the business (from risk and waste)

One size doesn’t fit all

• JBOD, RAID, Clustering, Replication, Hot Site

Hosted by

Break Even Analysis

Value of Information

TCOLow Medium High

Hig

hM

ediu

mL

ow

Payroll

Order Processing

C.R.M.

Inventory Management

System

Break-even: TCO = Value

Best Practices Line

Hosted by

Governance: When does data qualify to

move up or down the value stream? (more on this coming up)

Architecture: Hardware/Software

requirements

Processes and Standards

Optimization of Assets

Occupancy: Appropriately congregate data

by value and rationalize storage requirements at each phase

Hosted by

Classes of Storage

Create Classes of

Storage based on

architecture attributes

Track TCO, utilization

(on the device) for each

class of storage and

occupancy of the

classes relative to each

other

Distribution by Class

0%

20%

40%

60%

80%

100%

Low Med High

Hosted by

Utilization and TCO

Understand yields of

useable storage based

on RAID configuration

Establish a goal line for

average utilization

Create plans to drive

utilization to the goal

Storage Utilization

0

50

100

150

200

250

300

TB

0%10%20%30%40%50%60%70%

% Utilization

Used Usable Raw Used/Usable

Hosted by

Utilization and TCO

TCO by Class

0

50

100

150

200

250

TCO

($/M

B)

High Med Low

Track TCO across each

class

Ensure there is sufficient

gap between the classes

to warrant separation

Focus efforts on reducing

TCO in ALL classes.

Diminishing returns is a

factor…

Hosted by

Asset Sharing

Storage Networks enable asset sharing• Share tape drives (more on this later)

Don’t have to buy a tape drive with every server

Use your tape drives twelve hours per night

instead of four or five

• Shared pool of “spare” storage

Don’t need to allocate spare storage to every

server or application

Distribute the spare storage where it’s needed

Hosted by

The Non-Technical (but very important!) Stuff…

Hosted by

Storage Governance

Governance: the continuous exercise of authority over and

the performance of functions (Webster)

To date almost all vendors are focused on the Physical and Logical levels – does not diminish the continuing needs for Business Level focus

Hosted by

Storage Governance

Needs to be

Predict

Occupancy

Operating Standards

Asset Optimization

Change Control

Utility Mindset

Strategic

Used to be

Guesstimate

Utilization

Benchmarks

Asset Management

Downtime

SLA

Tactical

Hosted by

Before I Buy…

Have you considered

• What your RFx is going to look like?

• More importantly, how are you going to rank the

responses?

• Will I consider startups with great technology?

• Do I understand my SLAs?

• Checking references?

Hosted by

The Effects on Applications

Hosted by

How Can Applications Benefit? Performance - more storage per channel and still faster than

old F/W SCSI

High availability - try a 3-node cluster with SCSI versus Fibre Channel SAN

Disaster Recovery - A DR architecture that doesn’t involve the server for data replication

Data protection - not buying another tape drive with every new server

Storage management - more managed GBs/support staff in a pooled environment

Let’s take one and explore it further__

Data protection

Hosted by

Multiple Approaches including

• Distributed backup

• Centralized backup

• LAN Free backup

• Serverless backup

Terminology – Backup Methodologies

Hosted by

Client Systems Application Servers

100 MbpsLAN

File Server Database Server Mail Server Database Server

Storage Storage Storage Storage

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Backup Methodologies: Distributed Backup

Hosted by

Application Servers

100 MbpsLAN

Tape Library

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Master Backup Server

Client Systems

Bottleneck

B

Gig E LAN

MediaServer

SCSl

File Server Database Server Mail Server Database Server


Dedicated Gigabit Ethernet for backup LAN

Backup Methodologies:Centralized Backup over the LAN

Hosted by

Storage

Application Servers

100 MbpsLAN

Master Backup Server

Client Systems

Gig E LAN

Media ServerFile Server Database Server Mail Server Database Server


Tape Library 1

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Library 2

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Dedicated BackupDedicated BackupSwitched FabricSwitched Fabric

Backup Methodologies:LAN Free Backup with Native FC Tape Drives

Hosted by

SCSl


Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Fibre Channel SAN Fibre Channel SAN for Disk and Tapefor Disk and Tape

LAN1


LAN2


A¹ B¹

C¹ D¹

A B

C D

A B

C D

LAN2

MasterBackupServer

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

File Server

Database Server Mail ServerApplication Server

A B C D

Backup Methodologies:LAN Free Backup with SCSI Tape Drives

Hosted by


LAN1


LAN2

Storage

Storage

Storage

Storage

A¹ B¹

C¹ D¹

A B

C D

A B

C D

LAN2

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Ro

ute

rR

ou

ter

File Server

Database Server

Mail Server

Application Server Master

BackupServer

A B C D

Backup Methodologies:LAN Free Backup with SCSI Tape Drives

Hosted by

Application Servers


LAN1

Client Systems

LAN2


A¹ B¹

C¹ D¹

A B

C D

A B

C D

LAN2

Master

Backup

Server

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Ro

ute

rR

ou

ter

File Server

Database Server

Mail Server

Application Server Master

BackupServer

A B C D

XCOPY Server(SCSI Extended Copy Command)

XCOPY (SCSI Extended Copy Command)

Backup Methodologies:Serverless Backup with SCSI Tape Drives

Hosted by

Persistent binding• The mapping of a specific SCSI ID to a specific device

in a Fibre Channel environment

• Generally mapped by WWNN or WWPN

• Without persistent binding, the physical to logical

mapping of tape drives can be re-ordered every time

there is a re-boot

• This will confuse your backup software

Multiple Tape Drive Configuration – Issues

Hosted by

NT and W2K only

Not specific to SAN

If a tape drive fails in a library, there is danger of

re-ordering of the logical to physical mapping

This will happen upon re-boot

Lesson: replace drive before re-boot AND confirm mappings

before backups

Solutions are being integrated … help coming!

Physical Drives

1

2

3

4

5

Tape LibraryLogical

Mapping

1

2

3

4

5

Backup SoftwareMultiple Tape DriveConfiguration Hazards

Hosted by

How to Get There from Here(Data Migration)

Hosted by

Multiple Approaches

From the simple

• Backup tapes

To medium

• Mirrored copy, snap-shots, etc.

To complex

• Specialized data migration and

“virtualization” products

Hosted by

Migration Considerations

If you’re planning a migration over a

long weekend, know what time to “turn

back” if it’s not going as planned

Estimating the time it takes on paper is

fine, but…

• Don’t forget to factor in “import/export” times

into databases or applications

Hosted by


LAN LAN

File Server Application Server Mail Server Database Server

Storage Storage Storage StorageSCSl

Tape Library

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

MasterBackupServer

NASNAS

Today’s Typical Architecture

Hosted by

SCSl

Shared Shared StorageStorage

Mail Server Database Server

Storage Storage


LAN LAN

MasterBackupServer

Tape Library

Tape Drive

Tape Drive

Tape Drive

Tape Drive

Tape Drive

HeartbeatHeartbeatProduction

Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

Production Server

Storage

NASNAS

Phase 1: Introducing Storage Networking (w/ H.A.)

Hosted by

Phase 2: Migrating from DAS to SAN

A B

C D

LAN


LAN

File Server


Storage

Storage

Storage

Storage SCSl


Tape Drive

Tape Drive

Tape Drive

Tape Drive

MasterBackupServer

SAN Fabric

A B C DX X X X

Hosted by

Phase 3: Enterprise Ready SAN

SCSl


Tape Drive

Tape Drive

Tape Drive

Tape Drive

LAN1

Client Systems

A B

C D

MasterBackupServer

A B

C D

A¹ B¹

C¹ D¹

A¹ B¹

C¹ D¹

A B

C D

A B

C D

File Server


A B C D

Fabric 1Fabric 1 Fabric 2Fabric 2

Hosted by

Begin MigrationMethod Selection

Dual Direct-Attachment?

Host Mirroring?

Y

Host BlockCopy?

Host File Copy?

Host FileBackup?

N

N

N

Dual-HostNetwork

Attachment?

N

Array BlockCopy?

N

Host-to-HostNetwork

Mirroring?

Y

Host-to-HostBlock Copy?

Host-to-HostFile Copy?

N

N

N

Execute MigrationProcess

Y Y Y

SANAppliance?

N

Y

Y

N

Y Y

Y

Y

Abort MigrationProcess

N

Data Migration Decision Flow-Chart

Hosted by

Okay, it’s InstalledWhat’s Next?

Hosted by

Storage Management Lifecycle

Hosted by

Troubleshooting

Have you “Monitored for normal”

Is you staff trained?

• Can they do initial troubleshooting?

Do you know what to do if…

• you think it’s a switch problem? Or an HBA?

Are my maintenance contracts consistent?

• i.e. two hour response on storage array, but eight hour

response on FC switches

Hosted by

Planning for Next Quarter; Next Summer; Next Year; Next Millennium!

Hosted by

New Technologies to Consider

IP Storage

Disk versus tape for backup

InfiniBand

Storage Management products

Look before you leap!• Careful of baseline requirements

• Careful of what’s supported

• Careful of outrageous claims

hosted by seven step plan for building and scaling storage networks richard scannell bill peldzus

Documents