architecting next generation enterprise network storage
DESCRIPTION
TRANSCRIPT
IMEX©2000-2005 IMEX Research All rights Reserved
IMEXRESEARCH.COM
Architecting Next Generation
Anil Vasudeva Principal Analyst & President [email protected]
Enterprise Network Storage
IMEX©2000-2005 IMEX Research All rights Reserved
Agenda
Strategic Storage PlanStrategic Storage Plan
Managing Hurdles (Knowledge, Budget, Management)
Data Protection Data Protection
Issues (Existing Techniques/Pains)
Techniques (Mirroring, Snapshots, Replication, CDP)
Lowering TCOLowering TCO
Tiered Storage (Aligning Cost of Stg. w Value of Data)
Standardization/Interchangeability (Investment Protect,Virtualize)
Autonomics (Lights Out Management)
FuturesFutures
Information Classification & Mgmt (Reference Metadata Engines)
IMEX©2000-2005 IMEX Research All rights Reserved
Budget MandatesBudget Mandates
CEOs Mandate for CIOs: Do more for less
Migrate to Nex-Gen Infrastructure while protecting existing IT investments
Justify ROI/TCO (Acquisition + Operating Expenses)
Knowledge of Emerging TechnologiesKnowledge of Emerging Technologies
Keeping pace with new technologies, products, standards & management
Avoiding Pain Points - Backing up whole files, despite very little changed
Full restores when only a few bytes need to be put back
ManagementManagement• Managing Hodge-podgy growth and complexity
Standardizing on few configurations to reduce complexity
Establishing Data protection, Business Continuance/Disaster Recovery
ILM/Regulatory Compliance
Implementing Virtualization, Provisioning & Lights-out Storage Automation
Data Storage Hurdles
““Manage your data before it manages youManage your data before it manages you””
IMEX©2000-2005 IMEX Research All rights Reserved
Chaos in the Enterprise . . .
Server/OS
Network
Application
Storage
Test
Backup
Disaster Recovery
Database
Financials
TM
D/R plan (MF only)
STK Silos Tape
TM
TM
TM
IBM3090-600JMVS/ESAIMS / ADABAS
BU by FDR Upstream
HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12
Fujitsu DS90UX P/M
8mm BackupLegato to DLT
IBM ADSM3490
HP OmniBack
SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0
IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000
Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL
Cheyenn e to 4mm
Batch
IBM AS/400OS/400
InventoryExchange
CAD/CAME-commerce
Lotus NotesOLTP
CICS
File transfers AIX to HP/UX via Platinum 9.9
FTP between Sun - NT
Database extracts MVS to SP2 via MQ Series 4.4
PeopleSoft
(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control
IMEX©2000-2005 IMEX Research All rights Reserved
Data Explosion
0
1
2
3
4
5
6
7
8
9
10
2003 2004 2005 2006 2007 2008
Peta
byte
s of
Sto
rage
0
5
10
15
20
25
30
Stor
age
Reve
nues
$B
PB NormalPB with Accelerators*
*Realtime Data, VoIP, HPC, Grids, WebServices/XML
Storage Revenues
IMEX©2000-2005 IMEX Research All rights Reserved
DataCenter Automation Targets
Servers Utilization
ServersServers/Admin
StorageTerabytes/DBA
NetworksNtwk Ports/Admin
SystemAvailability
20-25%80+%
15-30500+
1TB100TB
50-100500+
HAL- 3 (99.9%)
HAL- 5 (99.999%)
NowTargeted
Data: IMEX Research 2004
IMEX©2000-2005 IMEX Research All rights Reserved
Market Segments by Applications
*IOs per sesond for a required response time ( ms)
(RAID - 0, 3)
500100MB/sec101 505
1K
10 K
100
10
1
eCommerceeCommerceTransaction Transaction ProcessingProcessing
OLTPOLTPOLTP
Data Warehousing
Visual DB
DSS(RAID - 1, 5, 6)
IOPs
(L
aten
cy)
StreamingStreamingStreamingAudioAudio
VideoVideo
Scientific ComputingScientific Computing
ImagingImaging
HPCHPCHPC
TPC
HPCHPC
IMEX©2000-2005 IMEX Research All rights Reserved
Storage Data -Types & Characteristics
• High $/GB • Low $/GB
• Milliseconds
• Moderate $/GB
• 1/10thsec to sec
Online Offline/VaultedMidline Nearline
• Med to Low $/GB
• Minutes to hours • Hours to days
Res
pons
e Ti
me
Current Business Critical Active data Hi-transaction data
Aged, Reference data - Images, records, BU emails Unalterable - regulatory
Centralized backup- Disk-to-Disk-to-Tape Staging to tape
% O
nD
isk
• 50% • 35% • 15% • Tape
Recoverable DataReference Data Buffered Data Dynamic DataArchived for BC/DR- Local, - Remote
Pric
e
Source:Maxtor
IMEX©2000-2005 IMEX Research All rights Reserved
Tiered Storage for Data Life Cycles
Age of Data/Freq. of Access
Migrate back to high performance if need be
Restored from tape if need be
Spee
d of
Acc
ess/
Freq
uenc
y of
Cha
nge
Backup & Restore SW
Volatile Data
Fixed Data
Tape Archive
IMEX©2000-2005 IMEX Research All rights Reserved
Corporate Data Usage
Nea
rline
Stor
age
IMEX©2000-2005 IMEX Research All rights Reserved
GoalsGoals• Operational Resilience
– Designing HA systems to meet RTO (a function of both type of failure & recovery technology deployed)
• Business Continuance– Designing Reliable Data Copy
systems to meet RPO (point in time to which data reverts to after an outage & recovery)
• Disaster Proof Processes (Including planned outages)
• Understanding Business Needs– Time to get back online– Critical Tier 1,-2,-3 applications– Max sustainable downtime
Data Protection
Recovery TimeObjective
RTOT-1 T0 T+1
Time at which Data Integrity last known
Time at which
Disruptive Event
Happens
Time at which
Recovery is Complete
Recovery Point Objective
RPO
Recovery Point
IMEX©2000-2005 IMEX Research All rights Reserved
Data Protection Technologies
Archiving Archiving
BackupBackup
MirroringMirroring• Asynchronous, Synchronous
SnapshotsSnapshots• Delta Snapshots, Full Snaps/Split
Mirrors
ReplicationReplication• Offsite Tape Storage, Host- Host,
Array-Array• Network based
CDPCDP
Archiving
Continuous Data Protectn
Snapshots
Traditional Backup
Mirroring
IMEX©2000-2005 IMEX Research All rights Reserved
Enterprise Data
Center
Departmental Small Medium Business
(SMB/SME)
Workgroup
Desktop SOHO and Mobile
Existing Deployed Storage Networks (Block and File) Scalability
“SAN in a Can” (Block & File) Simplified Use and Install
Low Cost Min. Features Easy to Use Self-Installable
Performance and capacity alone are no longer distinguishers attributes between enterprise and distributed storage
NASFile
(NFS & CIFS)
Convergence
Multi-Protocol
& Interface
Storage Market Requirements
IP SAN (Block or File)
(iSCSI)CO
ST
FUN
CTI
ON
S
FC SAN, IP SAN (Block) (FCP & FICON)
IMEX©2000-2005 IMEX Research All rights Reserved
Disk Storage Systems Market
DAS: -10%0
5,000
10,000
15,000
20,000
25,000
2003 2004 2005 2006 2007 2008
Rev
$M
SAN
DAS
NAS
SAN: 13%
NAS: 15%
cagr
IMEX©2000-2005 IMEX Research All rights Reserved
End to End Internet
Web
Web
Web
Web
Web
Web
Web
Web
Data CenterApplicationsEdge
Directory Security Policy Management
Software OS Platform
AppApp
AppApp
AppApp
AppApp
DBDB
DBDB
DBDB
IP Storage Network
FC SAN IP SAN NAS NAS
InternetCoreOptical
Edge
HA, Secure Data Center
IMEX©2000-2005 IMEX Research All rights Reserved
3 Tier Computing Infrastructure
Uniform and ubiquitous physical Connectivity – “Wire Once”
Any user to any server via Internet
Any server to any server via the LAN
Any sever to any storage via the SAN
Dynamic Logical Binding of…
server network identification
server OS version
server application assignment
application data volumes
Resulting in
Application Mobility across servers
Data mobility across storage
ApplicationEnd-Users
Tier –1 Network Services:
- Web Servers, - Firewalls,
- Load balancers
Tier-2 Application Services:
- Application Servers
Tier-3 Data Base Services
- Database Servers- Storage
Storage
Internet
LAN
SAN
IMEX©2000-2005 IMEX Research All rights Reserved
The iSCSI SAN
To Other LANs,Servers or IP SANs
Ethernet Header CRCIP TCP DATA
Client requests data from App Server
Ethernet CRCHeader IP
TCP iSCSI SCSI DATA
iSCSI-equipped App Server (“initiator”) requests data from an iSCSI storage (“target”)
Storage Arrays(iSCSI Target)
Application & DB Servers
(iSCSI Initiator)
Client Workstations
SAN GigE
Switches
LANEthernet Switches
IMEX©2000-2005 IMEX Research All rights Reserved
iSCSI on roadmap of storage vendorsC
OS
T
SERVICE LEVEL
High EndHigh End FC & iSCSIFC & iSCSI
MidMid--TierTier NAS & iSCSINAS & iSCSI
MidMid--TierTier FC & iSCSIFC & iSCSI
EntryEntry FC & iSCSIFC & iSCSI
SAN(Fibre
Channel)NAS
(IP)iSCSI
(IP)
•iSCSI delivers low-cost Networked Storage–Higher availability,Increased usage
–Centralized management,Storage functionality
IMEX©2000-2005 IMEX Research All rights Reserved
iSCSI SAN market on fast track
WW SAN Revenues
$-
$500
$1,000
$1,500
$2,000
$2,500
$3,000
$3,500
$4,000
$4,500
2001A 2002A 2003E 2004E 2005E 2006E
$M iSCSI
IB
Fibre Channel
IMEX©2000-2005 IMEX Research All rights Reserved
Tiered Storage Devices by Price/Performance
Drive Interface
Drive Types
FC Drive
FC RAIDSAS RAID
Dual-PortSAS
SATA Drive
PC Chipset
5400 RPM7200 RPM
SATA
SAS HBA/RAID
SASSAS
SAS Drive
10K RPM15K RPM
SAS HBA
SATA
Dual Mode SAS/SATAHBA & RAID
ServersMidline Storage
Mainstream NAS/SAN
Large Enterprise SAN & NAS
Desktop PCEntry NAS
Workstations
IMEX©2000-2005 IMEX Research All rights Reserved
Future: IP Storage Management on a chip
Host Services Integration StorageProvisioning Layer
IP SAN Management Layer
Appliance Service Layer
File system monitoring
IP SAN ManagementManagement
ConsoleManagement of
iSCSI HBAsMultiPath IO Supp
and FailoverSecurity
(iSNS, CHAP, SRP)
Virtualization Mirroring Snapshot Fail-Over
iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API Interoperability
HW Acceleration: TOE, iSCSI Offload, IPsec
Storage provisioning Win, LINUX, Solaris
IMEX©2000-2005 IMEX Research All rights Reserved
System Cost vs. High Availability
S/390MVSIBM Propl
S/390MVSIBM Propl
Bull Dell Fujitsu HP IBM NEC Siemens Stratus
Bull Dell Fujitsu HP IBM NEC Siemens Stratus
IBMIBM
Sun-SolarisHP-UXIBM-AIXNCR-SVR4
Sun-SolarisHP-UXIBM-AIXNCR-SVR4
Prop.
AS400
WinUNIX
Cluster Win
DowntimeHrs./Syst/Yr
99.999% 99.9% 99.0%
$10K
System Availability99.99%
0.1 101 100
Avg.Syst
Price
$100 K
$1 M
$10 M
z/390
z/390Sysplex
ClusteredUNIX
Clustered LinuxLinux
IMEX©2000-2005 IMEX Research All rights Reserved
Application-Driven Storage Virtualization
Moving from storage associated with
servers...
ApplicationApplicationApplication
...to storage associated with application
processes
New Model Allows applications to move storage from the
virtualized pool, wherever they may be
Old Model Server Hardware is the
initiator. Storage Drives are the Target
IMEX©2000-2005 IMEX Research All rights Reserved
Storage Sub Systems
Application & DB Servers
Clients
SAN
LAN Ntwk Mgmt WS
Storage Mgmt WS
Mgmt WS
Intelligent Uniform IP-based
Infrastructure
Present Data Center Infrastructue Future Infrastructue
Holy Grail - Future Intelligent IP Infrastructure