storage for networking professionals
Post on 05-Apr-2018
228 Views
Preview:
TRANSCRIPT
-
8/2/2019 Storage for Networking Professionals
1/75
Page 1
Storage for Networking Professionals
Presented by
Elaine Silber
Training and Certification Director
Infinity I/Owww.InfinityIO.com
-
8/2/2019 Storage for Networking Professionals
2/75
Page 2Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
SNIA Legal Notice
The material contained in this tutorial is copyrighted by theSNIA.
Member companies and individuals may use this material inpresentations and literature under the following conditions:
Any slide or slides used must be reproduced without modification
The SNIA must be acknowledged as source of any material usedin the body of any document containing material from thesepresentations.
This presentation is a project of the SNIA EducationCommittee.
-
8/2/2019 Storage for Networking Professionals
3/75
Page 3Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Aims and Objectives
This tutorial is intended to be an introduction to
basic storage technologies, techniques andterminology associated with data storage devicesfor networking professionals.
It provides an introduction for industryprofessionals who wish to acquire thesefundamentals of data storage before attendingmore targeted networked storage presentations
-
8/2/2019 Storage for Networking Professionals
4/75
Page 4Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Outcomes
After attending this tutorial you should be able to: Understand basic storage terms and technology and the basic
operation of hard disk drives Identify the components of the SNIA Shared Storage Model
Appreciate how disk drive characteristics impact performance
Describe storage concepts, including LUN mapping, zoning,volume manager and file systems
Describe basic storage protection techniques - RAID
Identify tape storage technologies
Learn Storage connectivity approaches
Understand Tiers of Storage (TOS) as seen from an InformationLife Cycle Management point of view
-
8/2/2019 Storage for Networking Professionals
5/75
Page 5Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Networking vs Storage Language
The Language of Networking The Language of Storage
Data over Distance Data over Time
Information movement Information repository
Configuring and segmentingnetwork topologies
Formatting and partitioning harddisks, Tiers of Storage (TOS)
Hubs, bridges, switches, routers,gateways, NIC (Network InterfaceCard), HBA (Host Bus Adaptor)
JBOD, RAID, Tape driveControllers
Inherently error prone and
acceptable
Designed to maximize correct
delivery. Expect error free.
Client/Server applications Initiator/Target Functions
Email, Web Browsing, File
Management Network Interfaces
Backup, Archive, Mirror, Block
Management I/O interfaces
-
8/2/2019 Storage for Networking Professionals
6/75
Page 6Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Networking vs Storage Language
The Language of Networking The Language of Storage
Speed, Solid State Capacity, Mechanical Movement
Media - Copper, Fiber, Wireless Media Disk, Tape
Bits in packets, CRC error checksevery packet
Bytes in blocks, Parity check everybyte
Buffers and Link transfer rates Kb/s, Mb/s, Gb/s
Cache and Disk/Tape I/O interfacetransfer rates MB/s Throughput
Interconnectivity network and
device latencies bottlenecks
Disk/Tape seek times and
latencies ms, us, nsApplications HTTP, NFS, SMTP
Transport Protocols
(TCP/IP/Ethernet), Fibre Channel
Logical Device Protocols SerialSCSI, FC, IDE/ATA
Physical Protocols Parallel SCSI
-
8/2/2019 Storage for Networking Professionals
7/75
Page 7Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Historical View of Storage/Network
Host-attached storage
Network Administrators saw storage as a black box
Storage Managers saw the network as a cloud
NetworkAdmin
Storage Admin
Database Manager
-
8/2/2019 Storage for Networking Professionals
8/75
Page 8Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Current View of Shared Storage
Storage is a shared resource
Separate from the computer system (host)
Hosts are consumers of storage
-
8/2/2019 Storage for Networking Professionals
9/75
Page 9Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Overall Terminology Confusion
Classic Storage Model
Applications
Host
Disk
array?
Datamover?
Appliance?
JBOD?
Storage Domain:Anything goes?
Network?
-
8/2/2019 Storage for Networking Professionals
10/75
Page 10Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
SNIA Shared Storage Model
File/rec
ord
layer
Block
layer
Storage
Devices
Device
Host
StorageDo
main
Files/DatabasesFiles/Databases
Packing manysmaller things into afew larger ones..
Block LayerBlock Layer
Storage Devices disk drives, tapedrives, solid statedisk
Block
A
ggregation
Network
Applications
Database(dbms)
File system(FS)
Block Aggregation address mapping,concatenation,striping, mirroring
-
8/2/2019 Storage for Networking Professionals
11/75
Page 11
Storage Basics
Disk Physical
Characteristics
-
8/2/2019 Storage for Networking Professionals
12/75
Page 12Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Disk Drives Walk the Same Walk
From a component perspective, all disk drives
are basically the same. A disk platter, usuallycomprising an aluminum or glass substratematerial that is sputter-coated with a
magnetically corrosive media (chromium,ruthenium, etc.), provides a precision surfacearea in which discrete data bits can be written
into a series of tracks.
Jon William Toigo
-
8/2/2019 Storage for Networking Professionals
13/75
Page 13Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
The ABCs of Physical Addressing
Head
Read/write head
Defines a single disk surface
Cylinder
The information that can be accessedon a disk drive by all the heads, withouthaving to seek
Sector A subdivision of a disk surface which is
created during formatting (typically a
512-byte segment)
-
8/2/2019 Storage for Networking Professionals
14/75
Page 14Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
16 Logical Heads
The ABCs of Physical Addressing
Specifications on label:
1416 Cylinders (1416 tracks)
16 Heads
63 SectorsBut 4 Physical Heads
-
8/2/2019 Storage for Networking Professionals
15/75
Page 15Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
The ABCs of Disk Performance
Data transfer time is determined by:
Speed of I/O technology (SCSI, Fibre Channel, etc) Seek time (time for heads to move to a new track)
Latency (time for sector to rotate under heads)
Speed and size of disk drive buffer memory
Whether the demand equals offered load (Can drive keep up with it speed of disk drive vs throughput)
-
8/2/2019 Storage for Networking Professionals
16/75
Page 16
Storage Basics
Storage Interfaces
-
8/2/2019 Storage for Networking Professionals
17/75
Page 17Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Drives Do Not Talk the Same Talk
Drive Interface Parallel IDE/ATA or Serial ATA (sometimes
abbreviated SATA) Integrated Drive Electronics (IDE), AT Attachment (ATA)
Parallel SCSI or SAS (Serial Attached SCSI)
Fibre Channel
-
8/2/2019 Storage for Networking Professionals
18/75
Page 18Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Drives Do Not Talk the Same Talk
Drive Interface Parallel IDE/ATA
lower-cost devices than SCSI,
controller/drive electronics wedded to the drive itself.
IDE standardizes how disk drives are connected to servers
via a ribbon cable and an interface connector on a PC orserver motherboard.
IDE/ATA protocol five+ revisions,
For 10 years now speeds and feeds keeping pace with
speed- and capacity-hungry applications. Little improvement in transfer rate expected in future
Difficult to create arrays with Parallel ATA
-
8/2/2019 Storage for Networking Professionals
19/75
Page 19Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Drives Do Not Talk the Same Talk
Drive InterfaceSerial ATA (sometimes abbreviated SATA)
is a standards-based interface that improves on parallelIDE/ATA
interface transfer rate is 150Mb/s, (compared with parallelATA's 100Mb/s)
That's a 50% increase, particularly useful in applicationswith large data volume requirements, such as videoediting.
First Generation SATA drives not yet more efficient than
Parallel ATA, SATA-2 and SATA-3 - expected transfer rates of 300 and 600
Mb/s Still limited by max speed of PCI bus at 133 Mb/s
-
8/2/2019 Storage for Networking Professionals
20/75
Page 20Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Drives Do Not Talk the Same Talk
Drive Interface Parallel SCSI
Several standards-based iterations, Confusing descriptors Fast, Wide, Ultra Currently, UltraSCSI 3 or Ultra160 SCSI
transfer rates of 160Mb/s
attach up to 16 devices on a single bus. Ultra320 andUltra640 are demonstrated at trade shows
Doubling and quadrupling of transfer rates
No significant improvement in device attachment orcabling distance characteristics. Note Tape Drive speeds do not come close to SCSI bus
speeds which is a good thing in order to keep drives moving
-
8/2/2019 Storage for Networking Professionals
21/75
Page 21Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Drives Do Not Talk the Same Talk
Drive Interface SAS (Serial Attached SCSI)
Greater throughput
Higher device attachment capabilities
Greater cabling distances
http://www.scsita.org/aboutscsi/presentations.html
-
8/2/2019 Storage for Networking Professionals
22/75
Page 22Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Drives Do Not Talk the Same Talk
Reliability
SCSI Drives
Mechanical pieces of a SCSI diskdrive are manufactured with ahigher duty cycle Enterprisedrives, supporting high-
performance transactionprocessing databases, areconstantly being beaten on byrandom seeks.
IDE/ATA drives Considerably lower duty cycles.
For PCs.
CPU Utilization
SCSI & FC drives
Responsibility is split between thehost processor and aspecialized processor on thehard disk assembly for
performing functions such asqueue management.
IDE/ATA drives The electronics in an IDE/ATA
drive rely on the hostprocessor to perform allstorage tasks.
-
8/2/2019 Storage for Networking Professionals
23/75
Page 23
Storage Basics
Protocols
-
8/2/2019 Storage for Networking Professionals
24/75
Page 24Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
SCSI Standards Architecture*
SCSI BlockCommands
(e.g., disk drive)
(SBC, SBC-2)
Reduced BlockCommands
(e.g., disk drive)
(RBC, RBCAM-1)
SCSI StreamCommands
(e.g., tape drive)
(SSC, SSC-2, SSC-3)
SCSI MediaChanger
(e.g., jukebox)
(SMC, SMC-2)
Multi-MediaCommands(e.g., DVD)
(MMC, MMC-2-5)
SCSI EnclosureServices
(SES, SESAM1,
SES-2)
Object BasedStorage Device
(OSD)
ManagementServer Commands
(MSC)
Primary Commands for All Devices(SPC, SPC-2, SPC-3)
SCSI ControllerCommands(e.g., RAID)
(SCC-2)
Device
SpecificCommandSets
Shared Command SetArchitectural Model
SAM
SCSIArchitecturalModel
(OriginallySCSI-3)
SCSI ParallelInterface
(SPI-2-5)
RelatedStandards and
Technical Reports(SDV, PIP, SSM,SSM2 and EPI)
Serial BusProtocol
(SBP-2-3)
IEEE-1394
FibreChannel
Protocol(FCP, FCP-2,
FCP-3)
FibreChannel
(FC)
SSA-SCSI-3Protocol
(SSA-S3P)
SSA-TL2
SSA- PH1 orSSA-PH2
SCSI-RDMAProtocol
(SRP, SRP-2)
InfiniBand TM
iSCSI
Internet
SerialAttached
SCSI(SAS, SAS-
1.1)
TransportProtocols
PhysicalInterfaces
*See TutorialSCSI The Protocol for all Storage Architectures
-
8/2/2019 Storage for Networking Professionals
25/75
Page 25Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
ABCs of SCSI Addressing
Data/Address Bus
Control Signals
Interface Interface InterfaceSCSIRAID
ID6
SCSIRAIDID0
SCSIRAID
ID4
SCSIInitiator
Host BusAdaptor
ID7
LUN 0LUN 1
LUN 2LUN 3
LUN 0LUN 1
LUN 2LUN 3
LUN 0LUN 1
Address = BUS : Target ID : LUN
-
8/2/2019 Storage for Networking Professionals
26/75
Page 26Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
How do you route SCSI?
SCSI isnt a routable protocol so how do you route SCSI?
SCSI-FCPSOF
Payload: SCSI Command in IUPayload: SCSI Command in IUCRC
FCFrameHeader
EOF
FCIP EthernetheaderIP
headerTCP FCIP
Header
SOF
Payload: SCSI Command in IUPayload: SCSI Command in IUCRC
EOF
FCS
FCFrameHeader
Ethernetheader
IPheader
TCP iFCPHeader
SO
F
FCFrame
Header
Payload: SCSI Command in IUPayload: SCSI Command in IUCRC
EO
F
FCS
iFCP
Ethernetheader
IPheader
TCPiSCSI
header Payload: SCSI Command PDUPayload: SCSI Command PDUFCSiSCSI
-
8/2/2019 Storage for Networking Professionals
27/75
Page 27
Storage Basics
Basic Storage Protection
-
8/2/2019 Storage for Networking Professionals
28/75
Page 28Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
RAID Flavors
Why RAID? -Redundant Array of Independent Disk Original work was to get away from large monolithic disks
Better performance with more individual disks and smaller
RAID 1Mirrored Volumes
RAID 0+1Mirrored Array
RAID 4Block-Level Striping with Parity Disk
RAID 5Striping with Distributed Parity
RAID 10Mirrored Striping Array
See Appendix for further definitions
-
8/2/2019 Storage for Networking Professionals
29/75
Page 29Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
RAID Flavors
-
8/2/2019 Storage for Networking Professionals
30/75
Page 30Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Software RAID
Volume management performed by server
Parity computation performed by server increased overhead RAID performance dependent on server performance and CPU load
For simple environments with lower performance and availabilityrequirements
Volume n
Volume,me B
Volume A
SERVER RAID STORAGE
Block A3 Parity 3
Block A2 Block B2
Block A1 Block B1
Block C3
Parity 2
Block C1
Block D3
Block D2
Parity 1
-
8/2/2019 Storage for Networking Professionals
31/75
Page 31Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Hardware RAID
Volume management performed by RAID controller card
Embedded processor in RAID controller to reduce server overhead Parity computation performed by auxiliary processor in controller
Dedicated cache memory increases server write performance
Volume n
Volume,me B
Volume A
SERVER RAID STORAGE
Block A3 Parity 3
Block A2 Block B2
Block A1 Block B1
Block C3
Parity 2
Block C1
Block D3
Block D2
Parity 1
-
8/2/2019 Storage for Networking Professionals
32/75
Page 32Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Future for RAID
A SNIA Technical WorkingGroup (TWG) is currently a
common RAID Disk DataFormat (DDF) Specification
Would allow storing RAIDconfiguration on physical
disks in a DDF by differentvendor implementations ina common format
Why? -- Would enable
data-in-place migrationamong systems fromdifferent vendors.
www.snia.org/tech_activities/ddftwg
-
8/2/2019 Storage for Networking Professionals
33/75
Page 33
Storage Basics
Logical View
of Storage
Physical vs. Logical
-
8/2/2019 Storage for Networking Professionals
34/75
Page 34Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data Presentation Chain
RAID Controller
Phys. Blocks (C/H/S)
FileFile
presents
presents
Application
VolumeFileFile presents
Application
Users Applications
Applications Files SystemRecordstuples tables
File System VolumesMetadata
tables tablespaces
I/O SubsystemVolume Logical Blockspresents
Logical Blocks presents
Disk Drives
RAID Controller presents
-
8/2/2019 Storage for Networking Professionals
35/75
Page 35Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
What the Host Sees
SAN
?JBOD (Just a Bunch of Disks)
Identifying storage volumes (SCSI IDs and LUNs)
Block Access
Wh h H S i h JBOD
-
8/2/2019 Storage for Networking Professionals
36/75
Page 36Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
What the Host Sees with JBOD
Logical Disks Physical Disks
5 x 1GB
SAN 1GB1GB
1GB
1GB
1GB
SCSI LUNs(LogicalUnits)
5 x 1GBHost A
JBODDrive D (2GB)Drive E (500MB)
Drive F (500MB)
SCSI ID 3
SCSI ID 4
SCSI ID 1
SCSI ID 2
SCSI ID 0
LUN 0
LUN 0
LUN 0
LUN 0
LUN 0
Host B
Drive D (1GB)
Drive E (1GB)
Volume Manager HBA (Host Bus Adaptor)Utility
Wh h H S i h RAID
-
8/2/2019 Storage for Networking Professionals
37/75
Page 37Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
What the Host Sees with RAID
Logical Disks
Volume Manager HBA Utility RAID Configuration Utility
SAN3GB
1GB
1GB
Host A
Drive D (3GB)
Host B
Drive D (1GB)
Drive E (1GB)
SCSI LUNs2 x 1GB1 x 3GB
Physical Disks
5 x 1GB
RAID (Redundant Array
of Independent Disks)
SCSI ID 2
SCSI ID 0
SCSI ID 1
LUN 0
LUN 2
LUN 1
LUN 0
LUN 0
St Vi t li ti t W k
-
8/2/2019 Storage for Networking Professionals
38/75
Page 38Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage Virtualization at Work
Logical Disks Physical Disks
10 x 1GB
SAN
3GB
1GB
1GB
Host A
Drive D (5GB)
5GB
4GB
1GB
Virtualized LUNs
1 x 1GB1 x 4GB1 x 5GB
Virtualization Software
MetadataManager
SCSI LUNs4 x 1GB2 x 3GB
RAID
Host B
Drive D (1GB)
Drive E (4GB)RAID
3GB
1GB
1GB
HBA UtilityVolume Manager RAID Configuration Utility
SCSI ID 2
SCSI ID 0
SCSI ID 1
LUN 0
LUN 0
LUN 0
LUN1
LUN 2
LUN0
LUN0
LUN 0
LUN 1
LUN 2
S WYSIWYG? N t
-
8/2/2019 Storage for Networking Professionals
39/75
Page 39Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Summary: WYSIWYG? Not..
What the file systemmakes the userbelieve.
Myfile.doc
Myfile.xls
Myfile.ppt
1
2
1 0 4
5 9
6
8 3 7
1 3
1 2 1 4
1 5
1 1
Volume Manager keeps trackwhere data blocks are writtenReality
-
8/2/2019 Storage for Networking Professionals
40/75
Page 40
Storage Basics
Tape (no less important)
Tape in the
-
8/2/2019 Storage for Networking Professionals
41/75
Page 41Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
p
SNIA Shared Storage Model
File/re
cord
layer
Block
layer
Storage
Devices
Device
Host
Block
Aggregation
Network
Applications
Database(dbms)
File system(FS)
Tape Appl icat ion
(e.g. backup soft w are)
Tapefo
rmat
system
Device
HostNetwork
Extentaggregation
Tape Devices
Tape Media
Why Tape?
-
8/2/2019 Storage for Networking Professionals
42/75
Page 42Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Why Tape?
Speed Faster than disk? Scalability
Real estateGB/sq. ft.
Proven longevity Legal, Archiving Unlike disk, tape media and devices are not co-dependent
Transportableoff-site archiving and storagedisaster recovery Media could be read on compatible tape mechanisms
Mechanism failure does not compromise data Serial access is appropriate for reading and writing long streams
of data (but not for real-time backup) Disk to disk copy in theory, but disk to disk to tape is reality for
backup.
Question If an appliance controls the backup to tapes, can the backup
software read it?
ABCs of Tape Media
-
8/2/2019 Storage for Networking Professionals
43/75
Page 43Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
ABCs of Tape Media
Tape ReelTape Reel
Pinch RollersPinch Rollers
Tape ArmsTape Arms
Read/write headRead/write head
Take-up reelTake-up reel
Read/write headRead/write head
Leader pinLeader pin
Take-up reelTake-up reelTape ReelTape Reel
Media Compatibility
-
8/2/2019 Storage for Networking Professionals
44/75
Page 44Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Media Compatibility
Tape drives and cartridges are typically developedtogether as inseparable technologies:
New tape drives may have the capability to readexisting cartridges made on older drives
Older drives may not have the capability to read the
cartridges written by newer drives
Tape Recording Method
-
8/2/2019 Storage for Networking Professionals
45/75
Page 45Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Tape Recording Method
Data is written to tapes in large contiguous sequentialblocks (variable size)
Access time to a random block on a tape may be longdue to serial recording method:
Some technologies read tape from the middle outreduces
access time by 50% on average Tape can achieve streaming speeds in the range of
5 to 30MB/sec (uncompressed)
Compressed speeds vs uncompressed speeds Compression typically done at tape drive
Compression ratio is dependent on the data type(e.g. BMP vs JPEG format)
Automatic Tape Subsystems
-
8/2/2019 Storage for Networking Professionals
46/75
Page 46Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Automatic Tape Subsystems
Tape Library Tape automation product
Requires host level specialized management software Management path different from data path
Automates media selection and loading
Uses bar code readers to facilitate media management
No tight connection betweentape library and tape drives(unlike tape drives and
tape cartridges)
-
8/2/2019 Storage for Networking Professionals
47/75
Page 47
Storage Basics
Storage Connectivity
Storage Connectivity (DAS)
-
8/2/2019 Storage for Networking Professionals
48/75
Page 48Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage Connectivity (DAS)
Traditional way of implementing storage
Storage is managed by a single host
Other hosts must access the storage through that singlehost, over the LAN
Direct-attached
internal storage
Direct-attached
external storage
Tape device
Direct-attached
external storage
SCSI
Fibre Channel
Storage Connectivity (NAS)
-
8/2/2019 Storage for Networking Professionals
49/75
Page 49Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage Connectivity (NAS)
Provides access to storage over the Network
NAS devices contain a thin server that provides fileservices to other hosts on the LAN using network fileaccess methods
File access
NAS appliance
Storage Connectivity (SAN)
-
8/2/2019 Storage for Networking Professionals
50/75
Page 50Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage Connectivity (SAN)
Servers and stand-alone storage devices, connected bya dedicated network
Any server can be configured to access any storagearray and/or storage to storage access
Servers and storage can scale independently Block level access
Storage
array
Tapedevice
Server
Storage ConnectivityT t T h l i
-
8/2/2019 Storage for Networking Professionals
51/75
Page 51Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Transport TechnologiesParallel SCSI
FibreChannel(Serial)
iSCSI(Serial)
InfiniBand(Serial)
Close integration ofSystem Software andHardware functions
Definable low latencies
In order delivery built into the hardware
Close integration ofSystem Software andHardware functions
Definable low latencies
In order delivery built into the hardware
IP based message passingenvironment
Variable (high) latencies
In-order delivery supportrequired (TCP)
Security and QoS defined
IP based message passingenvironment
Variable (high) latencies
In-order delivery supportrequired (TCP)
Security and QoS defined
Storage Connectivity L Di t
-
8/2/2019 Storage for Networking Professionals
52/75
Page 52Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Long Distance
Long Distance to StorageWhy???
Large campus environment Separate data centers that
need improvedmanageability
Disaster recovery orbusiness continuity
Vendors want todemonstrate unique
features
FC
Short distance
-
8/2/2019 Storage for Networking Professionals
53/75
Page 53Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage Connectivity Long Distance
-
8/2/2019 Storage for Networking Professionals
54/75
Page 54Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Long Distance
Before you go the distance, consider - Applications differ in terms of latency and bandwidth
Application read and write characteristics vary some applications read more data than they write
some write in small data blocks, others large
some have serial activity while others are random Where is caching being done?
in the server, array or application
Storage Connectivity Long Distance
-
8/2/2019 Storage for Networking Professionals
55/75
Page 55Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Long Distance
Before you go the distance, consider - Cross-site replication techniques vary considerably*
Should you mirror the data synchronously, asynchronously orsemi-synchronously?
Should the storage array do the replication, or should theoperating system or application do the replication?
Should a virtualization appliance handle the replication?
Should you make full replicas of data or just snap copies?
Check outSNIA Tutorial:
Data Protectionwith StorageNetworks
Check outSNIA Tutorial:
Data Protectionwith StorageNetworks
Storage ConnectivitySAN Extension Options
-
8/2/2019 Storage for Networking Professionals
56/75
Page 56Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
SAN Extension Options
FCIP over public or private IP (Frame Relay or T1/T3)*
FCIP over SONET/SDH
FC directly over SONET/SDH FC over DWDM or CWDMCheck outSNIA Tutorial:
Metropolitan andWide AreaNetworks
Check outSNIA Tutorial:Metropolitan andWide AreaNetworks
FCIP
SONET
Ethernet/PoS
IP
TCP
FCIP
FC
FC over ATM
SONET
ATM
AAL
FC
DWDM
FC over SONETover DWDM or
CWDM
SONET
FC
FC over SONET
SONET
FC
-
8/2/2019 Storage for Networking Professionals
57/75
Page 57Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
-
8/2/2019 Storage for Networking Professionals
58/75
-
8/2/2019 Storage for Networking Professionals
59/75
Page 59
Storage Basics
New way to look at Storage
Information Life Cycle Management
(ILM) and Tiers of Storage (TOS)
Information Lifecycle
-
8/2/2019 Storage for Networking Professionals
60/75
Page 60Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Information lifecycle: The creation and/or acquisition of the data information comes
into the organization either by being created by one or moreindividuals or by being acquired through e-mails, faxes, letters,phone calls, etc.
The publication of the data some information needs to be
published, either in print form or on a companys intranet or apublic Web site.
The retention and/or removal of the data some information mustbe archived for later use, and some information has a finite
purpose and can be discarded once it has served its purpose oris no longer valuable to the organization.
http://www.webopedia.com/TERM/I/ILM.html
Information LifecycleMANAGEMENT
-
8/2/2019 Storage for Networking Professionals
61/75
Page 61Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
MANAGEMENT
IL Management determining how the information is stored based on
how high of a priority the access of the information hasin the organization at any given moment.
At each stage in the informations lifecycle, the
management infrastructure must determine the bestsoftware, hardware and storage medium required forthe information at that stage, and how those factors
differ as the data move through the lifecycle.Check out
SNIA Tutorial:BusinessContinuityAnd HA
Check outSNIA Tutorial:
BusinessContinuityAnd HA
Tiers of Storage (TOS)
-
8/2/2019 Storage for Networking Professionals
62/75
Page 62Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Hardware driven*
High-end storage SuperRAID Array
Middle tier Raid Array
Low end storage jbod
features, functionality, capacity, I/Ocapabilities, etc
features, functionality, capacity, I/Ocapabilities, etc
*Moving beyond data storage By Ed FrauenheimStaff Writer, CNET News.com
Tiers of Storage (TOS)
-
8/2/2019 Storage for Networking Professionals
63/75
Page 63Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Policy Driven First
How valuable is this information now? What kind of performance do you need now?
Where is the best place for storing it?
What is the lowest cost that meets your requirements?
Secondly What Information needs to be protected and how?
Backup tiers (Primary, secondary, nearline, online, offline)
What is the value of information over time? Migration of data
Case Study Hardware TOS
-
8/2/2019 Storage for Networking Professionals
64/75
Page 64Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Stanford University Information Technology Systems and Services
Feature High- End Mid-Tier Low-EndUptime >99.999%
< 6 min down/year>99.99%< 1 hour down /year
>99.9%< 9 hours down /year
Connectivity FC, SCSI, ESCON,FICON
FC FC
Ports 16 - 96 4 - 8 2
Internal Disks SCSI or FC
(73GB/146GB)
SCSI or FC
(73GB/146GB)
ATA (180GB/250GB)
RAID levels 0, 1,3,5 0,1,3 0,1
Maximum LUNs 20,000 1024 32
Cache Size 16GB 64GB 2GB 16GB 512MB 1GB
Non-DisruptiveUpgrades
Yes Yes Maybe
Upgrade Cost per GB >$120 < $25 < $7
Architecture Monolithic or Modular Modular Modular
-
8/2/2019 Storage for Networking Professionals
65/75
-
8/2/2019 Storage for Networking Professionals
66/75
Page 66
Storage Basics
Audience Poll and Q&A
Audience Poll
-
8/2/2019 Storage for Networking Professionals
67/75
Page 67Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Are you an end user? Reseller?
Vendor?
Do you have networkedstorage in place today?
NAS or SAN?
Do you plan to within 6 or12 months?
Have you attended otherSNIA Tutorials?
At this meeting or otherSNIA event?
Have you been SNIA-
certified? Do you or your staff plan on
taking exam within 6 to 12months?
Q&A / Feedback
-
8/2/2019 Storage for Networking Professionals
68/75
Page 68Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Please send any questions or comments on thispresentation to SNIA:
tut-storagefornetwor@snia.orgM an y t h a n k s t o t h e f o l lo w i n g i n d i v i d u al s
f o r t h e ir c on t r i b u t i o n s t o t h i s t u t o r i al .
SNIA Education Committee
Elaine Silber Infinity I/O Barry Walker Infinity I/O
Bob Lockhart Neoscale SW Worth Microsoft
Brandy Bartyon Medusa Labs Jim Nelson Vixel
Howie Goldstein - HGAI Sam Samuel Infinity I/O
Leroy Budknik Knowledge Transfer Barbara Craig QLogic
John Moores Sandial Systems Ronnie Koch Infinity I/O, Africa
-
8/2/2019 Storage for Networking Professionals
69/75
Page 69
Storage Basics
Appendix
Hidden Slides
RAID 0Striped Volumes
-
8/2/2019 Storage for Networking Professionals
70/75
Page 70Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data blocks written sequentially to each disk in turn
Not really RAID No redundant check data
Single disk failure can result in loss of all data Better performance than single disk access for large files
Good where performance is more important than redundancy
Volume n
Volume B
Volume A
SERVER RAID STORAGE
Block 5 Block 6
Block 3 Block 4
Block 1 Block 2
RAID 1Mirrored Volumes
-
8/2/2019 Storage for Networking Professionals
71/75
Page 71Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data blocks written to both disks at once
100% data redundancy means no data loss
If one disk fails, data can be retrieved from mirrored disk
Requires two disk write operations per block but only one read
Good for small files where security is paramount
Volume n
Volume B
Volume A
SERVER RAID STORAGE
Block 3 Block 3
Block 2 Block 2
Block 1 Block 1=
RAID 0+1Mirrored Array
-
8/2/2019 Storage for Networking Professionals
72/75
Page 72Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data blocks written to each disk in turn then copied to mirrored array
Combines RAID 0 performance with RAID 1 Redundancy
If one disk fails, the array becomes a RAID 0
Limited scalability and double the cost
Volume n
Volume,me B
Volume A
SERVER RAID STORAGE
Block 5 Block 6
Block 3 Block 4
Block 1 Block 2=
Block 5 Block 6
Block 3 Block 4
Block 1 Block 2
RAID 4Block-Level Stripingwith Parity Disk
-
8/2/2019 Storage for Networking Professionals
73/75
Page 73Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data blocks written sequentially to each disk in the array
Similar to RAID 3 but generally performs better because data isaccessed in blocks instead of bytes
Volume n
Volume B
Volume A
SERVER RAID STORAGE
Block A3 Block B3
Block A2 Block B2
Block A1 Block B1
Parity 3
Parity 2
Parity 1
Parity
RAID 5Striping withDistributed Parity
-
8/2/2019 Storage for Networking Professionals
74/75
Page 74Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data blocks written sequentially to each disk in turn
Parity block computed for each row and distributed across all disks
If one disk fails, data can be retrieved using parity blocks
Parity calculation overhead reduces write performance
Good aggregate transfer rate during read
Volume n
Volume,me B
Volume A
SERVER RAID STORAGE
Block A3 Parity 3
Block A2 Block B2
Block A1 Block B1
Block C3
Parity 2
Block C1
Block D3
Block D2
Parity 1
RAID 10Mirrored Striping Array
-
8/2/2019 Storage for Networking Professionals
75/75
Page 75Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Data blocks written sequentially to each mirrored disk array
Combines RAID 0 performance with RAID 1 redundancy
If one disk fails, data can be retrieved from mirrored disk
Parity is not calculated so good write performance
Volume n
Volume,me B
Volume A
SERVER RAID STORAGE
Block 5 Block 5
Block 3 Block 3
Block 1 Block 1=
Block 6 Block 6
Block 4 Block 4
Block 2 Block 2=
top related