dsn xstack training das,san,nas nyári egyetem. d-link europe dsn storage array training – march...
Post on 22-Dec-2015
221 Views
Preview:
TRANSCRIPT
DSN xStack Training
DAS,SAN,NAS
Nyári egyetem
D-Link Europe DSN Storage Array Training – March 2010
Evolution of Storage Technology
Direct Attached SCSI
Network Attached Storage Fibre Channel Storage
IP SAN Storage
SCSIFC
EthernetFibre Channel Switch
Ethernet Switch
DAS
NAS
IP-SAN
FC-SAN
AP+File System
RAID
RAID
RAID + File System + AP
File System+ RAID
AP
AP+File System
initiator
target
D-Link Europe DSN Storage Array Training – March 2010
DAS/NAS/SAN I/O Differences
(NFS/CIFS)
Block I/O
Block
D-Link Europe DSN Storage Array Training – March 2010
SAN
Business Critical Applications
Email & Department Level & Remote DatabaseFile / Image & Content Management
Leadership, Management & Customer DatabaseMedical Database Management
Scientific Data Collection
NA
S/SA
N
Working Group Applications
DA
S
Office applications, Department File-Share
EnterpriseMission Critical Applications
D-Link Europe DSN Storage Array Training – March 2010
DAS or Direct Attached Storage is connected directly to a server Data storage devices normally use SCSI/FC technology direct attached to the server Data backup and recovery typically utilize 20-30% of resources (CPU, system, IO, etc.) Good performance characteristics suitable for the SOHO environment Expansion of DAS is problematic
SCSIFC
EMAIL ERP FINANCE
SCSIFC
EMAIL ERP HR FINANCE
Exp
• Creates islands of storage difficult to manage
• Capacity expansion cannot be shared
DAS Applications
D-Link Europe DSN Storage Array Training – March 2010
NAS Applications
NAS or Network Attached Storage connects through a standard Ethernet connection
NAS is typically configured as a file service for servers and workstations
NAS can allocate a shared storage space for different server or workstation
NAS does not perform well in typical block-level applications (transactions, streaming)
EMAIL ERP FINANCE
EMAIL ERP FINANCE
EXP
NAS provides simple means of capacity expansion
D-Link Europe DSN Storage Array Training – March 2010
FC-SAN Applications
FC-SAN or Fiber Channel-Storage Area Network provides high performance shared storage
Provides security features allowing multiple hosts access of the shared storage pool
Provides block-based data access ideally suited for enterprise class applications
FC-SAN is the choice for storage infrastructure by large enterprises and service providers
FC HBAs in each server connect to the FC switch to form the FC-SAN
FC-SAN solutions are expensive, complex and costly to manage
EXPFC SWITCH
MAIL ERP FINANCE
MAILERP
FINANCE
FC SWITCH
MAIL ERP FINANCE
FC-SAN provides centralized expansion and management
FINANCE
HR
MAILERP
D-Link Europe DSN Storage Array Training – March 2010
IP-SAN Applications
IP-SAN or Internet Protocol-Storage Area Network provides shared storage
Use of existing Ethernet infrastructure and server's Ethernet ports lowers costs
Provides block-based storage ideally suited for enterprise applications
Use of the existing network infrastructure means simple, rapid deployment of storage
IP development continues at 10 times the speed of Fibre Channel projecting 40G networks in the next 2-3 years
EXPEthernetSwitch
MAIL ERP FINANCE
ERP
EthernetSwitch
MAIL ERP FINANCEHR
Expansion is very simple and can be integrated into an existing Ethernet network
FINANCE
ERP HR
MAIL FINANCE
D-Link Europe DSN Storage Array Training – March 2010
Evolution of Ethernet
40G
100G
Ethernet has a long history of development from the emergence of Ethernet in 1983 to 10GB-T introduction in 2006Gigabit devices are now the standard with a new generation of 40G/100G Ethernet technology in the next 2 ~ 3 years
D-Link Europe DSN Storage Array Training – March 2010
Storage Architecture Comparison
DAS NAS FC-SAN IP-SAN (iSCSI)
Technology SCSI Ethernet Fiber Ethernet
Performance High Low High High
Disk Utilization
Low, 30% Medium, 60% High, 70% High, 70%
Distance <25M Unlimited 100KM (No Repeater)
Unlimited
Centralized Poor Average Excellent Excellent
Data Sharing Poor Average Excellent Excellent
Scalability Poor Average Excellent Excellent
Backup Complex Average Simple Simple
DR Design Poor Average Excellent Excellent
Security Low Average High High
Management Low Average High Average
TCO Low Average High Average
Apply General Storage Data Share, Backup, Redundancy
Mission Critical Data, Backup, Redundancy
Mission Critical Data, Backup, Redundancy
Markets SMB/SME, SOHO SMB/SME, SOHO SMB/SME SMB/SME
Comparison of all relevant factors in selecting the most appropriate storage architecture.
D-Link Europe DSN Storage Array Training – March 2010
DAS/NAS/SAN Summary
DAS – SMB/SME application, limited flexibility
NAS - focused on shared storage and addressing increasing demand for storage capacity
FC-SAN - focused on scalable storage optimizing data sharing and management
IP-SAN – focused on affordable scalable storage without restrictions
RAID
File System
Application
DAS
SCSI / FC
RAID
File System
Application
NAS
EthernetSwitch
FC-SAN
RAID
File System
Application
FC Switch
IP-SAN
RAID
File System
Application
EthernetSwitch
Ethernet
NFS/CIFS
D-Link Europe DSN Storage Array Training – March 2010
IP-SAN versus FC-SAN
D-Link Europe DSN Storage Array Training – March 2010
Competing Architectures
FC-SAN is highly manageable and deterministic but inflexible
IP-SAN is more flexible with simplified management
D-Link Europe DSN Storage Array Training – March 2010
What is iSCSI?
Internet Small Computer Systems Interface Provides storage access over TCP/IP networks
Maps SCSI functionality to TCP/IP Protocol Similar to mapping SCSI over Fibre Channel (FCP)
Network Protocol–Peer to HTTP, NFS, FTP, Telnet, etc. (uses TCP)
Can be used with existing IP & Ethernet networks–NICs, Switches, Routers, etc.
Reuses networking and storage concepts
D-Link Europe DSN Storage Array Training – March 2010
What is iSCSI ?
iSCSI is a transport for SCSI Commands iSCSI is an End to End protocol iSCSI can be implemented with current TCP/IP Stacks iSCSI can be implemented completely in a HBA iSCSI has the concept of Human readable SCSI Device (Node)
naming iSCSI adds its own CRC checking to ensure correct Data
iSCSI Transport includes Security as a base concept Link Authentication (e.g. CHAP) iSCSI Authentication for Access Control IPSec Packet Security (packet authentication and encryption)
D-Link Europe DSN Storage Array Training – March 2010
What is iSCSI?
iSCSI (Internet SCSI) specifies a way to “encapsulate” SCSI commands in a TCP/IP network connection
D-Link Europe DSN Storage Array Training – March 2010
Generic iSCSI PDU Format
BYTE 01234567
00 -- 03
04 -- 07
20 -- 23
16 -- 19
08 -- 15
01234567 01234567012345673210
Total AHSLength
Logical Unit Number (LUN)
Initiator Task Tag (ITT)
Expected Data Transfer Length
. I Opcode
hex 01F R W 0 0 Reserved
DataSegmentLength
Reserved ATTR
24 -- 27 Command Seq. Num. (CmdSN)
28 -- 31 Expected Status Seq Num. (ExpStatSN)
48 -- 51
or null
Header Digest (if Any) -- CRC32c
48 or 52
to n
Data-Segment (if Any) - Command Data
32 - 47
SCSI Command Descriptor Block (CDB)
n+1 to n+4
Data Digest (if Any) -- CRC32c
D-Link Europe DSN Storage Array Training – March 2010
iSCSI Login
Two types of Login sessions Discovery (SendTargets) Normal (after any discovery mechanism)
Normal login phases Security negotiation Operational parameter negotiation Full Feature (perform I/O)
Login uses text-based parameter negotiation Syntax: key=value (or list of values) Designed for extensibility
D-Link Europe DSN Storage Array Training – March 2010
iSCSI Security
Secure IP connection Integrity, authentication, and confidentiality Based on ESP (component of IPsec)
Authentication Mutual Authentication (CHAP)
Initiator to Target AND vice-versa
Integrity Cryptographic integrity, not just checksum or CRC Linked to authentication to prevent regeneration attack
Authorization iSCSI: Who can connect to which Target LUN masking & mapping handled by SCSI, not iSCSI
D-Link Europe DSN Storage Array Training – March 2010
iSCSI Message TypesProtocol Data Unit (PDU)
Initiator to Target NOP-out SCSI Command
Encapsulates a SCSI CDB
SCSI Task Mgmt Cmd Login Command Text Command
Including SendTargetsUsed for iSCSI Discovery
SCSI data Output Data for Writes
Logout Command
Target to Initiator NOP-in SCSI Response
Can contain status
SCSI Task Mgmt Rsp Login Response Text Response SCSI data
Input Data from Reads Logout Response Ready to Transfer
R2T Async Event
D-Link Europe DSN Storage Array Training – March 2010
iSCSI PDU Sequence
CMD PDU Write
R2T PDU
Data-Out PDU
Data-Out PDU
Cmd Rspse PDU, Status=good
CMD PDU Read
Data-In PDU ,Status=Good
Data-In PDU
CMD PDU Read
Cmd Response PDU , Status=Good
Data-In PDU, Status=Good
CMD PDU Write , Immediate Data
iSCSI
Initiator
iSCSI
Target
D-Link Europe DSN Storage Array Training – March 2010
iSCSI Adapter Options
Copyright 2003 Storage Networking Industry Association. All Rights Reserved.
SCSI Port to OS SCSI Port to OS SCSI Port to OS
Software iSCSISoftware iSCSI
with TCP Off-load
iSCSI and
TCP Off-loadH
ost P
rocessin
g
Media Interface
Ethernet
Media Interface
Ethernet
Media Interface
Ethernet
Ad
apter C
ard
Adapter Driver
TCP/IP
iSCSI
Adapter Driver
TCP/IP
iSCSI
Adapter Driver
TCP/IP
iSCSI
iSCSI with Simple NIC
iSCSI with TOE iSCSI HBA
D-Link Europe DSN Storage Array Training – March 2010
iSCSI Multi-Pathing Mechanisms
Ethernet Link Aggregation or Trunking Link layer (2), below TCP, transparent to iSCSI
Multiple TCP connections In a single iSCSI session Same or different Ethernet ports
Multiple iSCSI sessions Multipathing software (e.g., MPIO) above iSCSI Same or different hardware (e.g., Ethernet) ports
D-Link Europe DSN Storage Array Training – March 2010
Link Aggregation SupportApplication
802.3ad1 8
Direct-attach GbE
2x servers w/2x GbE LAG direct-attach
2x GbE LAG direct-attach w/switch
802.3ad
8x GbE LAG direct-attach w/switch
2 GbE LAG
8 GbE LAG
802.3ad
2x2 GbELAGs
Trunking
DSN-2100
DSN-3200
DSN-5210
DSN-5220
D-Link Europe DSN Storage Array Training – March 2010
Single-Session Multiple Connection per Session
• MC/S load balancing for a passive switch
• MC/S can provide dynamic load balancing
• MC/S can provide one or more paths to
storage
D-Link 8-port configurations maximize multiple
paths
Multiple-Connection SupportMC/S
Operating System support for MPIO, MC/S
AP MC/S1 MC/S AP2
12
C1 C2 C1 C2
MC/S (Multiple connections / session) support is setup on servers and storage at the same time providing incremental increases in available bandwidth.
Connections defined by
IP Address + TCP Port #
D-Link Europe DSN Storage Array Training – March 2010
High-Availability Multi-Path
Multi-path solutions provide fully redundant physical
path components including NIC/adapters, cables and
switches, server and storage devices to create the
logical “path.” If one or more of these components
fail causing a path failure, the MPIO driver will
redirect all I/O to use an alternate path allowing
uninterrupted storage access.
Servers and storage provide
multiple connections
MultiPath(MPIO)
Servers and Storage must support MPIO
Fault tolerance: Upon port or switch failure, IO to the storage can be routed through an alternate path
Fault-tolerant: MPIO will take the initiative to switch to an alternate path
AP MPIO MPIO AP
Load balancing can be provided on LUNs with multiple sessions
Multi-gigabit ports can provide multiple dual-path configuration and/or multiple sessions
MPIO Layer
D-Link Europe DSN Storage Array Training – March 2010
IP-SAN Pros and Cons
For: Runs over existing, ubiquitous Ethernet, TCP/IP fabrics. Internetworking built in Lots of fabric management tools IT folks understand TCP/IP
Against TCP Slow Start impacts I/O latency, throughput Lossy fabrics impact I/O latency through re-transmission and
complicate receive endpoint data placement. Bridging to legacy FC SANs slow/expensive because of TCP
termination overhead.
D-Link Europe DSN Storage Array Training – March 2010
Fibre Channel over Ethernet (FCoE)
Enables interfacing with current FC infrastructure Lossless Ethernet improves Quality of Service Takes advantage of emerging 10G infrastructure and
pervasive Ethernet skill set
D-Link Europe DSN Storage Array Training – March 2010
SCSI Read/Write Example over FC
SCSI Read
Host
FCP_CMND
Target
FCP_DATA
FCP_DATA
FCP_DATA
FCP_RSP
FCP_CMND
Host Target
FCP_XFER_RDY
FCP_DATA
FCP_DATA
FCP_RSP
SCSI Write
FCP_DATA
Unsolicited data(modest amount)
Exchange
Sequence (maybe out of order)
D-Link Europe DSN Storage Array Training – March 2010
FCoE = lossless Ethernet
Switch or Endpoint
Eth
Tx
Switch or Endpoint
Port transmitbuffer
Port receivebuffer
Port receive packet buffer
Eth
Rx
HWM LWM
Outbound PAUSE generator
Eth
Tx
Eth
Rx
Ethernetlink
Port transmitbuffer
Inb
ou
nd
PA
US
E
Inb
ou
nd
PA
US
E
Outbound PAUSE generator
When port receive bufferfills to a high watermark,
issue PAUSE XOFF to linkpeer; when buffer drains to
low watermark, issuePAUSE XON to peer
D-Link Europe DSN Storage Array Training – March 2010
FCoE Pros and Cons
For: Presents new but familiar PHY and Link Layers for FC Core switching discipline remains FC-SW-5 Higher FC layers almost completely unchanged
Against: Lossless fabrics are prone to congestion Ethernet-FC gateways with their different port speeds
are natural bottlenecks Heavy costs associated with:
FCoE or Converged Network Adapters (CNA) Implementing lossless fabric
D-Link Europe DSN Storage Array Training – March 2010
Storage Array Components
D-Link Europe DSN Storage Array Training – March 2010
HDD Interfaces - parallel → serial
SAS (Serial Attached SCSI) is a point-to-point
serial technology supporting full-duplex
operations up to 6Gb/s.
SCSI supports up to 16 devices cascaded at
speeds up to 320MB
ATA (IDE) for desktop computers is a point-to-
point interface. Main disadvantages include
thermal and cable length.
Serial topologies have effectively replaced parallel topologies due to the complexities of eliminating signal cross-talk issues that affect both performance, scalability and reliability.
SATA (Serial ATA) is a point-to-point serial
interface technology supporting half-duplex
operations up to 3Gb/s.
D-Link Europe DSN Storage Array Training – March 2010
HDD Storage Systems Evolution
1986: UC BerkleyRAID Paper
2000: IBM Deskstar, 75GB1999: Maxtor ATA, 10.2GB1991: IBM ThinkPad, 1.2G
IBM #11968: Winchester HDD1956: RAMAC HDD 5M
1979: IBM 3370/2300M1973: IBM 3340/140M
2008
2000
1990
1980
1950
1989/ATA1986/SCSI-1
1983: IBM PC/XTMFM Drives, 10M
1997/Ultra ATA1995/SCSI-31991/SCSI-2
2006/SATA 2.52002/SAS 1.02001/SATA 1.0
2009: SATA 2TB2008: SATA 1TB2006: SAS, 500G2003: SATA, 100G
2003/iSCSI1995/FC
RAMAC PC/XT RAID SCSI-1 ATA FC SATA SAS iSCSI
D-Link Europe DSN Storage Array Training – March 2010
HDD Interface OverviewType ATA SATA SCSI SAS FC
Xmit Type Parallel Serial Parallel Serial Serial
Addressing 2 1or16 (SATA II) 16 128 16M
Distance(M)
1 1 25 10 50km
Speed (MB/s)
100 150, 300, 600 160, 320 150, 300, 600
100, 200, 400, 1000
Ports 90 Pin 7 Pin 68 Pins 7 Pins Copper/Fiber
Dual Port No No NO Yes Yes
Topology Bus P-to-P Bus P-to-P Loop, Switched
Duplex Half Half Half Full Half/Full
Max Conn 2 1 or 15Port Multiplier
16 4096 w/expanders
Loop – 4096Switched - 16M
协议 ATA ATA SCSI SCSI SCSI
SAS
20??
D-Link Europe DSN Storage Array Training – March 2010
Disk Drive Comparison
Read Write Read WriteIO/Sec (4K) MB/Sec (128K)
340
275
123108
155
125 117101
155
93105 104
iStor Performance BenchmarkDisk Drive Baseline - 50% Capacity
ST3300655SS 15K SAS - ST3750630SS 7.2K SAS - ST31000340NS 7.2K SATA
Seagate ST3300655SS Seagate ST3750630SS Seagate ST31000340NS
D-Link Europe DSN Storage Array Training – March 2010
Typical Read/Write Data Path
Host I/F
Memory, I/O Bus
Processor
Cache
Cache
RAIDSystem
Interrupt
HDD
1
2 3 45
6The host transmits data to the target
device. The host interface Ethernet
(TCP/IP) interface decodes and processes
the packet. The layer also handles error
recovery such as re-transmission requests
due to packets errors (CRC, length, etc.)
TCP or iSCSI engine moves data to cache
1
2
Processor decodes SCSI command and
starts operation
Processor Cache mechanisms to start IO
data movement 5
DMA engines used to move data
to/from the cache and HDD
3
4
IO to/from HDD
6
The processor can touch the data several times during the processing of the iSCSI command consuming resources and available bandwidth. TCP/IP offload engines have helped to significantly reduce the bandwidth but processors are still directly involved with the setup of all hardware mechanisms to move the data through the RAID system thereby consuming valuable memory bus bandwidth.
Multiple touches of the data is the primary cause
of poor performance
D-Link Europe DSN Storage Array Training – March 2010
Advanced SoC Technology
Network storage solutions have limited
performance and are comprised of a
motherboard, RAID cards, iSCSI or NICs
and storage virtualization software.
Single-chip SoC technology includes array
processors providing host network interface,
RAID features, HDD control and dual-
channel features in a single chip
The only SoC in the iSCSI storage market
that supports both 1 Gb and 10 Gb networks
that provides a high performance, reliable
and cost effective solution.
D-Link iSCSI IP-SAN Array
D-Link Europe DSN Storage Array Training – March 2010
High Speed SoC Array Processor
iSNP8000
12 processor cores in the
iSNP8000 SoC provides a
parallel computing architecture
with a RAID processing unit for
best in class performance.
Built-in 1GbE and 10GbE
• Highest Gigabit port density
• Direct connect 8-port Gigabit
• No costly switches required
• No costly HBAs
• Simplified SAN structure
High-Speed/Bandwidth Design
Storage / Network Array ProcessorUp to 4GB of system memory for high performance applicationsIndependent high-speed cache and system memory to maximize the overall performance.
D-Link Europe DSN Storage Array Training – March 2010
Redundant Support – Zero Downtime
Active
Passive
10G Link provides
zero latency cache
coherency
Supports Hot-swappable controllers
Active-Passive provides no loss of
performance on hardware failure
Redundant controllers provide the
highest reliability and availability
DSN-5220/DSN-5420 Dual Controllers
The 10G Reflective Memory Channel
(RMC) is a patented high-speed bus
providing low latency cache updates.
Upon a controller failure the surviving
controller will automatically take over
operations for zero downtime and
maximum in data security.
Active-Active双机运作模式下Zero Down Time
D-Link Europe DSN Storage Array Training – March 2010
xStack Virtualization
D-Link Europe DSN Storage Array Training – March 2010
Complete Virtualization
48
Virtualized storage is managed at the Storage Pool level Make QoS decisions at volume
creation Drives consolidated into one
available pool Deploy new volumes efficiently Manage storage resources
strategically Fully utilize storage capacity
Complete Virtualization Includes Servers and Storage
Free Space
RAID 1 Volume 100 GB
RAID 10 Volume 200 GB
RAID 5 Volume 300 GB
RAID 0 Volume 500 GB 450 GB
Virtualization
Virtualization
RAID 5RAID 10
End to End Virtualization
D-Link Europe DSN Storage Array Training – March 2010
Virtual Storage Approach
D-Link Europe DSN Storage Array Training – March 2010
Virtual Storage Benefits
Shared Virtual Pool
Shared Pool
Vol 1
Vol 2
Vol 3 12 disks
Isolated Islands of Storage
6 disks
Unused Storage
Unused Storage
Unused Storage
Vol 1
Vol 2
Vol 3
6 disks
6 disks
Lower Cost Decreased management
requirements Requires fewer disks Less power Uses full capacity of all disks
Higher Performance Optimized RAID level for
each application Volumes can span all disks Greater disk utilization
D-Link Europe DSN Storage Array Training – March 2010
Virtual Storage Benefits
Ability to configure any combination of volume types; no need to make any global decisions up front
Allows all of the available storage capacity to be utilized without any wasted space
No need to pre-allocate drives to a specific storage pool
Ability to reconfigure any volume when needed; you are not locked into anything
All volumes are on-line during any grow or reconfigure operation
D-Link Europe DSN Storage Array Training – March 2010
Easy to Use Management
No RAID group pre-configuration simplifies resource planning Create volumes in seconds Pre-defined applications for volume creation “On the Fly” RAID migration and volume expansion
D-Link Europe DSN Storage Array Training – March 2010
Simple Volume Creation
D-Link Europe DSN Storage Array Training – March 2010
xStack Performance
D-Link Europe DSN Storage Array Training – March 201055
Advanced iSCSI Storage Engine
Eliminates performance bottlenecks of traditional storage architectures Wire rate 10GbE or 8x1GbE High transaction rates and bandwidth H/W TCP/IP, iSCSI & RAID acceleration Performance scales linearly with drive count Utilizes performance capability of SSD drives High Availability support [5 issued patents]
True Storage Virtualization Storage pools provide device independence Supports mixed device technologies: SAS/SATA/SSD
Low Power – 11 Watts Enables high density architectures
D-Link Europe DSN Storage Array Training – March 2010
….
DSN xStack Base Architecture
Redundant Memory Channel
iSNP8000iSNP8000
Management
Processor
Management
Processor
10 GE
PHY
10 GE
PHY
sATA/SAS
Controller
sATA/SAS
Controller
Buffer MemoryBuffer Memory
XGMII Interface
8 x GE
PHY
8 x GE
PHY
OR
RGMII Interfaces
10 Gb/sBackplane
PHY
10 Gb/sBackplane
PHY
XGMII Interface
System MemorySystem Memory
…
….
sATA or SAS
Drives
sATA/SAS
Controller
sATA/SAS
Controller
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Throughput
4 Port 8 Port 10Gb0
200
400
600
800
1000
1200
1400
448
896
1160
Sequential Performance
Jumbo Frame
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack 8-Port Performance
0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M
IO Transfer Size in Byte
4 Volumes
3 Volumes
2 Volumes
1 Volume
RAID-0 Sequential ReadMB/s
0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M
4 Volumes
3 Volumes
2 Volumes
1 Volume
RAID-0 Sequential Write
IO Transfer Size in Byte
IO Transfer Size in Byte
RAID-5 Sequential Write
IO Transfer Size in Byte
MB/s
MB/sRAID-5 Sequential Read
MB/s4 Volumes
3 Volumes
2 Volumes
1 Volume
0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M
MB/s
0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M
4 Volumes3 Volumes2 Volumes
1 Volume
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Transaction Rates
59
28K
84
D-Link Europe DSN Storage Array Training – March 2010
xStack Data Protection Features
D-Link Europe DSN Storage Array Training – March 2010
Non-Redundant RAID Support
JBOD Acronym for “Just a Bunch Of Drives” Stand-alone drive or concatenation of multiple drives (for a volume that is larger than a
single drive) Just provides storage capacity; no data redundancy or performance improvements
Stripe (RAID-0) Data is striped across two or more drives for improved performance (simultaneous I/O
across multiple drives)
Stripe is the same size on all drives
Total capacity is the stripe size times the number of drives
Volume is vulnerable to any drive failure; one drive failure will take the volume off-line
No rebuild is available in the event of a drive failure
D-Link Europe DSN Storage Array Training – March 2010
Redundant RAID Support
Mirror (RAID-1) Data is mirrored across an even number of drives (complete copy)
Depending on which drives fail, a mirrored volume can sustain up to half of drives failing
Provides the maximum data protection, but consumes double the storage capacity
Rebuild will automatically begin onto other available drives (if sufficient capacity exists)
Parity (RAID-5) Similar to RAID-0, but requires one additional disk for parity data
Volume can sustain one drive failure, and it will continue to be available (in reduced mode)
Rebuild will automatically begin onto another drive, if sufficient capacity exists
Stripe-Mirror (RAID-10) Combination of stripe (RAID-0) and mirror (RAID-1)
Depending on which drives fail, a mirrored volume can sustain up to half of drives failing
Provides the maximum data protection and performance
Rebuild will automatically begin onto other available drive(s), if sufficient capacity exists
D-Link Europe DSN Storage Array Training – March 2010
RPV2: RAID Protected Virtual Volume200GB RAID-5
DiskRAID 1
RAID 5
RAID 0
RPV2 automatically allocates 200GB space
Traditional RAID 5 Reconstruction RPV2 rebuild of RAID-5 volume
RAID 1
RAID 5
RAID 0
HDD Failure
Time-consuming reconstruction of entire HDD capacity affecting performance
RPV2 rebuilds only active volumes saving significant time
RAID Protected Virtual Volumes
D-Link Europe DSN Storage Array Training – March 2010
Intelligent Drive Removal (Down Drive)
I need more
Capacity!
SMART Threshold Exceeded
Down Drive
Down drive can be used to move user data from HDD prior to failure avoiding costly volume rebuild
After successful data migration the HDD is automatically removed from service
Volume Micro Rebuild
The HDD may not respond within the timeout period due to media defects.
HDD will automatically revector media defects to
available space of the disk
Down Drive and Micro-Rebuild are proactive features that attempt to avoid time consuming operations that affecting system reliability and performance. These intelligent data protection mechanisms substantially improve system utilization.
Intelligent Data Protection
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Systems Overview
D-Link Europe DSN Storage Array Training – March 2010
D-Link IP-SAN Products
DSN-2100
DSN-3200DSN-3400
DSN-5210DSN-5410DSN-5000
DSN-1100
DSN-5220DSN-5420DSN-520DSN-540
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Systems Overview
High-Performance IP-SAN Systems for the SMB Market DSN-5410: 1 x 10GbE port with 12 SAS or SATA-II drives in a 2U enclosure DSN-5210: 8 x 1GbE port with 12 SAS or SATA-II drives in a 2U enclosure DSN-3400: 1 x 10GbE port with 15 SATA-II drives in a 3U enclosure DSN-3200: 8 x 1GbE port with 15 SATA-II drives in a 3U enclosure DSN-2100: 4 x 1GbE port with 8 SATA-II drives in a 2U enclosure DSN-1100: 4 x 1GbE port with 5 SATA-II drives in a desktop enclosure
iSCSI Connectivity Less costly and much easier to manage than Fibre Channel Gigabit Ethernet infrastructure is readily available in all office buildings Compatible with all major host platforms (Windows, Macintosh, Linux,
VMware, etc.)
Storage Virtualization Ability to allocate volumes from a pool of available storage No pre-configuration or pre-allocation is needed
D-Link Europe DSN Storage Array Training – March 2010
DSN-1100 Physical Characteristics
Rear View
Front View (with door closed) Front View (with door open)
iSCSI Data Ports(4x1GbE ports)
SerialDiagnostic
Port
ManagementEthernet Port(10/100 Mbps)
Power and Fault LED’s
Powerbutton
D-Link Europe DSN Storage Array Training – March 2010
DSN-2100 Physical Characteristics
Rear View
Front View (with bezel) Front View (without bezel)
Hot-SwappableRedundant AC Power
Supplies (2)
iSCSI Data Ports(4x1GbE ports)
Serial Diagnostic Port
ManagementEthernet Port(10/100 Mbps)
Power LED Fault LEDPower LED Fault LED
Power and Reset Switches
D-Link Europe DSN Storage Array Training – March 2010
DSN-3XXX Physical Characteristics
Rear View
Front View (with bezel) Front View (without bezel)
Hot-SwappableRedundant AC Power
Supplies (3)
iSCSI Data Ports(8x1GbE-ports shown)
Serial Diagnostic Port
ManagementEthernet Port(10/100 Mbps)
Power and Reset Switches
Power LED Fault LEDPower LED Fault LED
D-Link Europe DSN Storage Array Training – March 2010
DSN-3XXX Physical Characteristics
Internal View(cover removed for clarity)
Hot-SwappableCooling Fans (3)
Hot-SwappableRedundant AC
Power Supplies (3)
ManagementEthernet Port(10/100 Mbps)
iSCSI Data Ports
D-Link Europe DSN Storage Array Training – March 2010
DSN-5XXX Physical Characteristics
Front View(Primary Array and Expansion Array)
Power, Fault, Ready LED’s
Modular Design and ExpandabilityPrimary Array with 12 drives and one or two RAID controllers
Dual Controllers provide High Availability in the event of a failure on one controllerUp to six (6) Expansion Arrays with 12 drives in each for a maximum of 84 drives
No need to add more RAID controllers as drives are added; performance scales linearly
D-Link Europe DSN Storage Array Training – March 2010
DSN-5XXX Physical Characteristics
Rear View – 8 x 1GbE
Rear View – 1 x 10GbE
Redundant power supplies (2)
Primary ControllerSecondary Controller
EnclosureServicesModule
Redundant power supplies (2)
Primary ControllerSecondary Controller
EnclosureServicesModule
Mute Audio Alarm Button
Mute Audio Alarm Button
D-Link Europe DSN Storage Array Training – March 2010
DSN-5XXX Physical Characteristics
Primary Array Controller(shown with cover removed for clarity)
Management Port(10/100/1000Mbps)
iSCSI Network Ports(8 x 1GbE shown)
SASExpansion
Ports (2)
RS-232 SerialDiagnostic Port
D-Link Europe DSN Storage Array Training – March 2010
DSN-5XXX Physical Characteristics
Expansion Array (rear view)
Primary I/O ModuleSecondary I/O Module
Redundant power supplies
Expansion Array I/O Module
Connection from Primary or Expansion
Array
Connection tonext Expansion
Array
D-Link Europe DSN Storage Array Training – March 2010
DSN-5XXX Redundant Controllers
Active / Passive The primary controller services all system I/O The secondary controller is constantly being updated, so its cache memory is
up-to-date, with no performance degradation A failure on either controller will automatically transfer all network traffic to
the surviving controller, with no interruption to host I/O If the primary controller fails, the secondary controller will send “gratuitous
ARP’s” from all network ports, to redirect host communication to the network ports of the secondary controller
After replacing the failed controller it will automatically boot to return to a fully-redundant state (v2.8 or later)
Firmware updates are automatically applied to both controllers at the same time
A system restart for dual-controller systems will be eliminated in an upcoming firmware version
No performance degradation after a failover occurs All volumes are always accessible, even after a failover
D-Link Europe DSN Storage Array Training – March 2010
Mini-SAS to SAS Cable
SAS to SAS Cable
Mini-SAS to SAS Cable
SAS to SAS CablePrimary Array
Expansion Array #1Expansion Array #2
EXP-1 EXP-0
Primary Controller in Slot # 0
Blank-Off Plate
HOST EXPHOST EXP
Drives12-23
Drives24-35
Drives0-11
Expansion Array #3Expansion Array #4
HOST EXPHOST EXP
Drives36-47
Drives48-59
Expansion Array #5Expansion Array #6
HOST EXPHOST EXP
Drives60-71
Drives72-83
Expansion Array Cabling (single controller)
Blank-Off Plate
Blank-Off Plate
Blank-Off Plate
Blank-Off Plate
Blank-Off Plate
Blank-Off Plate
Single-ControllerSystem
D-Link Europe DSN Storage Array Training – March 2010
Mini-SAS to SAS Cable
SAS to SAS Cable
Mini-SAS to SAS Cable
SAS to SAS CablePrimary Array
Expansion Array #1Expansion Array #2
EXP-1 EXP-0EXP-1 EXP-0
Primary Controller in Slot # 0
Redundant Controller in Slot # 1
HOST EXP HOST EXPHOST EXP HOST EXP
Drives12-23
Drives24-35
Drives0-11
Expansion Array #3Expansion Array #4
HOST EXP HOST EXPHOST EXP HOST EXP
Drives36-47
Drives48-59
Expansion Array #5Expansion Array #6
HOST EXP HOST EXPHOST EXP HOST EXP
Drives60-71
Drives72-83
Expansion Array Cabling (dual controller)Dual-Controller
System
D-Link Europe DSN Storage Array Training – March 2010
Cabling Topology (dual controllers)
IMPORTANT: All network cables must be connected BEFORE a failover occurs
To Host Servers
GbE Switch
To Management Network
Network Switch
D-Link Europe DSN Storage Array Training – March 2010
Cabling Topology (dual controllers)
GbE Switch GbE Switch
Host Server
D-Link Europe DSN Storage Array Training – March 201081
Compatibility
Total adherence to industry standards Certified with leading applications
Choice of data protection applications Use functionality included with operating system
Why this matters Works with existing best-in-class storage system infrastructures Manage advanced functionality with familiar tools
D-Link Europe DSN Storage Array Training – March 2010
OS/ApplicationsOS/ApplicationsConnectivityConnectivity Data ProtectionData Protection
DSN xStack Ecosystem
82
HardwareHardware
D-Link Europe DSN Storage Array Training – March 2010
Green Storage
RoHS = no hazardous substancesISO14001 = pollution control and
improved energy efficiency
D-Link Green Storage
D-Link Green Switches
66W
12WD-Link
Other MFG 150W 300W
Green Setup Green Technology
Smart Enclosures
Green Cooling Requirements
Low Power ConsumptionGreen Supply Chain
D-Link switches require 40% less energy than competitive products
Green Packaging
DSN products save energy with feature/functions that improve overall efficiency
The industry‘s lowest power consumption
Intelligent fan speed control reducing noise in the IT room
WEEE CompliantUse of recyclable package material
Simplified WEB design enables paperless operation
Very low power consumption reduces cooling requirements
and the carbon footprint.
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Management Center
D-Link Europe DSN Storage Array Training – March 2010
Getting Started
Java 6 Run-Time Environment Available from http://java.com
Launch any Internet Browser at the system Default IP address of 192.168.1.1 Requires a host that can communicate on the 192.168.1.x subnet
Startup Wizard Walks you through the first-time system configuration
Password for the Administrative Login (default password of “admin”) Management Port: IP Address, Network Mask and Gateway IP Address IP Address for one or more iSCSI data ports E-mail Notification (SMTP Server IP Address, STMP Server Port Number)
Alternative to the Startup Wizard Connect the RS-232 Serial Cable to the Diagnostic port
9600 bps, 8/N/1, no hardware handshake At the Login prompt, login as “admin” with a password of “admin” Select item “3” to set the out-of-band port configuration Note: This method does not allow you to set the other parameters (network portals, admin password, etc.)
Other Setup Activities Launch Java GUI from Default Web Page Set the system date, time and time-zone
D-Link Europe DSN Storage Array Training – March 2010
Startup WizardDefault IP Address is
192.168.1.1
D-Link Europe DSN Storage Array Training – March 2010
Default Web Page
Click here to launch the
Java GUI
D-Link Europe DSN Storage Array Training – March 2010
Java Management Center
Navigation Pane
Actions Pane
Details Pane
SummaryPane
D-Link Europe DSN Storage Array Training – March 2010
GUI Capabilities
Platform Independent– Runs on Windows, Linux, Solaris, or Macintosh platforms– Just need to install the Java 6 Run-Time Environment
Easy-to-Use– Navigation pane allows you to manage multiple systems with a single GUI– Four views
Volume View: shows all volumes, iSCSI initiators, and active iSCSI sessions/connections Physical Storage View: shows all hard drives System Administration View: shows current hardware and software revisions, Event Log,
etc. Network Settings View: shows the IP addresses, gateways, network masks for the
management port and all iSCSI data ports– Target names are automatically generated by the system– All volumes are presented on all network ports– Controlled access from a single host initiator, several initiators, or all initiators– Optional CHAP password authentication for additional access security
D-Link Europe DSN Storage Array Training – March 2010
GUI Capabilities
Volume Creation Wizard Pre-Defined Recipes -- commonly used applications (e.g., file server,
web server, etc.) Walk Me Through The Choices – selects the volume composition
based on answers to questions about performance and data redundancy expectations
Advanced Mode – allows you to completely define all of the volume characteristics
Down Drive
Provides the ability to systematically move all volumes off of a drive, so it can be gracefully removed from the system
Allows drives to be replaced while the system is running, without ever taking any volumes off-line
Used when replacing a smaller-capacity drive with a larger-capacity drive, or when a drive is reaching the end of its useful life
D-Link Europe DSN Storage Array Training – March 2010
GUI Capabilities
Grow Volume– Allows the capacity of a volume to be increased, while still
maintaining the existing volume composition– The volume remains on-line during the grow operation– Some additional effort will be needed on the host operating
system to increase the size of the file system Reconfigure Volume
Allows you to change the volume composition (including RAID type, drive selections, etc.)
Also allows you to increase the capacity, if desired The volume remains on-line during the reconfiguration process If the volume size was increased, some additional effort will be needed
on the host operating system to increase the size of the file system
D-Link Europe DSN Storage Array Training – March 2010
GUI Capabilities
Allocate Spare Drive Provides the ability to reserve a drive as a “spare” that cannot be
used for creating new volumes Volume rebuilds look for a spare drive of the same technology type
first (v2.7 and later) If no spare drive is allocated, volume rebuilds will look for any other
available capacity Create a Network Portal
Select Network Settings View Add Portal IP Address, Network Mask and Gateway IP Address to a
physical port Grant initiator access to the volume (default is “All Initiators”) Assign a CHAP password to the volume (optional)
D-Link Europe DSN Storage Array Training – March 2010
GUI Capabilities
E-mail Notification and SNMP Traps Provides the ability to send an e-mail message when serious or
failure events occur Requires an external SMTP (Simple Mail Transport Protocol)
server for e-mail notification
Provides the ability to send an SNMP (Simple Network Mgmt Protocol) when serious or failure events occur (v2.7 and later)
Date, Time and Time-Zone Setup You should set these during initial system installation Ability to configure a third-party Time Server (NTP) such as
“time.nist.gov”
D-Link Europe DSN Storage Array Training – March 2010
Host System Configuration
D-Link Europe DSN Storage Array Training – March 2010
LAGs, MCS and MPIO
LAG (Link Aggregation Group) Link Aggregation allows for multiple Ethernet ports to be
combined to form one high-speed logical link to another network device
iStor LAG support is vendor unique so the switch MUST be configured or network errors will occur
Link aggregation works on a connection basis so overall performance will not be realized unless the number of server connections exceeds the number of data ports to the storage
Note: LACP is not supported. Switch must be manually configured
D-Link Europe DSN Storage Array Training – March 2010
LAGs, MCS and MPIO
MCS (Multiple Connections per Session) MCS creates multiple connections within a single iSCSI session to
manage load balancing and path failover The feature is similar to LAGs in that it links multiple Ethernet ports
to form a higher speed link to the network device For increased performance, the Ethernet ports must be on separate
subnets (the round-robin algorithm is normally subnet centric) MCS can improve performance without the need for LAGs in some
configurations MPIO (Multi-Path IO)
MPIO creates two separate sessions to the iSCSI array to manage load balancing and path failover
MPIO provides link redundancy for path failover MPIO can be used in conjunction with LAGs
D-Link Europe DSN Storage Array Training – March 2010
Microsoft iSCSI Initiator Configuration
Latest version is 2.08
Use Persistent Targets to automatically reconnect on reboot
Supports MPIO and MCS: MPIO creates 2 separate sessions to
the iSCSI array to manage load balancing and path failover
MCS creates multiple connections within a single iSCSI session to manage load balancing and path failover
D-Link Europe DSN Storage Array Training – March 2010
iSNS (iSCSI Storage Name Service)
Modeled on Fibre Channel Nameserver Discovery domains (i.e., ability to separate resources)
Scalable discovery and configuration management Asynchronous notification of changes
Initiator retrieves all iSCSI target info from iSNS Rich information repository (e.g., IPsec config info, etc.) Central resource management
D-Link Europe DSN Storage Array Training – March 2010
iSNS Domains
iSNS
iSNS is part of the infrastructure or a specific
management server
Different Discovery Domains
Host A
Host B
Host C
Storage B
Storage A
Host B and C will not discover
Storage A
Host A will not discover Storage B
D-Link Europe DSN Storage Array Training – March 2010
Linux Configuration
After you have installed the open-iscsi Software Initiator you may need to make some modifications
Check the parameters in the Volume Advanced Settings for target volume with the values found in the iscsid.conf file, and make changes to the iscsi.conf file as needed
D-Link Europe DSN Storage Array Training – March 2010
Macintosh Configuration
Third-party iSCSI initiators GlobalSAN
Free iSCSI Initiator from Studio Network Solutions
ATTO Technology Not free…
Easy-to-Use Persistent Target support MCS support for path
redundancy
D-Link Europe DSN Storage Array Training – March 2010
VMware – Basic Configuration
Provides full path redundancy for a 3-server configuration
For the IP-SAN, each ESX Server uses 2 network ports that must be teamed to support path failovers (IP addresses in use must be a single subnet)
The bandwidth between the ESX servers and each switch is 3x the bandwidth between the switch and the storage array
Applications that are heavy in I/O can result in a high usage of processor 0
Significant improvement in performance can be realized by setting the affinity of a Virtual Machine to disallow processor 0
ESX Svr 1
ESX Svr 2
ESX Svr 3
Switch 1
Switch 2
xStackStorageArray
D-Link Europe DSN Storage Array Training – March 2010
VMware - High Bandwidth Configuration
Provides full path redundancy and maximum bandwidth for 3 servers configured with a modest number of VMware LUNs (aka: Volumes)
The ESX Servers Virtual switches and port groups are configured as described in the Basic configuration
The storage controller is configured with 6 Network Portals (IP addresses) on one subnet providing a balanced configuration
ESX Svr 1
ESX Svr 2
ESX Svr 3
Switch 1
Switch 2
xStackStorageArray
D-Link Europe DSN Storage Array Training – March 2010
VMware - LAG Configuration Provides full redundancy, maximum
bandwidth and a balanced network load for a 3-server configuration
The ESX Servers Virtual switches and port groups are configured as described in the Basic configuration
The controller is configured with Link Aggregation Groups (LAGs)
Each LAG has 3 Ethernet Ports and 1 Network Portal (IP address); only one subnet is used
The LAG support is vendor specific so the switch must be manually configured for LAG support, sometimes called “trunking”
ESX Svr 1
ESX Svr 2
ESX Svr 3
Switch 1
Switch 2
xStackStorage
Array
LAG
LAG
D-Link Europe DSN Storage Array Training – March 2010
Best Practice and Troubleshooting
D-Link Europe DSN Storage Array Training – March 2010
IP-SAN Best Practices
Host Servers Use server-class NICs designed for storage applications Use of Jumbo Frames can reduce the overhead on both your servers and
iSCSI targets; for end-to-end support, each device in the network needs to support Jumbo frames including the NIC and Ethernet switches
Network Switches Use non-blocking Ethernet switches and set the negotiated speed on the
switches Enable Flow Control on network switches and NIC/adapters Disable uni-cast storm control on iSCSI ports
D-Link Europe DSN Storage Array Training – March 2010
IP-SAN Best Practices
Network Infrastructure Segregate IP-SAN and LAN traffic
Minimizes congestion and latency Configure additional Paths for High Availability
Use OS MPIO or MCS (multiple connections per session) Additional NICs in the server create additional connections Redundant Ethernet switches for maximum redundancy
Use CAT6 rated cables for GbE Network Infrastructures Use CAT6a or CAT7 for 10Gigabit installations
required for distances > 55 meters
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Best Practices
Save a System Configuration File Allows you to recover the system configuration in the
event of a controller replacement: Network Portals, LAG’s, etc.
System Advanced Settings
Initiator access for all volumes
Avoids having to manually re-enter that information
A new System Configuration File should be saved after making any configuration changes
In the System Administration View, select “Settings” then select “Save”
D-Link Europe DSN Storage Array Training – March 2010
DSN xStack Best Practices
Always operate the system with a fully-charged battery Default behavior will change to “write-thru” mode when the
battery is charging or missing, which results in SLOWER PERFORMANCE (unless you select “Ignore Battery Status”)
Battery may not be fully charged upon initial system installation, so wait for the battery to become fully charged before evaluating performance
Disable Windows Firewall during Firmware Upgrade The system will display a pop-up warning message if the
firewall is enabled
Firewall can be re-enabled after completing the firmware upgrade
D-Link Europe DSN Storage Array Training – March 2010
System Troubleshooting Tools
Save Event History Download the Event Log and other system information from the GUI
Select “Save Event History” from the System Actions pane
Forward the file named EventHistory.log to iStor Technical Support
System Diagnostic Capture Active link on the Default Web Page to download the diagnostic capture from
each controller
Forward the captured file(s) to iStor Technical Support for analysis
256MB NAND Flash memory required Older controllers may only have 128MB
Serial Console Output Any error messages will be helpful
Version 2.7 (and later) will automatically include this information as part of the System Diagnostic Capture
D-Link Europe DSN Storage Array Training – March 2010
System Troubleshooting Tips
Always have the customer save the event history when requesting help Required Information from the Customer:
Product Model Operating system General configuration (NIC, switch) Application
In some cases a capture of the serial console output may be needed to resolve an issue
If customers using LAGs ensure the switch is configured and flow control is enabled Lack of proper switch configuration can result in poor
performance due to packet dropping
D-Link Europe DSN Storage Array Training – March 2010
System Troubleshooting Tips
Use of Jumbo Frames The 4-port and 10G products support 9K frames. The 8-port
products support a 4K frame (remember switch and NIC must also be configured).
Redundant Controllers require a Switch The switch is required for path failover. Management ports from BOTH controllers must be connected
to the network The management ports are not connected internally so therefore
both must be connected to maintain communication on a failover
SATA supported on single controller ONLY Installing a SATA drive in a dual controller system will cause a
‘Fail to Bind’ error on a boot or restart of the system.
D-Link Europe DSN Storage Array Training – March 2010
System Troubleshooting Tips
The customer can ping the management port but cannot display the default web page Have the customer lower the security level of the browser
Have the customer reboot if a volume has gone offline due to a drive failure or drive removal The system updates meta-data on the 1st drive failure to
remove that drive as a volume member The system does not update meta-data when a drive failure
results in a volume offline state A failed drive may stay operational long enough to copy the
data to another volume If the wrong disk is removed causing the volume(s) to go
offline, re-insert the disk and then restart the system.
D-Link Europe DSN Storage Array Training – March 2010
System Troubleshooting Tips
Cannot bring up GUI from remote Host Host maybe on different subnet requiring a gateway IP
address for the management port.
E-mail notification not working Must be able to ping mail server IP address from Management
Port. Can use ‘Test’ button in Management Center
Host doesn’t recognize Volume Maybe due to 2TB limit (Linux/Vmware/XP) Check access controls
Can ping Management port IP address but cannot access GUI Ensure system is ready (Ready/Fault LED)
D-Link Europe DSN Storage Array Training – March 2010
System Troubleshooting Tips
SAN automatic File Sharing File sharing software is required to manage multiple host
access to the same volume (MSCS, Vmware, etc.)
top related