IBM Systems
© 2009 IBM Corporation
IBM Systems Storage DS8700
IBM Systems
Summary - DS8700 (2-way/4 way base frame)242x model 941
I/O Drawers (slightly larger at 5U)
4GB features only (no 2GB/ no ESCON)
Drawers attached via PCI-E switch
New Host Attachment and
Device Adapter features (PCI-E)
Batteries
Power Supplies
P6 (POWER 6) Servers
Feature specified 2-way(#4301)/4-way(#4302)
2-way processor memory size 32GB-128GB
4-way processor memory size 32GB-384GB
4-way required for expansion frame models
HMC – new laptop
Familiar Layout
IBM Systems
DS8700 (4-Way with two expansion frames, Rear view)
�Non-disruptive MES of
first expansion frame
�Capable of being
extended to 5 frames
�Expansion frame with
IO drawers must be
model 94E
�Expansion Frames
without IO drawers can
be either 94E/92E
�Use models 931/932 if
Thin Provisioning or
Remote Pair FlashCopy
is required
941 Base94E/92E Position 2 (#0341) 94E Position 1 (#0340)
IBM Systems
�Hardware changes from
DS8100/DS8300 to the DS8700► IBM Power6-based controller
► PCI Express (PCIe) internal fabric
► New PCIe IO Drawer
► Updated Device Adapter
► Increased cache and NVS size
Agenda
IBM Systems
High Bandwidth, Fault Tolerant InterconnectHigh Bandwidth, Fault Tolerant Interconnect
DS8000 Topology – All Models
SANSAN
Persistent memory
Volatile memoryN-way
SMP
Persistent memory
Volatile memory N-waySMP
RAID
Adapters
RAID
Adapters
Host
Adapters
Host
AdaptersHost
AdaptersHost
AdaptersHost
AdaptersHost
Adapters
Host1Host2 Host3
IBM Systems
DS8300 Architecture Host
…
…
4-way P5 570 2.2GHz
Memory DIMMs
Memory DIMMs
P5
L3 Cache
Memory DIMMs
Memory DIMMs
P5
L3 Cache
4-way P5 570 2.2GHz
Memory DIMMs
Memory DIMMsP5
L3 Cache
Memory DIMMs
Memory DIMMs
P5
L3 Cache
= Updated in DS8700
Server/CPU:
Power5+ IO Fabric:
RIO
IBM Systems
DS8700 Architecture Host
…
…
2/4-way P6 570 4.7Ghz
Memory DIMMs
Memory DIMMs
P6L3 Cache
Memory DIMMs
Memory DIMMs
P6
L3 Cache
2/4-way P6 570 4.7Ghz
Memory DIMMs
Memory DIMMsP6
L3 Cache
Memory DIMMs
Memory DIMMs
P6
L3 Cache
Power6
processor PCIe point to point
connections
PCIe IO
Drawer
IBM Systems
Hardware Changes in the DS8700
Front Rear
v
P6 Servers4.7Ghz 2/4-way
New PCIe IO Host Bay
Advanced Gen2 PCIeHigh Bandwidth IO Fabric
Point to point cables
PCIe Bridged AdaptersNew adapter processor
IBM Systems
Advanced PCIe Internal Component Interconnect
� Performance► Bi-directional, full duplex, low latency
► Symmetrical access to data -> no performance skew
� Reliability: ► Bit error auto-correction with CRC detection
� Industry standard with 800 members in PCIe Special
Interest Group (SIG)
� Millions of lines of firmware support in existence
PCI Express is a interconnect technology designed to
provide universal connectivity for use as a chip-to-chip and chip to adapter card interconnect.
IBM Systems
DS8700 Improvements - Cluster
�Power6 Processor► 4.7 GHz P6 570 CECs
● 941 2-way
– Up to 128 drives
♦ Base rack
● 941 4-way
– Up to 1024 drives
♦ Base rack plus up to 4 expansion frames (94E)
♦ First expansion rack contains additional IO enclosures
�All expansion frames can be added concurrently
�Concurrent upgrade from 2-way to 4-way system
IBM Systems
DS8700 Improvements - Cluster
� Power6 Processor
► 4.7 GHz P6 570 CECs
● 941 2-way
– Up to 128 drives
♦ Base rack
● 941 4-way
– Up to 1024 drives
♦ Base rack plus up to 4 expansion frames (94E)
♦ First expansion rack contains additional IO enclosures
� All expansion frames can be added concurrently
� Concurrent upgrade from 2-way to 4-way system
� Dedicated Ethernet Adapters for TPC-R no longer required / available
IBM Systems
DS8700 Improvements – Device Adapter
�Replace 750FX (0.5 GHz) processor
with the 750GX (1 GHz) processor
�Upgrade to PCIe interface for point-
to-point connection
�Why it matters► Throughput enhancement from PCIe upgrade
► Better performance in IOPS-sensitive workloads
● Enables better utilization of SSD drives
IBM Systems
DS8700 Improvements – Cache and NVS
�Cache options► 941 2-way
● 32GB to 128GB
► 941 4-way
● 32GB to 384GB
�NVS Sizes
(static – based
on cache size)► 1GB – 12GB
1GB32GB
12GB384GB
8GB256GB
4GB128GB
2GB64GB
NVS SizeCache
Size
IBM Systems
DS8700 - Model Reduction from 5 to 2 Non-DisruptiveUpgrade Path
�2 models: 1 A frame (941) and 1 B frame (94E)
�2-way base with 1st I/O tower pair feature standard
�Enables lower entry price by not requiring 2nd I/O tower pair
�2-way – up to 128 drives in base frame
�Add 2nd I/O tower pair feature (can be field added non-disruptively)
�4-way = 2-way base + processor card feature + 2nd I/O tower pair feature
�4-way + 1st expansion frame added concurrently
� 4-way + 1st expansion frame. Add expansion frames to 1024 drives
IBM Systems
DS8700 – Improving on DS8000
� Increase in performance
► Sequential and IOPs vs DS8300
� Improved flexibility
► Additional concurrent hardware upgrade capability
� Simplify and improved DS8000 design
► Simplified adapter card packaging, smaller cables
� Maintain quality of latest generation DS8000
►Minimize changes to higher level code
► Carry forward the same parts and their locations
� Bring forward features and advanced function in DS8000
► Built from DS8000 R4.2 code base
► Remote mirror and copy functions are interoperable
IBM Systems
DS8000 Family Summary
323216Host Adapter Slots
12812864Max Host Adapter Ports
FCPFCPFCPPPRC Fabric
2 TB2 TB2 TBMax LUN Size
Add / DelAdd / DelAdd / DelDynamic Provisioning
32-384GB / 1-12GB32-284GB / 1-8GB16-128GB / 1-4GBCache / NVS
P6 4.7GHz 2 or 4-wayP5 2.2GHz 4-wayP5 2.2GHz 2-wayProcessor
4 Gb FC x 4 portsESCON x 2 ports
4 Gb FC x 4 ports
ESCON x 2 ports
4 Gb FC x 4 ports
Host Adapters
16168DA Slots
512512512Max Logical Paths / CU
2K2K2KMax Process Logins
510510510Max N-Port Logins/Port
64K total64K total64K totalMax Number of LUNs / CKD volumes
717.6 TB717.6 TB173 TBMax Capacity w/450GB DDM
239.2 TB239.2 TB56 TBMax Capacity w/146GB DDM
RAID 5, 6, 10RAID 5, 6, 10RAID 5, 6, 10RAID Types
73, 146 GB73, 146 GB73, 146 GBSSD DDM Types
1 TB1 TB1 TBSATA DDM Types
146, 300, 450 GB146, 300, 450 GB146, 300, 450 GBFC DDM Types
FC-ALFC-ALFC-ALDDM Interface
16-102416-102416-384DDMs
DS8700DS8300DS8100