ucs system architecture
TRANSCRIPT
-
8/18/2019 UCS System Architecture
1/102
-
8/18/2019 UCS System Architecture
2/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS System Architecture OverviewTommi Salli
BRKCOM1005
-
8/18/2019 UCS System Architecture
3/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Cisco Unified Computing System
S Any ANSI
Mgmt
SAN A Any ANSI T11 Compliant SAN
LAN Any IEEE Compliant LAN
One Logical Chassisto Manage 160 Servers
LAN Connectivity
SAN Connectivity
Multiple Chassis
Blade & Rack Servers
Server Identity Management
Monitoring, Troubleshooting
-
8/18/2019 UCS System Architecture
4/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Cisco UCS Architecture
UCS Manager
XML API Standard APIs
APIs
Fabric Extenders
Compute
UCS Ma
Fabric Interconnects
-
8/18/2019 UCS System Architecture
5/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Unified Management
A Single Unified System
For Blade and Rack Servers
UCS Manager
C-Series RackOptimized Servers
B-SerieSer
Service Profile: HR_App1VNIC1
MAC: 08:00:69:02:01:2EHR_WEB_VLAN (ID=50)
VNIC2MAC: 08:00:69:02:01:2F
HR_DB_VLAN (ID=210)HBA 1 and 2
WWN: 5080020000075740WWN: 5080020000075741
VSAN ID: 12Boot Order: SAN
BIOS Settings:Turbo On
HyperThreading On
• Integral part of UCS system
• Manages all aspects of the UCS
• Single point of management for UCS
• Open API
• Integrated Automation
• Add capacity without complexity
UCS Service ProfileUnified Device Management
Network Policy
Storage Policy
Server Policy
Unified Management
-
8/18/2019 UCS System Architecture
6/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS Benefits
Highest ScaleUnified Fabric
Vir
Ad
Fab
Exte
FaInterc
UCS C-series
UCS B-Series
UnifiedManagement
Industry-leadingcompute without
compromise
Unified Management
HighPerformance
Virtual Networks
-
8/18/2019 UCS System Architecture
7/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS Manager
• Embedded—manages entire UCS Domain
Fabric Interconnect
• 10GE unified fabric switch
Chassis IO Module
• Remote line card
Blade Server Chassis• Flexible bay configurations
Blade and Rack Servers
• x86 industry standard
• Patented extended memory
I/O Adapters
• Choice of multiple adapters
Building Blocks of Cisco UCS
An Integrated System Optimizes Data Center Efficiency
-
8/18/2019 UCS System Architecture
8/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
System Component Connectivity
Compute Chassis
x86 Computer x86 Computer
X
II
x8x8x8x8
B
MGMT
SS
B
X X X X X
CC
A
G G
G G
SAN
G
R
A
G
G G
G
R
G
PM P
SANLAN
Fabric
Interconnect
Fabric
Interconnect
FabricExtender
FabricExtender
Compute Blade
(Half slot)
Adapter
Compute Blade(Full slot)
AdapterAdapter
Fabric Interconnect
‒32 Fixed Unified Ports + 4 or 1 Expansioto a maximum of 48 or 96 Unified Ports
Chassis
‒Upto 8 half width blades or 4 full width b
Fabric Extender
‒Host to uplink traffic engineering
‒Up to 160Gb Flexible bandwidth allocat
Adapter
‒Virtualized adapter for single OS and hysystems
Compute Blade
-
8/18/2019 UCS System Architecture
9/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Wire for Bandwidth, Not Connectivity
• Wire Once Architecture
• All links can be active all the time
• Policy-driven bandwidth allocation
• Virtual interface granularity
20G per Chassis 40G per Chassis 80G per Chassis
-
8/18/2019 UCS System Architecture
10/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects61006200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade ServersDifferent blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter options
Mix adapters within blade
Building Blocks
-
8/18/2019 UCS System Architecture
11/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
• Embedded device manager for family of UCS components
• Enables stateless computing via Service Profiles
• Efficient scale: Same effort for 1 to N blades
• APIs for integration with new and existing data center infrastructure
Unified Computing System Manager
-
8/18/2019 UCS System Architecture
12/102© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS Manager
UCS Manager
GUI Custom Portal or Tools
Systems ManagementSoftware
CLI
Single point of management for UCS sy
components
‒ Adapters, blades, chassis, fabric extende
interconnects
Embedded device manager
‒Discovery, Inventory, Configuration, Moni
Diagnostics, Statistics Collection
‒Coordinated deployment to managed end
APIs for integration with new and existi
center infrastructure
‒SMASH-CLP, IPMI, SNMP
‒XML-based SDK for commercial & custom
implementations
-
8/18/2019 UCS System Architecture
13/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Management Protocols
Call-home
SMASH CLP
Remote KVM
UCS CLI and GU
UCS XML API
CIM XML
IPMI
SNMP
Serial Over LAN
sysl
-
8/18/2019 UCS System Architecture
14/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS Centrale
UCS Manager UCS Manager
Data Center 1
UCS Manager UCS Manager
Data Center 2
UC
Data
Multi-UCS Manager
• Unifies management of multi UCS
domains
• Leverages UCS Manager technology
• Simplify global operations with centralized
inventory, faults, logs, and server consoles
• Delivers global policies, service pr
pools, and templates
• Foundation for high availability, dis
recovery, and workload mobility
• Model based API for large scale
automation
-
8/18/2019 UCS System Architecture
15/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects
61006200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade ServersDifferent blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter options
Mix adapters within blade
Building Blocks
-
8/18/2019 UCS System Architecture
16/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 6248UP Fabric Interconnect
• High Density 48 ports in 1RU• 1Tbps Switching capability
• All ports can be used as uplinks ordownlinks
• All ports can be configured to support either1Gb or 10Gb speeds
• Unified Ports
• 1 Expansion slots
• 2us Latency
• 80 PLUS Gold PSUs
• Backward and forward Compatibility
Feature details
-
8/18/2019 UCS System Architecture
17/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 6296UP Fabric Interconnect
• High Density 96 ports in 2RU• 2Tbps Switching capability
• All ports can be used as uplinks ordownlinks
• All ports can be configured to support either1Gb or 10Gb speeds
• Unified Ports
• 4 Expansion slots
• 2us Latency
• 80 PLUS Gold PSUs
• Backward and forward Compatibility
Feature details
-
8/18/2019 UCS System Architecture
18/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Unified Ports
Dynamic Ports Allocation: Lossless Ethernet or Fibre Channel
Unified Port
Use-cases
Native Fibre Channel
Flexible LAN & storage convergenbased on business needs
Service can be adjusted based on demand for specific traffic
Convert protocol support on the
same port dynamically All ports on UCS 6200 Series
16-port Expansion Module for
6248UP and 6296UP
Lossless Ethernet:
1/10GbE, FCoE, iSCSI, NAS
Benefits
Simplify switch purchase -remove ports ratio guess work
Increase design flexibility
Remove bandwidthbottlenecks
-
8/18/2019 UCS System Architecture
19/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 6200 Expansion Module
UCS-FI-E16UP• 16 “Unified Ports”
• Ports can be configured as eithe
Ethernet or Native FC Ports
• Ethernet operations at 1/10 Gig
Ethernet
• Fibre Channel operations at 8/4
• Uses existing Ethernet SFP+ anCisco 8/4/2G and 4/2/1G FC Op
-
8/18/2019 UCS System Architecture
20/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Unified Port Management
-
8/18/2019 UCS System Architecture
21/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects61006200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade ServersDifferent blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter optionsMix adapters within blade
Building Blocks
-
8/18/2019 UCS System Architecture
22/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 2204XP I/O Module
• Increased uplink bandwidth
• 4 x 10 Gig network-facing ports
• Double the server-facing bandwidth
• 16 x 10 Gig = 4 per half width slot
• Two I/O Modules per chassis
• 40Gbps to a single half-width blade(20Gbps left and right)
• 80Gbps to a full-width blade
• Built in chassis management• Fully managed by UCSM
Feature details
-
8/18/2019 UCS System Architecture
23/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 2208XP I/O Module
• Double the uplink bandwidth
• 8 x 10 Gig network-facing ports
• Quadruple the server-facing bandwidth
• 32 x 10 Gig = 4 per half width slot
• Two I/O Modules per chassis
• 80Gbps to a single half-width blade(40Gbps left and right)
• 160Gbps to a full-width blade
• Built in Chassis Management
• Fully Managed by UCSM
Feature details
-
8/18/2019 UCS System Architecture
24/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects61006200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade ServersDifferent blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter optionsMix adapters within blade
Building Blocks
-
8/18/2019 UCS System Architecture
25/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 5108 Blade Chassis
Chassis
• Up to 8 half slot blades
• Up to 4 full slot blades
• 4x power supplies, N+N grid redundant
• 8x fans included
• 2x UCS 2104 Fabric Extender
• All items hot-pluggable
CS C
-
8/18/2019 UCS System Architecture
26/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
4 to 8 Blades
4 Power
Supplies
6U, 19” Rack
8 Fan Modules
4 Power
Connectors
2 Fabric
Extenders
UCS 5108 Blade Chassis Parts
UCS 5108 Bl d Ch i B k l
-
8/18/2019 UCS System Architecture
27/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Redundant data and management paths
I/O Modules
Blade ConnectorsPSU Connectors
UCS 5108 Blade Chassis Backplane
B ildi Bl k
-
8/18/2019 UCS System Architecture
28/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects6100
6200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade ServersDifferent blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter optionsMix adapters within blade
Building Blocks
Bl d O i
-
8/18/2019 UCS System Architecture
29/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Blade Overview
B22 M3 B200 M3 B250 M2 B420 M3 B230 M2 B
Slots 1 1 2 2 1
CPU E5-2400 E5-2600 Xeon 5600 E5-4600 E7-2800
Cores 16 16 12 32 20
DIMMs 12 24 48 48 32
Max GB 192GB 768GB 384GB 1.5TB 512GB
Disk 2 x 2.5” 2 x 2.5” 2 x 2.5” 4 x 2.5 2 SSD
Raid 0/1 0/1 0/1 0/1/5/10 0/1
mLOM Dual 20Gb Dual 20Gb No Dual 20Gb No
Mezz 1 1 2 2 1
B22 M3 Blade
-
8/18/2019 UCS System Architecture
30/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B22 M3 Blade
2 Socket
Intel E5-2400
12 DIMM slots
Maximum memory speed 1333MHz
2 Internal HDDs
SFF - SAS, SATA and SSD optionsLSI 2002 RAID Controller
Supports RAID 0 and 1
1 Mezzanine card slot
PCIe 3.0 x16 mezzanine connector
mLOM option
B200 M3 Blade
-
8/18/2019 UCS System Architecture
31/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B200 M3 Blade
2 Socket
Intel E5 series CPUs
24 DIMM slots
Maximum memory speed 1600MHz
2 Internal HDDsSFF - SAS, SATA and SSD options
LSI 2004 RAID Controller
Supports RAID 0 and 1
1 Mezzanine card slot
PCIe 3.0 x16 mezzanine connector
mLOM option
B250 M2 Blade
-
8/18/2019 UCS System Architecture
32/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B250 M2 Blade
2 Socket
Intel 55xx and 56xx series CPUs
48 DIMM slots
Maximum memory speed 1333MHz
2 Internal HDDsSFF - SAS, SATA and SSD options
LSI 1064 RAID Controller
Supports RAID 0 and 1
2 Mezzanine card slot
PCIe 2.0 x16 mezzanine connector
B420 M3 Blade
-
8/18/2019 UCS System Architecture
33/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B420 M3 Blade
4 Socket
Intel E5-4600 CPUs
48 DIMM slots
Maximum memory speed 1600MHz
4 Internal HDDsSFF - SAS, SATA and SSD options
LSI 2208R RAID Controller
Supports RAID 0, 1, 5 and 10
2 Mezzanine card slot
PCIe 3.0 x16 mezzanine connector
mLOM option
B230 M2 Blade
-
8/18/2019 UCS System Architecture
34/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B230 M2 Blade
2 Socket
Intel E7 CPUs
32 DIMM slots
Maximum memory speed 1066MHz
2 Internal HDDs
2.5 inch low profile SSD options
LSI 2108 RAID Controller
Supports RAID 0 and 1
1 Mezzanine card slot
PCIe 2.0 x16 mezzanine connector
B440 M2 Blade
-
8/18/2019 UCS System Architecture
35/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B440 M2 Blade
4 Socket
Intel E7 CPUs
32 DIMM slots
Maximum memory speed 1066MHz
4 Internal HDDs
SFF – SAS, SATA and SSD options
LSI 2108 RAID Controller
1GB write cache
Battery Backed cache option
Supports RAID 0, 1, 5 and 6
2 Mezzanine card slot
PCIe 2.0 x16 mezzanine connector
B200 M2 and B250 M2 Blade Server CPU options
-
8/18/2019 UCS System Architecture
36/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B200 M2 and B250 M2 Blade Server CPU options
PID CPU Cores QPI Speed Architecture
Support
1333Mhz
Memory
Speed
N20-X00001 2.93GHz Xeon X5570 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X
N20-X00002 2.53GHz Xeon E5540 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP
N20-X00003 2.26GHz Xeon E5520 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP
N20-X00004 2.26GHz Xeon L5520 60W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP
N20-X00006 2.66GHz Xeon X5550 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X
N20-X00009 2.00GHz Xeon E5504 80W CPU/8MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP
A01-X0100 3.33GHz Xeon X5680 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X
A01-X0102 2.93GHz Xeon X5670 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X
A01-X0105 2.66GHz Xeon X5650 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X
A01-X0106 2.26GHz Xeon L5640 60W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP X
A01-X0107 2.13GHz Xeon L5630 40W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP
A01-X0108 1.86GHz Xeon L5609 40W CPU/12MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP
A01-X0109 2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP
A01-X0111 2.40GHz Xeon E5620 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP
A01-X0113 2.13GHz Xeon E5506 80W CPU/4MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP
A01-X0115 3.46GHz Xeon X5690 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X
A01-X0117 3.06GHz Xeon X5675 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X
A01-X0120 2.53GHz Xeon E5649 80W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP x
A01-X0123 2.13GHz Xeon E5606 80W CPU/8MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP
B200 M3 Blade Server CPU options
-
8/18/2019 UCS System Architecture
37/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
B200 M3 Blade Server CPU options
PID CPU Cores QPI Speed Architecture
Support
1600Mhz
Memory
Speed
UCS-CPU-E5-2690 2.90 GHz E5-2690/135W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X
UCS-CPU-E5-2680 2.70 GHz E5-2680 130W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x
UCS-CPU-E5-2665 2.40 GHz E5-2665/115W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x
UCS-CPU-E5-2650 2.00 GHz E5-2650/95W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x
UCS-CPU-E5-2640 2.50 GHz E5-2640/95W 6C/15MB Cache/DDR3 1333MHz 6 7.2 GT/s Xeon E5
UCS-CPU-E5-2620 2.00 GHz E5-2620/95W 6C/15MB Cache/DDR3 1333MHz 6 7.2 GT/s Xeon E5
UCS-CPU-E5-2643 3.30 GHz E5-2643/130W 4C/10MB Cache/DDR3 1600MHz 4 8 GT/s Xeon E5 X
UCS-CPU-E5-2660 2.20 GHz E5-2660/95W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X
-
8/18/2019 UCS System Architecture
38/102
Drives Supported
-
8/18/2019 UCS System Architecture
39/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Drives Supported
B200 B250 B230 B440146GB 6Gb SAS 15K X X X
300GB 6Gb SAS 15k X X X
300GB 6Gb SAS 10k X X X
600GB 6Gb SAS 10k X X X
900GB 6Gb SAS 10k X X X
500GB SATA 7.2k X
1TB SATA 7.2k X
100GB SATA SSD
X X X200GB SATA SSD X
100GB Low Height 7mm
SATA SSDX
200GB Low Height 7mm SATA
SSDX
300GB Low Height 7mm SATA
SSDX
Building Blocks
-
8/18/2019 UCS System Architecture
40/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects61006200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade ServersDifferent blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter optionsMix adapters within blade
Building Blocks
-
8/18/2019 UCS System Architecture
41/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
C22 M3 C24 M3 C220 M3 C240 M3 C260 M2 C420
RU 1 2 1 2 2 2
Cores 16 16 16 16 20 3
DIMMs 12 12 16 24 64 4
Max GB 192GB* 192GB* 512GB 768GB 1TB 1,5
Disk8 x 2.5” or
4 x 3.5”
24 x 2.5” or
12 x 3.5”
8 x 2.5” or
4 x 3.5”
24 x 2.5” or
12 x 3.5”
16 x 2.5” or 32 x
SSD16 x
LoM 2 x 1Gb 2 x 1Gb 2 x 1Gb 4 x 1Gb2 x 1Gb + 2 x
10Gb2 x 1
PCIe Slots2 x PCIe
3.0
5 x PCIe
3.0
2 x PCIe
3.0
5 x PCIe
3.06 x PCIe 2.0 6 x PC
Internal
StorageUSB Port USB Port
USB Port
FlexFlash
USB Port
FlexFlash
USB Port
FlexFlash
USB
FlexF
*384GB w/ 32GB DIMMs
-
8/18/2019 UCS System Architecture
42/102
C200 M2 Rack Server
-
8/18/2019 UCS System Architecture
43/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
2 Socket
Intel 55xx and 56xx CPUs
12 DIMM slots
Maximum memory speed 1333MHz
4 3.5” or 8 2.5” Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
Built in Intel ICH10 SW RaidSupports RAID 0, 1, 5 and 10
650W PSUs
2 PCIe slots
Height 1RU
Integrated CIMC and KVM
UCS C200 M2
-
8/18/2019 UCS System Architecture
44/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
PSUs VGA, Serial, USB and
Management LAN
Internal LAN
DVD Power button, Status LEDs and KVM connector
Internal HDDs
UCS C200 M2
-
8/18/2019 UCS System Architecture
45/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS C200 M2
-
8/18/2019 UCS System Architecture
46/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
IOH
Slot A
Slot B
X8
X16
½ Height
½ Length
Full Height
½ Length
SLOT
ASLOT
B
C210 M2 Rack Server
-
8/18/2019 UCS System Architecture
47/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
2 Socket
Intel 55xx and 56xx CPUs
12 DIMM slots
Maximum memory speed 1333MHz
16 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
Built in Intel ICH10 SW Raid
Supports RAID 0, 1, 5 and 10650W PSUs
5 PCIe slots
Height 2RU
Integrated CIMC and KVM
UCS C210 M2
-
8/18/2019 UCS System Architecture
48/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
PSUs VGA, Serial, USB and
Management LANInternal LAN
UCS C210 M2
-
8/18/2019 UCS System Architecture
49/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS C210 M2
-
8/18/2019 UCS System Architecture
50/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
IOH
PCIeSwitch
Slot A
Slot B
Slot C
Slot D
Slot E
X8
X8
x8
x8
x8
x8
SLOT A
SLOT B
SLOT C
SLOT D
SLOT E
Full Height
½ Length
Full Height
½ Length
Full Height
½ Length
Full Height
Full Length
Full HeightFull Length
C220 M3 Rack Server
-
8/18/2019 UCS System Architecture
51/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
2 Socket
Intel E5-2600
16 DIMM slots
Maximum memory speed 1600MHz
8 or 4 Internal HDDs
SFF and 3.5” – SAS, SATA and SSD options
Battery Backed cache option650W PSUs – Platinum Rated
2 PCIe slots
Height 1RU
Integrated CIMC and KVM
C220 M3
-
8/18/2019 UCS System Architecture
52/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
PSUsVGA Serial and CIMC
interfaces
Integrated 1Gb LOM
Intel i350
USB
C220 M3
-
8/18/2019 UCS System Architecture
53/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
C220 M3
-
8/18/2019 UCS System Architecture
54/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
CPU
#1
CPU
#2
PCIe 3.0 x16 Slot A – Full height, ½ length
PCIe 3.0 x8 Slot B – ½ height, ½ length
PCIe 3.0 x8 RAID Mezz
SLOT ASLOT B
C240 M3 Rack Server
-
8/18/2019 UCS System Architecture
55/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
2 Socket
Intel E5-2600
24 DIMM slots
Maximum memory speed 1600MHz
24 or 12 Internal HDDs
SFF and 3.5” – SAS, SATA and SSD options
Battery Backed cache option650W and 1200W PSUs – Platinum Rated
5 PCIe slots – GPU ready
Height 2RU
Integrated CIMC and KVM
C240 M3
-
8/18/2019 UCS System Architecture
56/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
PSUs VGA, Serial, USB and
Management LANIntegrated 1Gb LOM
Intel i350
C240 M3
-
8/18/2019 UCS System Architecture
57/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
C240 M3
-
8/18/2019 UCS System Architecture
58/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
CPU
#1
CPU
#2
PCIe 3.0 x8 Slot C – Full height, ½ Length
PCIe 3.0 x8 Slot D – ½ height, ¾ length
PCIe 3.0 x8 RAID Mezz
PCIe 3.0 x8 Slot A – Full height, ½ Length
PCIe 3.0 x16 Slot B – Full height, ½ Length
PCIe 3.0 x16 Slot E – Full height, ¾ length, GPU ready
SLOT A
SLOT B
SLOT C
SLOT DSLOT E
C250 M2 Rack Server
-
8/18/2019 UCS System Architecture
59/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
2 Socket
Intel 55xx and 56xx CPUs
48 DIMM slots
Maximum memory speed 1333MHz
8 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option850W PSUs
5 PCIe slots
Height 2RU
Integrated CIMC and KVM
UCS C250 M2
PSUs
-
8/18/2019 UCS System Architecture
60/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Internal LANVGA, Serial and USB Manag
ports
Hot Pluggable FANs
UCS C250 M2
-
8/18/2019 UCS System Architecture
61/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS C250 M2
-
8/18/2019 UCS System Architecture
62/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
IOH
PCIeSwitch
PCIe
Switch
Slot D
Slot E
Slot A
Slot B
Slot C
x16
x8
x8
x16
x8
x8
x8
Slot A
Slot E
Slot DSlot B
Slot C
Full Height
½ Length
Full Height
½ Length
½ Height
½ Length
½ Height
½ Length
½ Height½ Length
C260 M2 Rack Server
-
8/18/2019 UCS System Architecture
63/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
2 Socket
Intel E7 CPUs
32 or 64 DIMM slots
Maximum memory speed 1066MHz
16 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option1200W PSUs
Internal Flash Storage
6 PCIe slots
Height 2RU
Integrated CIMC and KVM
UCS C260 M2
-
8/18/2019 UCS System Architecture
64/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
ManagemeInternal LANFlex LOM
UCS C260 M2
-
8/18/2019 UCS System Architecture
65/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS C260 M2
-
8/18/2019 UCS System Architecture
66/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
CPU
#1
CPU
#2
IOH
#1
IOH
#2
x16
x8
x8
x8
x8
x4
x16
Raiser A
Raiser B
Slot A
Slot B
Slot C
Slot D
Flex LOM
½ Height
½ Length
½ Height
½ Length
½ Height
½ Length
½ Height
½ Length
Full Height
½ Length
Full Height
½ Length
S
L
O
T
A
S
L
O
T
B
S
L
O
T
C
S
L
O
T
D
F
L
E
X
L
O
M
RAISER ARAISER B
C460 M2 Rack Server
-
8/18/2019 UCS System Architecture
67/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
4 Socket
Intel E7 CPUs
64 DIMM slots
Maximum memory speed 1066MHz
12 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option850W PSUs
Internal Flash Storage
10 PCIe slots
Height 4RU
Integrated CIMC and KVM
UCS C460 M2
-
8/18/2019 UCS System Architecture
68/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Management ports
Internal LAN
Internal 10GbE LAN Base-T and SFP
UCS C460 M2
-
8/18/2019 UCS System Architecture
69/102
© 2013 Cisco and/or its affiliates All rights reservedBRKCOM-1005 Cisco Public
-
8/18/2019 UCS System Architecture
70/102
UCS C460 M2
-
8/18/2019 UCS System Architecture
71/102
© 2013 Cisco and/or its affiliates All rights reservedBRKCOM-1005 Cisco Public
S A S
R i s e r
S l o t # 1
S l o t # 2
S l o t # 3
S l o t # 4
S l o t # 5
S l o t # 6
S l o t # 7
S l o t # 8
S l o t # 9
S l o t # 1 0
C200, C210 and C250 Rack Server CPU options
-
8/18/2019 UCS System Architecture
72/102
© 2013 Cisco and/or its affiliates All rights reservedBRKCOM-1005 Cisco Public
PID CPU Cores QPI Speed Architecture
Support
1333Mhz
Memory
Speed
C200 C210
N20-X00001 2.93GHz Xeon X5570 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X Yes Yes
N20-X00002 2.53GHz Xeon E5540 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP Yes Yes
N20-X00003 2.26GHz Xeon E5520 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP Yes Yes
N20-X00004 2.26GHz Xeon L5520 60W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP Yes Yes
N20-X00006 2.66GHz Xeon X5550 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X Yes Yes
N20-X00009 2.00GHz Xeon E5504 80W CPU/8MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP Yes Yes
A01-X0100 3.33GHz Xeon X5680 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X No No
A01-X0102 2.93GHz Xeon X5670 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X Yes Yes
A01-X0105 2.66GHz Xeon X5650 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X Yes Yes
A01-X0106 2.26GHz Xeon L5640 60W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP X Yes Yes
A01-X0107 2.13GHz Xeon L5630 40W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP Yes Yes
A01-X0108 1.86GHz Xeon L5609 40W CPU/12MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP Yes Yes
A01-X0109 2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP Yes Yes
A01-X0111 2.40GHz Xeon E5620 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP Yes Yes
A01-X0113 2.13GHz Xeon E5506 80W CPU/4MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP Yes Yes
A01-X0115 3.46GHz Xeon X5690 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X No No
A01-X0117 3.06GHz Xeon X5675 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X Yes Yes
A01-X0120 2.53GHz Xeon E5649 80W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP x Yes Yes
A01-X0123 2.13GHz Xeon E5606 80W CPU/8MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP Yes Yes
C220 and C240 Rack Server CPU Options
-
8/18/2019 UCS System Architecture
73/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
PID CPU Cores QPI Speed Architecture
Support
1600Mhz
Memory
Speed
C220 C240
UCS-CPU-E5-2690 2.90 GHz E5-2690/135W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X Yes Yes
UCS-CPU-E5-2680 2.70 GHz E5-2680 130W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x Yes Yes
UCS-CPU-E5-2665 2.40 GHz E5-2665/115W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x Yes Yes
UCS-CPU-E5-2650 2.00 GHz E5-2650/95W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x Yes Yes
UCS-CPU-E5-2640 2.50 GHz E5-2640/95W 6C/15MB Cache/DDR3 1333MHz 6 6.4 GT/s Xeon E5 Yes Yes
UCS-CPU-E5-2630 2.30 GHz E5-2630/95W 6C/15MB Cache/DDR3 1333MHz 6 4.8 GT/s Xeon E5 Yes Yes
UCS-CPU-E5-2620 2.00 GHz E5-2620/95W 6C/15MB Cache/DDR3 1333MHz 6 Xeon E5 Yes Yes
UCS-CPU-E5-2609 2.4 GHz E5-2609/80W 4C/10MB Cache/DDR3 1066MHz 4 Xeon E5 Yes Yes
UCS-CPU-E5-2643 3.30 GHz E5-2643/130W 4C/10MB Cache/DDR3 1600MHz 4 8 GT/s Xeon E5 X Yes Yes
UCS-CPU-E5-2650L 1.8GHz E5-2650L/70W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X Yes Yes
UCS-CPU-E5-2630L 2.00 GHz E5-2630L/60W 6C/15MB Cache/DDR3 1333MHz 6 Xeon E5 Yes Yes
C260 and C460 Rack Server CPU options
-
8/18/2019 UCS System Architecture
74/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
PID CPU Cores QPI Speed Architecture B440M1 C260M2 C460M2
A01-X0200 2.26GHz Xeon X7560 130W CPU/24MB cache 8 6.4 GT/s Nehalem-EX Yes No No
A01-X0201 2.00GHz Xeon X7550 130W CPU/18MB cache 8 6.4 GT/s Nehalem-EX Yes No No
A01-X0206 1.86GHz Xeon L7555 95W CPU/24MB cache 8 5.8 GT/s Nehalem-EX Yes No No
A01-X0202 2.67GHz Xeon X7542 130W CPU/18MB cache 8 5.8 GT/s Nehalem-EX Yes No No
A01-X0203 2.00GHz Xeon E7540 105W CPU/18MB cache 6 6.4 GT/s Nehalem-EX Yes No No
A01-X0209 1.86GHz Xeon E7520 95W CPU/18MB cache 4 4.8 GT/s Nehalem-EX Yes No No
UCS-CPU-E748702.4 GHz E7-4870 130W 10C CPU / 30M Cache 10 6.4 GT/s Westmere EX No No Yes
UCS-CPU-E748602.26 GHZ E7-4860 130W 10C CPU / 24M Cache 10 6.4 GT/s Westmere EX No No Yes
UCS-CPU-E748502 GHz E7-4850 130W 10C CPU / 24M Cache 10 6.4 GT/s Westmere EX No No Yes
UCS-CPU-E748302.13 GHz E7-4830 105W 8C CPU / 24M Cache 8 6.4 GT/s Westmere EX No No Yes
UCS-CPU-E748071.86 GHz E7-4807 95W 6c CPU / 18m Cache 6 4.8 GT/s Westmere EX No No Yes
UCS-CPU-E72870 2.4 GHz E7-2870 130W 10C / 30M Cache 10 6.4 GT/s Westmere EX No Yes No
UCS-CPU-E72860 2.26 GHz E7-2860 130W 10C / 24M Cache 10 6.4 GT/s Westmere EX No Yes No
UCS-CPU-E72850 2 GHz E7-2850 130W 10C /24M Cache 10 6.4 GT/s Westmere EX No Yes No
UCS-CPU-E72830 2.13 GHz E7-2830 105W 8C / 24M Cache 8 6.4 GT/s Westmere EX No Yes No
UCS-CPU-E72803 1.73 GHz E7-2803 105W 6C / 18M Cache 6 4.8 GT/s Westmere EX No Yes No
UCS-CPU-E78867L 2.13 GHz E7-8867L 105W 10C / 30M Cache 10 6.4 GT/s Westmere EX No Yes Yes
UCS-CPU-E78837 2.67 GHz E7-8837 130W 8C / 30M Cache 8 6.4 GT/s Westmere EX No No Yes
Rack Mount RAID Controllers
-
8/18/2019 UCS System Architecture
75/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Max # drives SAS or
SATA RAID BBC C200 C210 C220 C240 C250 C260
ICH10 4 SATA SW 0 and 1 x x
LSI 1064 4 SAS/SATA HW 0 and 1 x x
LSI 3081E 8 SAS/SATA HW 0 and 1 x
LSI 9240-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60
LSI 9260-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x x
LSI 9261-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x x x x
LSI 9280-4i4e 4 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x x
LSI 2008-8i 8 SAS/SATA HW 0, 1, 5, 10 and 50 X X
LSI 9266-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x X X
UCS M
Building Blocks
-
8/18/2019 UCS System Architecture
76/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS ManagerEmbedded in Fabric Interconnect
UCS Fabric Interconnects61006200
UCS Fabric ExtendersLogically part of Fabric InterconnectInserts into Blade Enclosure
UCS Blade Server ChassisFlexible bay configurationsLogically part of Fabric Interconnect
UCS Blade Servers
Different blade typesMix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS AdaptersThree adapter optionsMix adapters within blade
Hi h P f 10Gb
Adapters for B-Series M72KR-Q
-
8/18/2019 UCS System Architecture
77/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
High Performance 10Gbps per maximum throughput for high bSAN and LAN traffic
Full hardware offload for FCoE processing
250,000 IOPS per port deliver h
Up to 8Gb FC throughput
Full support for TCP/IP and Ethwith enhancements
Priority-based Flow Control (80
Jumbo frames
Checksum offloads
Segmentation offloads
Common driver for CNAs and H
Low power ~ 5W
-
8/18/2019 UCS System Architecture
78/102
-
8/18/2019 UCS System Architecture
79/102
I/O Adapters for B-Series M51KR-B
-
8/18/2019 UCS System Architecture
80/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Broadcom NetXtreme II 57711Port 10 Gigabit Ethernet PCIe
x8 PCI Express base specificav2.0 and v1.1
iSCSI offload
Virtual LANs (VLANs), IEEE 8
IEEE 802.3x flow control
TCP, IP, UDP checksum offloasegmentation
iSCSI Boot capable
UCS 1280 VIC
C t b fit
-
8/18/2019 UCS System Architecture
81/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
• Dual 4x10 Gbps port-channel to a single slot
• Host connectivity PCIe Gen2 x6
• HW Capable of 256 PCIe devices
• OS restriction apply
• PCIe virtualization OS independent
• Single OS driver image for both VICs
• FabricFailover supported
• No user configuration required for 4x10Gb portchannel
• Not limited to 10Gig bandwidth per vNIC
• Flows from each vNIC can be load balanced
80 Gb I/O connectivity per adapter
VM-FEX scale to 116 VM
Customer benefits
Feature details
3rd Party Adapters for UCS C-Series
-
8/18/2019 UCS System Architecture
82/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
I/0 Adapters:
N2XX-ABPCI02 - Broadcom BCM57711, 10 GbE Dual Port NIC (TwinAx Cable Only)
N2XX-ABPCI03 - Broadcom BCM5709, GbE Quad Port GE NIC
N2XX-ABPCI01 - Broadcom BCM5709, GbE Dual Port GE NIC
UCSC-PCIE-BSFP - Broadcom BCM57712, 10GbE Dual Port NIC
N2XX-AEPCI01 - Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)
N2XX-AEPCI03 - Emulex LPE 11002 4Gb Dual Channel FC HBA
N2XX-AEPCI05 - Emulex Lpe 12002 8Gb Dual Port FC HBA
N2XX-AIPCI01 - Intel Ethernet X520 10GbE Dual Port Server Adapter (TwinAx Cable Only)
N2XX-AIPCI02 - Intel Quad Port GE NIC
N2XX-AQPCI01 - Qlogic QLE 8152 (FCoE) 10 Gb 2-port CNA (TwinAx Cable Only)
N2XX-AQPCI03 - Qlogic 2462 4Gb Dual-Channel FC HBA
-
8/18/2019 UCS System Architecture
83/102
Connectivity
UCS FI Operating Modes
-
8/18/2019 UCS System Architecture
84/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
• External LAN sees UCS 6100 as an end-host
with multiple adapters (no STP)
• Active/Active use of uplinks by pinning
• Single upstream L2 domain
• More scalable than switch mode
• External LAN sees UCS 6100 as a tradi
Ethernet switch (STP = PVST+)
• Some uplinks blocked by STP (no pinn
• Single or disjoint L2 domains
• MAC learning on uplink/server interfa
End Host Switch
UCS Ethernet Connectivity
-
8/18/2019 UCS System Architecture
85/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
appliance
monitor
LANIP Storage FCoE Storage
UCS 6100 UCS 6100
Nexus 2248Nexus 2248
storage targetuplinks
Port Types Vs. FI Operating Mode
-
8/18/2019 UCS System Architecture
86/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
From Chassis to Fabric Interconnect
-
8/18/2019 UCS System Architecture
87/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 2104
10Gb Mezz
IOH
CPU CPU
x16 Gen 2
x16 Gen 2
Mezz
Server Blade
Midplane
IO ModulesUCS 2104
SFP+ ModuleFabric
InterconnectsSFP+ Module
IO Module to 61XXBlades pinned to uplink baseOn Slot number
Blade Chassis
(UCS 61XX)
From Chassis to Fabric Interconnect - New
-
8/18/2019 UCS System Architecture
88/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS 2208
UCS 1280
IOH
CPU CPU
x16 Gen 2
x16 Gen 2
Mezz
Server Blade
Midplane
IO ModulesUCS 2208
16x
SFP+
16x
SFP+ModuleFabric
Interconnects
16x
SFP+
16x
SFP+Module
4x10 Gbps Ether channel from VIC-2 to 2208 IO M No user configuration required
vNIC flows are 5-tuple LB across links
Each individual flow limited to 10Gb
Fabric Failover available
IO Module to 6248 links userconfiguration Ether channel
Blade Chassis
(UCS 6248)
(UCS 2208)
(UCS 1280)
UCS Connectivity Summary
LAN
http://www.emc.com/products/detail/hardware/celerra-ns960.htm
-
8/18/2019 UCS System Architecture
89/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
SAN Switch
LAN Switch
LANCLOUD FC STORAG
NAS STORAGE UCS Fabric Int
Access Layer LAUnified Fabric
UCS FC in NPV Mode
Upstream Switch in NPIV Mode
UCS Ethernet in EHM
Fibre Ch
Ethernet
Fabric A Fabric B
SAN Fabric Storage Arrays
FC Switch Mode
http://www.emc.com/products/detail/hardware/celerra-ns960.htmhttp://www.emc.com/products/detail/hardware/celerra-ns960.htm
-
8/18/2019 UCS System Architecture
90/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
UCS B-Series
UCS 6100 UCS 6100
FCoE StorageFC Storage
Ethernet
Unified I/
FCoE
Core
SAN Edge A SAN Edge B
Direct Attach
Must have connectioMDS FC Switch or N Data traffic doesn’t have to go
FC switch or N5K
Only works with CiscFC Switches or N5K
UCS C-Series Integration to UCSM
-
8/18/2019 UCS System Architecture
91/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
CIMC
GE LOM PCIe Adapter
OS or Hypervisor
Nexus
2232
Mgmt Traffic
Data Traffic
Nexus
2232
UCS 6100 or 6200UCS 6100 or 6200
• Reduce cost of deplo
• Scale and performanc
• Choose from 5 server
• Scale to 160 C-Series
-
8/18/2019 UCS System Architecture
92/102
Different FEX technologies
-
8/18/2019 UCS System Architecture
93/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Features:
• Adapter FEX split a physical NIC intomultiple logical NICs
• VM-FEX extends Adapter FEXtechnology to virtual machine
• Based on open Standards
Benefits:
• Same functionality in Physical and Virtualenvironments
• Increased bandwidth utilization by sharing physicalinterface to multiple Applications and/or VMs
• Improved Performance and dynamic network &security policy mobility during VM migration withVM-FEX
Adapte
Emulated Mode VMDirectPath
Modes of VM-FEX
-
8/18/2019 UCS System Architecture
94/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Standard Mode
12%-15% CPU performanceimprovement
vMotion supported
High Performance Mode
Co-exists with Standard mode
Bypasses Hypervisor layer
30% improvement in I/O perfo
vMotion supported with ESX 5
VM-FEX with VMware
I/O profiles defined in UCS & applied in vCenter
-
8/18/2019 UCS System Architecture
95/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
VMW ESX
Server
vCenter
VMW ESX
Server
UCS DVS (PTS)
VM#1 VM#4VM#3VM#2 VM#5 VM#8VM#7VM#6
Port Profiles
Defined in UCS
WEB Apps
HR
DB
Compliance
UCS exports Port
Profiles to VC
VC Deploys VMs
with UCS policies
UCS
-
8/18/2019 UCS System Architecture
96/102
VM
VMDirectPath: How is Works
-
8/18/2019 UCS System Architecture
97/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Dynamic VIC device
Config:
Used by
PCI mgmt
layer
Mgmt Bar:
Used by
Vmkernel
and PTS
Data Bar :
Vmxnet3compliant
Rings and
Registers
Vmxnet3
OS PCI
subsystem
Control Path
Emulation PT transitions
Port Events
PCIe events
Vmxnet3 Driver
Ethernet Device Driver
Cisco vDS
Data Path
VM-FEX with KVM Architecture
Management
Application
KVM
Guest 2
Application
Guest 1
Port Profile1
-
8/18/2019 UCS System Architecture
98/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
… …
UCS Switch
C i s c o
V I C
Adapter Port
Switch Port
… …
U s e r
K e r n e l
Macvtap
Interface
Netdev
Interface
Libvirt
Management
Tools
Netlink
Socket
virtio-net
eth1
Macvtap 1
vhost-net
Guest
OS
virtio-net
Guest
OS
eth2
Macvtap 2
vhost-net
eth0 ethn
PF VF1 VF2 VFn
Port Profile1
Qos1, vlan1
Port Profile2
Qos2, vlan2
Veth 1 Veth 2
Port Profile2:
Qos2, vlan2
Port Profile1:
Qos1, vlan1
Recommended Reading for BRKCOM-1005
-
8/18/2019 UCS System Architecture
99/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
Call to Action
-
8/18/2019 UCS System Architecture
100/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
• Visit the Cisco Campus at the World of Solutionsto experience Cisco innovations in action
• Get hands-on experience attending one of the Walk-in Labs
• Schedule face to face meeting with one of Cisco’s enginee
at the Meet the Engineer center
• Discuss your project’s challenges at the Technical Solution
-
8/18/2019 UCS System Architecture
101/102
© 2013 Cisco and/or its affiliates. All rights reserved.BRKCOM-1005 Cisco Public
-
8/18/2019 UCS System Architecture
102/102