dell emc vxrack system flex architecture overview · pdf filevxrack™ system flex...

31
Dell EMC VxRack System FLEX Architecture Overview Document revision 1.8 April 2018

Upload: doananh

Post on 07-Mar-2018

243 views

Category:

Documents


6 download

TRANSCRIPT

Page 1: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Dell EMCVxRack™ System FLEXArchitecture Overview

Document revision 1.8April 2018

Page 2: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Revision history

Date Document revision Description of changes

April 2018 1.8 Added support for new versions of ScaleIO, Red HatEnterprise Linux (RHEL), VMware vSphere, and support forthe new PowerEdge R640 and PowerEdge R740xd servers

February 2018 1.7 • Updated Compute node terminology

• Updated Network topology

• Updated logical network diagram

• Added support for ScaleIO 2.0.1.4

October 2017 1.6 • Editorial updates

• Updated Cisco Nexus 9332PQ network topology content

• Added Cisco Nexus 93180YC-EX Switch

June 2017 1.5 • Inserted additional illustrations in the Network topologysection

• Updated physical network illustration

• General content updates throughout publication

March 2017 1.4 Updated elevations and physical and logical networkdiagrams

December 2016 1.3 • Updated compute components

• Updated sample configuration elevation diagrams

October 2016 1.2 • Updated VxRack System product name

• Updated to support ScaleIO 2.0

• Updated management software information

• Removed System infrastructure topic

July 2016 1.1 • Updates to overview graphics in the System architectureand components section

• Revised Virtual networks section

• Revised Base configurations and scaling section

• Revised elevation drawings in the Sample configurationssection

January 2016 1.0 Initial release

Revision history | 2

Page 3: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

ContentsIntroduction.................................................................................................................................................4

System architecture and components......................................................................................................5Compute.................................................................................................................................................9Network................................................................................................................................................ 10

Network with Dell 14G servers.......................................................................................................10Network with Dell 13G severs........................................................................................................15

Storage.................................................................................................................................................21Virtualization.........................................................................................................................................21

VMware vSphere ESXi.................................................................................................................. 22VMware vCenter Server.................................................................................................................22

Management........................................................................................................................................ 24Base configurations and scaling ..........................................................................................................24

System features........................................................................................................................................ 26

VxRack System FLEX management software........................................................................................27

Sample configuration............................................................................................................................... 28VxRack System FLEX with eight 1 RU Compute enclosures...............................................................28

Additional references............................................................................................................................... 30Network components............................................................................................................................30Storage components............................................................................................................................ 30Virtualization components.................................................................................................................... 30

3 | Contents

Page 4: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

IntroductionThis document describes the high-level design of the VxRack System FLEX. This document alsodescribes the hardware and software components that Dell EMC includes in each VxRack FLEX.

The target audience for this document includes sales engineers, field consultants, advanced servicesspecialists, and customers who want to deploy a virtualized infrastructure using VxRack FLEX.

Refer to the Glossary for a description of terms specific to Converged Systems.

Introduction | 4

Page 5: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

System architecture and componentsVxRack System FLEX contains compute, network, storage, virtualization, and management resources.

The following table shows the components of VxRack FLEX:

Resource Components

Compute • VxRack FLEX compute only nodes

• VxRack FLEX storage only nodes

• VxRack FLEX hyperconverged nodes

Network • Cisco Nexus 3172TQ Management Switch

• Cisco Nexus 93180YC-EX Switch ToR Access Switch

• Cisco Nexus 3132Q-X or Cisco Nexus 3164Q ToR Access Switches

• Cisco Nexus 9332PQ Aggregation Switch

Storage ScaleIO software-defined storage

Virtualization • VMware vSphere ESXi

• VMware vCenter Server

• VMware vSphere Web Client

• VMware Single Sign-On (SSO) Service

Management Vision Intelligent Operations software

The following illustration provides a high-level overview of the physical connectivity of VxRack FLEXcomponents with Cisco Nexus 93180YC-EX Switches and PowerEdge R640 and PowerEdge R740xd

5 | System architecture and components

Page 6: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

servers. The VxRack FLEX Controller nodes support only 10GB connectivity. The VxRack FLEX nodessupport either 10BG or 25GB connectivity.

The following illustration provides a high-level overview of the physical connectivity of VxRack FLEXcomponents with Cisco Nexus 93180YC-EX Switches and PowerEdge R630 and PowerEdge R730xdservers:

System architecture and components | 6

Page 7: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

7 | System architecture and components

Page 8: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

The following illustration provides an overview of the logical network components in the VxRack FLEXarchitecture:

This illustration shows a single rack only. Systems with additional racks contain multipleaggregation and access switches. The Dell R640 and R740 PowerEdge servers and VMwarevSphere 6.5 can use either 10 Gb or 25 Gb connections.

The following illustration shows the logical network components for systems with R630 and R730 serverswith VMware vSphere 6.0.

System architecture and components | 8

Page 9: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

ComputeVxRack System FLEX enclosures are two socket, 1 or 2 RU rack mount enclosures built for production-level applications.

VxRack FLEX can be deployed in numerous system sizes. The minimum can be as small as fourenclosures, while six is recommended to optimize ScaleIO performance. Add VxRack FLEX enclosures inany increment of four enclosures, as required, up to hundreds of nodes in a single ScaleIO cluster.

9 | System architecture and components

Page 10: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

NetworkThe Cisco Nexus switches provide 10 or 25 GbE or 40 GbE IP connectivity between the VxRack SystemFLEX and the external network.

For Dell 14G servers, the Cisco Nexus 93180YC-EX Switch provides four separate 10 GbE or 25 GbEconnections to the VxRack FLEX Controller nodes using a 1:1 connection between the NIC and switch.For 14G servers, the Cisco Nexus 93180YC-EX Switch provides four separate 25 GbE connections to theVxRack FLEX nodes using a 1:1 connection between the NIC and switch. For 13G servers, it provides a10GbE connection.

For Dell 13G servers, the Cisco Nexus 31xx Series Switches provides four 10 GbE connectivity usingbreakout cables to connect to the VxRack FLEX nodes and VxRack FLEX Controller nodes.

VxRack FLEX includes Cisco Nexus 93180YC-EX, Cisco Nexus 3132Q-X, or Cisco Nexus 3164Q accessswitches, as well as the Cisco Nexus 9332PQ aggregation switches. VxRack FLEX includes a Cisco3172TQ switch used for out-of-band management.

Network with PowerEdge Dell 14G servers

The Cisco Nexus switches provide 10GbE and 25GbE IP connectivity between the VxRack FLEX nodesand VxRack FLEX Controller nodes and 40GbE uplink ports to the external network or aggregation layer.The Cisco Nexus 93180YC-EX Switch provides 25GbE connections to the VxRack FLEX nodes and10GbE connections to the VxRack FLEX Controller nodes using 1:1 connections between the NIC andswitch.

VxRack FLEX includes Cisco Nexus 93180YC-EX access switches, as well as the optional Cisco Nexus9332PQ aggregation switches. VxRack FLEX includes a Cisco 3172TQ switch used for a managementlayer network.

Network topology for Dell 14G servers

The default access/aggregation network design contains a pair of connected Cisco Nexus 93180YC-EXSwitches for the access layer.

The number of supported depends on how the Cisco Nexus 93180YC-EX Switch is configured. The CiscoNexus 93180YC-EX Switch deployment has the following variations:

• Connecting to a Cisco Nexus 9332PQ aggregation switch with a single uplink

• Connecting to a Cisco Nexus 9332PQ aggregation switch with dual uplinks

System architecture and components | 10

Page 11: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

The following illustration and table show the network design of the Cisco Nexus 93180YC-EX Switch:

The number of supported nodes depends on how the Cisco Nexus 93180YC-EX Switch is configured. Ithas the following variations:

• Connecting to Cisco Nexus 9332PQ aggregation Switch with single uplink

• Connecting to Cisco Nexus 9332PQ aggregation Switch with dual uplinks

The number of supported nodes depends on the configuration of the Cisco Nexus 93180YC-EX Switch.There are four variations:

• Cisco Nexus 93180YC-EX Access Switch not connecting to Cisco Nexus 9332PQ Aggregation

• Cisco Nexus 93180YC-EX Access Switch not connecting to Cisco Nexus 9332PQ Aggregation

11 | System architecture and components

Page 12: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

• Cisco Nexus 93180YC-EX Access Switch connecting to 9332PQ Aggregation Switch with singleuplink

• Cisco Nexus 93180YC-EX Access Switch connecting to 9332PQ Aggregation Switch with dualuplinks

The following illustration and table show the leaf network design of the Cisco Nexus 93180YC-EX Switch:

Cisco Nexus 93180YC-EX Access Switch not connecting to Cisco Nexus 9332PQ Aggregation Switch

6 - 40/100GbE ports 2 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer

48 - 10/25GbE ports 6 x 10GbE port VxRack Controller node

42 x 10GbE ports DL to server

21 FLEX Node servers

System architecture and components | 12

Page 13: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Cisco Nexus 93180YC-EX Access Switch not connecting to Cisco Nexus 9332PQ Aggregation Switch

6:1 oversubscription

Cisco Nexus 93180YC-EX access Switch connecting to Cisco Nexus 9332PQ Aggregation Switch withSingle Uplink

6 x40/100GE ports 2 x 40GbE ports UL to aggregation switch pair

2 x 40GbE ports vPC peer

48 x10/25GE ports 6 x 10GbE ports for VxRack Controller

42 x 10GbE ports to DL to nodes

21 VxRack FLEX node servers

6:1 oversubscription Maximum of 14 pairs of Cisco Nexus 93180YC-EX Switches

Cisco Nexus 93180YC-EX Access Switch connecting to Cisco Nexus 9332PQ Aggregation Switch with DualUplinks

6 x40/100GE ports 4 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer

48 x10/25GE ports 6 x 10GbE ports for VxRack Controller

42 x 10GbE ports to DL to nodes

21 VxRack FLEX node servers

6:1 oversubscription Maximum of 7 pairs of Cisco Nexus 93180YC-EX Switches

13 | System architecture and components

Page 14: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

The following illustration shows an aggregation/access network design of the Cisco Nexus 9332PQ andCisco Nexus 93180YC-EX switches that are ready to scale to multiple racks:

The following table provides details about the Cisco Nexus 9332PQ single rack aggregation networkdesign:

Cisco Nexus 9332PQ aggregation network capacity

Aggregation layer

Aggregation switch

System architecture and components | 14

Page 15: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Cisco Nexus 9332PQ aggregation network capacity

32 x 40GE ports: 4 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer connectivity

2 x 40GbE ports (customer UL, data protection, and so on)

4-8 x 40GbE ports for future expansion

20 x 40GbE DL ports (Cisco Nexus 3132Q-X)16 x 40GbE DL ports (Cisco Nexus 3164Q)

5:1 oversubscription (Cisco Nexus 3132Q-X)4:1 oversubscription (Cisco Nexus 3164Q)

The compute layer connects to the Ethernet component of the network layer. The southboundinterconnects connect to the Cisco Nexus switches in the Ethernet network through 10 GbE port channelsfor the FLEX Controller and 25GbE for VxRack FLEX nodes

The storage layer consists of ScaleIO software-defined storage using the direct attached storage (DAS)of each VxRack System enclosure.

FLEX Controller servers connect to the ToR switches using 10G SFP+ (two to each switch), usingbreakout cables, to communicate with the in-band components of the infrastructure. They have one link tothe Cisco Nexus 3172TQ management switch to communicate with the out-of-band components.

Cisco Nexus 9332PQ leaf/aggregation network pair capacity connected by Cisco Nexus 93180YC-EX Switch(Single link)

32 x 40GE ports: 2 x 40GbE ports vPC peer

2 x 40GbE ports uplink to customer

28 x 40GbE ports to FLEX Controller

14 cabinets of 24 servers - 3 Controllers = 333 SIO Nodes

14:1 oversubscription

Cisco Nexus 9332PQ leaf/aggregation network pair capacity connected by Cisco Nexus 93180YC-EX Switch(Dual link)

32 x 40GE ports: 2 x 40GbE ports vPC peer

2 x 40GbE ports uplink to customer

28 x 40GbE ports to FLEX Controller

7 cabinets of 24 servers - 3 Controllers = 165 SIO Nodes

7:1 oversubscription

Network with Dell 13G servers

The default access/aggregation network design contains a pair of connected Cisco Nexus 93180YC-EXSwitches, Cisco Nexus 3132Q-X Switches, or Cisco Nexus 3164Q Switches for the access layer.

The Cisco Nexus 3132Q-X Switch supports a maximum of 44 nodes. When density exceeds 44 nodes,up to five switch pairs can be bundled and attached to a pair of Cisco Nexus 9332PQ aggregationswitches, supporting up to 220 nodes (total node count includes VxRack FLEX Controller nodes).

15 | System architecture and components

Page 16: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

The Cisco Nexus 3164Q Switch supports a maximum of 100 nodes. When density exceeds 100 nodes,up to two switch pairs can be bundled and attached to a pair of Cisco Nexus 9332PQ aggregationswitches, supporting up to 200 nodes (total node count includes VxRack FLEX Controller nodes).

The number of nodes supported by the Cisco Nexus 93180YC-EX Switch depends on how the switch isconfigured. It has the following variations:

• Connecting to Cisco Nexus 9332PQ aggregation switch with single uplink

• Connecting to Cisco Nexus 9332PQ aggregation switch with dual uplinks

Cisco Nexus 93180YC-EX architecture

The following table shows the leaf network design of the Cisco Nexus 93180YC-EX Switch:

It is recommended that your VxRack FLEX network configuration includes a pair of CiscoNexus 9332PQ aggregation switches. This prevents any outages in the event of expanding thesystem to one or more cabinets.

System architecture and components | 16

Page 17: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Cisco Nexus 93180YC-EX access switch connecting to Cisco Nexus 9332PQ Aggregation Switch withSingle Uplink (10GbE VxRack FLEX nodes)

6 x40/100GE ports 2 x 40GbE ports UL to aggregation switch pair

2 x 40GbE ports vPC peer

48 x10/25GE ports 6 x 10GbE ports for VxRack Controller

17 | System architecture and components

Page 18: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Cisco Nexus 93180YC-EX access switch connecting to Cisco Nexus 9332PQ Aggregation Switch withSingle Uplink (10GbE VxRack FLEX nodes)

42 x 10GbE ports to DL to nodes

21 VxRack FLEX node servers

6:1 oversubscription Maximum of 14 pairs of Cisco Nexus 93180YC-EX Switches

Cisco Nexus 93180YC-EX Access Switch connecting to Cisco Nexus 9332PQ Aggregation Switch with DualUplinks (10GbE VxRack FLEX nodes)

6 x40/100GE ports 4 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer

48 x10/25GE ports 6 x 10GbE ports for VxRack Controller

42 x 10GbE ports to DL to nodes

21 VxRack FLEX nodes servers

6:1 oversubscription Maximum of 7 pairs of Cisco Nexus 93180YC-EX Switches

Cisco Nexus 93180YC-FX Access Switch not connecting to Cisco Nexus 9332PQ Aggregation Switch

6 - 40GbE ports 2 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer

48 - 10/25GbE ports 6(8) x 10GbE port VxRack Controller node (2 for planned controller expansion)

40 x 25GbE ports DL to server

20 VxRack FLEX nodes servers

13.5:1 oversubscription

Cisco Nexus 93180YC-EX access Switch connecting to Cisco Nexus 9332PQ Aggregation Switch withSingle Uplink

6 - 40GbE ports 2 x 40GbE ports UL to aggregation switch pair

2 x 40GbE ports vPC peer

48 - 10/25GbE ports 6(8) x 10GbE port VxRack Controller node (2 for planned controller expansion)

40 x 25GbE ports DL to nodes

20 VxRack FLEX nodes servers

13.5:1 access layeroversubscription

Maximum of 14 pairs of Cisco Nexus 93180YC-EX Switches

Cisco Nexus 93180YC-EX Access Switch connecting to Cisco Nexus 9332PQ Aggregation Switch with DualUplinks

6 - 40GbE ports 4 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer

48 - 10/25GbE ports 6(8) x 10GbE port VxRack Controller node (2 for planned controller expansion)

40 x 25GbE ports DL to nodes

System architecture and components | 18

Page 19: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Cisco Nexus 93180YC-EX Access Switch connecting to Cisco Nexus 9332PQ Aggregation Switch with DualUplinks

20 VxRack FLEX nodes servers

6.75:1 access layeroversubscription

Maximum of 7 pairs of Cisco Nexus 93180YC-EX Switches

Cisco Nexus 9332PQ and Cisco Nexus 3132Q-X architecture

The following illustration shows an aggregation/access network design of the Cisco Nexus 9332PQ andCisco Nexus 3132Q-X switches that are ready to scale to multiple racks:

19 | System architecture and components

Page 20: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

The following table provides details about the Cisco Nexus 3132Q-X access network design:

Cisco Nexus 3132Q-X access network design

Access switch pair

32 x 40GE ports: 4 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer

2 x 40GbE ports for management cluster

2 x 40GbE ports for future expansion

22 x 40GbE ports DL to nodes (88 10GE ports)

44 supported servers (including FLEX Controller servers, if applicable)

5.5:1 oversubscription

The following table provides details about the Cisco Nexus 9332PQ single rack aggregation networkdesign:

Cisco Nexus 9332PQ aggregation network capacity

Aggregation layer

Aggregation switch

32 x 40GE ports: 4 x 40GbE ports UL to customer

2 x 40GbE ports vPC peer connectivity

2 x 40GbE ports (customer UL, data protection, and so on)

4-8 x 40GbE ports for future expansion

20 x 40GbE DL ports (Cisco Nexus 3132Q-X)16 x 40GbE DL ports (Cisco Nexus 3164Q)

5:1 oversubscription (Cisco Nexus 3132Q-X)4:1 oversubscription (Cisco Nexus 3164Q)

The compute layer connects to the Ethernet component of the network layer. The southboundinterconnects connect to the Cisco Nexus switches in the Ethernet network through 10 GbE port channelsusing breakout cables.

The storage layer consists of ScaleIO software-defined storage using the direct attached storage (DAS)of each VxRack System enclosure.

VxRack FLEX Controller nodesconnect to the access switches using 10G SFP+ (two to each switch),using breakout cables, to communicate with the in-band components of the infrastructure. They have onelink to the Cisco Nexus 3172TQ management switch to communicate with the out-of-band components.

Cisco Nexus 9332PQ leaf/aggregation network pair capacity connected by Cisco Nexus 93180YC-EX Switch(Single link)

32 x 40GE ports: 2 x 40GbE ports vPC peer

2 x 40GbE ports uplink to customer

28 x 40GbE ports to FLEX Controller

14 cabinets of 24 servers - 3 Controllers = 333 SIO Nodes

System architecture and components | 20

Page 21: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Cisco Nexus 9332PQ leaf/aggregation network pair capacity connected by Cisco Nexus 93180YC-EX Switch(Single link)

14:1 oversubscription

Cisco Nexus 9332PQ leaf/aggregation network pair capacity connected by Cisco Nexus 93180YC-EX Switch(Dual link)

32 x 40GE ports: 2 x 40GbE ports vPC peer

2 x 40GbE ports uplink to customer

28 x 40GbE ports to FLEX Controller

7 cabinets of 24 servers - 3 Controllers = 165 SIO Nodes

7:1 oversubscription

StorageVxRack System FLEX uses the software-defined storage technology. ScaleIO is a software-only solutionthat uses the local disks and LAN of existing VxRack System nodes to create a virtual SAN. It is designedto scale to thousands of nodes.

VxRack FLEX supports the following ScaleIO 2.0.1 features:

• Extended 5-node MDM cluster

• LDAP user authentication

• In-flight checksum

• Public and private key pair authentication

• Instant maintenance mode

• ESRS 3.0 integration

• Virtualized IP addresses for SDC communication

For more information about ScaleIO, refer to Dell EMC Support.

VirtualizationVMware vSphere is the virtualization platform that provides the foundation for the private cloud.

The core VMware vSphere components are the VMware vSphere ESXi and VMware vCenter Server formanagement. VMware vSphere includes a pair of Platform Service Controller Linux appliances to providethe Single Sign-On (SSO) service.

The hypervisors are deployed in a cluster configuration. The cluster allows dynamic allocation ofresources, such as CPU, memory, and storage. The cluster also provides workload mobility and flexibilitywith the use of VMware vMotion and Storage vMotion technology.

21 | System architecture and components

Page 22: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

VMware vSphere ESXi

VMware vSphere ESXi is a lightweight hypervisor that runs on the FLEX Controller node and on theVxRack FLEX nodes. It requires very little space to run (less than 6 GB of storage required to install) andhas minimal management overhead.

Dell 14G servers

The 14G hardware boots the hypervisor from the BOSS-S1 card, a PCIe controller hosting two M.2 SSDdrives, presented as a single volume (RAID1). FLEX Controllers boot from an SD card.

Dell 13G servers

VMware vSphere ESXi boots from the SATADOM, a small SATA3 flash memory module which is insertedinto the server board SATA connector to provide solid state storage capacity that simulates a hard diskdrive (HDD). For the enclosures, VMware vSphere ESXi boots from the SATADOM on the local node.

VxRack FLEX Controller node

For 14G servers, theVxRack FLEX Controller node boots from a SD card. For 13G servers, it boots fromthe SATADOM.

Cluster configuration

VMware vSphere ESXi hosts and their resources are pooled together into clusters. These clusterscontain the CPU, memory, network, and storage resources available for allocation to VMs. vSphereclusters can scale up to a maximum of 64 hosts. Up to 1000 hosts can be supported in one VMwarevCenter instance.

Some advanced CPU functionality might be unavailable if more than one enclosure model isrunning in a given cluster.

Data stores

VxRack FLEX supports a single data store type: block level storage using VMFS.

The maximum size per VMFS5 volume is 64 TB (50 TB VMFS3 @ 1 MB). The maximum VMDK file sizeis 62 TB. Each host/cluster can support a maximum of 255 volumes.

Virtual networks

Virtual networking in VxRack FLEX is managed by a VMware vSphere Distributed Switch (VDS).

VMware vCenter Server

VMware vCenter Server is a central management point for hypervisors and virtual machines (VM).

VMware vCenter Server 6.5 is supported on Dell 14G servers. Currently, VMware vCenterServer 6.0 is supported on Dell 13G servers.

VMware vCenter Server Appliance (vCSA) is leveraged to manage the virtual infrastructure. VMwareUpdate Manager is installed on a 64-bit Windows Server and runs as a service to assist with host patchmanagement.

System architecture and components | 22

Page 23: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

There are two VMware vCSAs in VxRack System FLEX: one for the VxRack Controller subsystem andone for customer use, which contains all of the ScaleIO nodes.

VMware vCenter Server Virtual Appliance (vCSA) is leveraged to manage the virtual infrastructure.VMware Update Manager is installed on a 64-bit Windows Server and runs as a service to assist withhost patch management.

There are at least two vCSAs in VxRack FLEX - one for the VxRack FLEX Management Controller andone or more for the management of the VxRack FLEX Controller nodes.

vCSA provides functionality that includes:

• Cloning of VMs

• Template creation

• VMware vMotion and VMware Storage vMotion

• Initial configuration of VMware Distributed Resource Scheduler (DRS) and VMware vSpherehigh-availability (HA) clusters

vCSA also provides monitoring and alerting capabilities for hosts and VMs. System administrators cancreate and apply alarms to all managed objects in VMware vCenter Server, including:

• Data center, cluster, and host health, inventory, and performance

• Datastore health and capacity

• VM usage, performance, and health

• Virtual network usage and health

HA is also an option for the management vCSA deployed in VxRack System FLEX, starting with vSphere6.5. This option does require additional VMs (using further FLEX Controller cluster resources), but isincluded with the vCenter Server standard license.

Databases

Beginning with VMware vSphere 6.5, vCenter and VUM use the Postgres database within the vCSA.

For VMware vSphere 6.0, the back-end database that supports VMware VUM is a VM running a MicrosoftSQL database. The back-end database that supports VMware vCSA on VMware vSphere ESXi 6.0 is anembedded postgres database.

Authentication

VMware Single Sign-On (SSO) Service integrates multiple identity sources including AD, Open LDAP,and local accounts for authentication.

VMware vCenter Server supported features

Dell EMC supports the following VMware vCenter Server features:

• VMware Single Sign On (SSO) Service

• VMware vSphere Web Client (used with Vision Intelligent Operations)

23 | System architecture and components

Page 24: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

• VMware vSphere High Availability

• VMware Distributed Resource Scheduler (DRS)

• VMware vSphere Distributed Switch (VDS)

• VMware Fault Tolerance

• VMware vMotion

• VMware Storage vMotion

• VMware Enhanced vMotion Compatibility (EVC)

• VMware Resource Pools

• VMware Storage Distributed Resource Scheduler (DRS) (capacity only)

• VMware Storage-driven profiles (user-defined only)

• VMware distributed power management (up to 50 percent of VMware vSphere ESXi hosts)

• VMware Syslog Service

• VMware Core Dump Collector

• VMware vCenter Web Services

ManagementThe VxRack FLEX management stack consists of the following software components:

• Vision Intelligent Operations

• ScaleIO GUI

• VMware vSphere Web Client

• ESRS

• vSphere Update Manager (VUM) (ESXi 6.0 only. Included with vCSA for ESXi 6.5)

• Microsoft SQL Server (ESXi 6.0 only. Included with vCSA for ESXi 6.5)

Base configurations and scalingVxRack System FLEX has a base configuration that is a minimum set of hyperconverged and storagecomponents, as well as fixed network resources. These components are integrated within one or more 28inch 42 RU cabinets.

System architecture and components | 24

Page 25: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Within the base configuration, the following hardware aspects can be customized:

Hardware Minimum set

Compute Dell EMC recommends at least six nodes to realize performance and resiliency features ofScaleIO SDS. Four nodes minimum.

Network For Dell 14G servers, one Cisco Nexus 3172TQ and one pair of Cisco Nexus 93180YC-EXSwitches.For Dell 13G servers, one Cisco Nexus 3172TQ and one pair of Cisco Nexus 3132Q-X, CiscoNexus 3164Q, or Cisco Nexus 93180YC-EX Switches.

Storage No minimum. Storage is software-defined SAN storage that leverages local disks to build avirtual SAN storage pool.

Management Three FLEX Controller servers with HA support and VSAN for software scale-out.

VxRack FLEX is a scale-out solution that allows you to add VxRack System enclosures with various CPU,memory, and drive options.

ScaleIO software-defined SAN storage allows scaling from a base configuration to a large-scaledeployment.

Together, the components offer balanced CPU, I/O bandwidth, and storage capacity relative to thecompute and storage arrays in the VxRack System. All components have N+N or N+1 redundancy.

These resources can be scaled up as necessary to meet increasingly stringent application workloadrequirements. To scale up storage and compute resources, add nodes to the environment. Optionally, addexpansion cabinets with additional resources.

25 | System architecture and components

Page 26: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

System featuresVxRack System FLEX is a modular hyper-converged platform that allows extreme scalability and flexibilityfor next generation cloud applications and mixed workloads.

VxRack FLEX is designed for deployments involving large numbers of VMs and users. It provides thefollowing features:

• Low provisioning complexity with simple-to-use functionality

• Flexible and variable configuration options

• Horizontal scaling by adding, moving and removing nodes on-the-fly to extend direct attachedstorage (DAS) capacity exponentially

• Step-sized building blocks for future data center environments

• Pre-configured, pre-loaded, pre-tested, and fully optimized IT stack, delivered as a fullyassembled and supported system

System features | 26

Page 27: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

VxRack System FLEX management softwareDell EMC recommends using Vision Intelligent Operations software as your primary managementinterface for VxRack Systems.

Vision software includes the Vision dashboard, which provides system inventory, health monitoring, andRCM compliance management; and the Vision shell, which provides network configuration and othercapabilities necessary to manage a VxRack System.

For more information about Vision software, refer to cpsdocs.dellemc.com.

27 | VxRack System FLEX management software

Page 28: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Sample configuration

VxRack System FLEX with eight 1 RU VxRack FLEX nodesCabinet elevations vary based on the specific configuration requirements.

These are provided for sample purposes only. For specifications for a specific VxRack FLEX design,consult your vArchitect.

Configuation with Dell R630 PowerEdge servers.

Sample configuration | 28

Page 29: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Configuration with Dell R640 PowerEdge servers.

29 | Sample configuration

Page 30: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

Additional referencesReferences to related documentation for virtualization, compute, network and storage components areprovided.

Network componentsNetwork component information and links to documentation are provided.

Product Link to documentation

Cisco Nexus 93180YC-EX http://www.cisco.com/c/en/us/products/switches/nexus-93180yc-ex-switch/index.html

Cisco Nexus 3132Q-X http://www.cisco.com/c/en/us/products/collateral/switches/nexus-3132q-switch/data_sheet_c78-729482.html

Cisco Nexus 3164Q http://www.cisco.com/c/en/us/products/collateral/switches/nexus-3000-series-switches/datasheet-c78-731524.html

Cisco Nexus 3172T-Q http://www.cisco.com/c/en/us/products/collateral/switches/nexus-3000-series-switches/data_sheet_c78-729483.html

Cisco Nexus 9332PQ http://www.cisco.com/c/en/us/support/switches/nexus-9332pq-switch/model.html

Storage componentsStorage component information and links to documentation are provided.

Product Description Link to documentation

ScaleIO Converges storage and compute resources into asingle-layer architecture, aggregating capacity andperformance, simplifying management, and scaling tothousands of nodes.

http://www.emc.com/storage/scaleio/index.htm

Virtualization componentsVirtualization component information and links to documentation are provided.

Product Description Link to documentation

VMware vCenterServer

Provides a scalable and extensible platform thatforms the foundation for virtualization management.

http://www.vmware.com/products/vcenter-server/

VMware vSphereESXi

Virtualized infrastructure for Vblock Systems.Virtualizes all application servers and providesVMware High Availability (HA) and DynamicResource Scheduling (DRS).

www.vmware.com/products/vsphere/

VMware Single Sign-On (SSO) Service

Provides VMware-specific authentication services. blogs.vmware.com/kb/2012/10/vsphere-sso-resources.html

Additional references | 30

Page 31: Dell EMC VxRack System FLEX Architecture Overview · PDF fileVxRack™ System FLEX Architecture Overview Document revision 1.7 ... Cisco Nexus 9332PQ leaf/aggregation network pair

The information in this publication is provided "as is." Dell Inc. makes no representations or warranties of any kind withrespect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitnessfor a particular purpose.

Use, copying, and distribution of any software described in this publication requires an applicable software license.

Copyright © 2016, 2017, 2018 Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, and other trademarks aretrademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Publishedin the USA in April 2018.

Dell EMC believes the information in this document is accurate as of its publication date. The information is subject tochange without notice.

31 | Copyright