vmworld 2014 - scaling your sddc network
DESCRIPTION
VMWorld 2014 - Scaling Your SDDC NetworkTRANSCRIPT
![Page 1: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/1.jpg)
Scaling Your SDDC Network:Building a Highly Scalable SDDC Infrastructure with Advanced Physical Network Architectures &
VMware NSX
Phillip CoatesSystems Engineering Manager ANZBrocade Communications Systems, Inc.
![Page 2: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/2.jpg)
Evolution of datacenter architectures
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC 2
Phase 1:
3-tier Architectures
Co
reA
gg
Acc
ess
Phase 2:
Scale-out Architectures
Le
af
/ S
pin
eC
ore
Scale Out
Phase 3:
Advanced Scale-out Architectures+
Overlay Networking
10G
DC POD N Edge Services POD
SUPER SPINE
BORDER LEAF
WAN EDGE
INTERNET DC INTERCONNECT
DC POD 1
SPINE
LEAF
![Page 3: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/3.jpg)
• Brocade provides choices for building reliable and scalable underlay networks for the VMware SDDC
• Brocade VDX switches are easy to deploy and manage
• Brocade VDX gateway provides a highly resilient and easy to manage Hardware VTEP gateway for VMware NSX
• Integration with VMware vRealize in Brocade VDX switches provides visibility and monitoring for the network
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 3
VMware and Brocade – “Better Together”
![Page 4: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/4.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC 4
Physical network architectures for the
SDDC
Logical networking with VMware NSX
Agenda
Provisioning, automation and
visibility/monitoring
![Page 5: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/5.jpg)
Learning from massive scale deployments
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC 5
Source: https://code.facebook.com/posts/360346274145943/introducing-data-center-fabric-the-next-generation-facebook-data-center-network/
![Page 6: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/6.jpg)
Clos Concepts: L2 Clos network with Brocade VDX
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 6
L2 Links
SPINE
LEAF
• Manage all fabric switches as a single logical device
• No blocking links and no need for Spanning Tree
• Multipathing at layers 1 to 3
• Zero-touch provisioning & Self-forming trunks
TRILL-based Ethernet fabric
![Page 7: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/7.jpg)
Clos Concepts: L3 Clos network with Brocade VDX
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 7
L3 Links
SPINE
LEAF
• Zero-touch provisioning and deployment mechanisms (standards based)
‒ DHCP and TFTP
• Management through Netconf/REST and DevOps integration
• Layer 2 Extension mechanisms through native VXLAN support
IP Routing protocols like BGP and OSPF
![Page 8: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/8.jpg)
Choices for datacenter infrastructure
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 8
L3 Clos
• Smaller team to manage the infrastructure
• Embedded automation required for OpExsavings
• Larger team to manage the infrastructure
• Tool chains in place for automation and orchestration
• Network infrastructure scalable to very large deployments
L2 Clos with Brocade VCS L3 Clos with Brocade VDX
Both VCS and L3 Clos deployments use the same VDX hardware and Brocade NOS software!
![Page 9: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/9.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 9
Building scalable physical networks
L2 Clos based architectures
![Page 10: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/10.jpg)
Building Blocks: Datacenter POD physical architecture (3-Stage folded Clos)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 10
L2 Clos with Single or dual homed servers
L2 Links
VCS
Fabric
SPINE
LEAF
Servers/Blades
10G
Servers/Blades
10G
Servers/Blades
10G
Compute Racks
Controller
Management SW IP Storage
10G
Management/Infrastructure Racks
![Page 11: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/11.jpg)
Building Blocks: Edge services POD physical architecture
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 11
VCS
Fabric
BORDER LEAF
Servers/Blades
10G
Edge Racks
Load Balancer
10G
Firewall
SW RouterSW VPN
SW Firewall
Single or dual-homed edge service devices
L2 Links
![Page 12: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/12.jpg)
L2 Clos based Datacenter Site(3-stage folded Clos)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 12
SPINE
LEAF
10G 10G 10G 10G
Compute and Infrastructure/Management Racks Edge Racks
10G 10G
BORDER LEAF
INTERNET DC INTERCONNECT
L2 Links
WAN EDGE
DC POD Edge Services POD
VCS
Fabric
VCS
Fabric
![Page 13: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/13.jpg)
Multi-fabric VCS physical architecture for DC Site(5-stage folded Clos)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 13
BORDER LEAFSPINE
LEAF
VCS
Fabric
10G 10G
10G
VCS
Fabric
10G 10G 10G
DC POD N
Compute and Infrastructure/Management Racks Edge Racks
Edge Services POD
SUPER SPINE
WAN EDGE
INTERNET DC INTERCONNECT
L2 Links
L3 Links
10G
VCS
Fabric
10G 10G 10G
DC POD 1
Compute and Infrastructure/Management Racks
SPINE
LEAF
![Page 14: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/14.jpg)
L2 Extension between DC Pods for vMotion, Virtual SAN, Fault Tolerance
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 14
BORDER LEAFSPINE
LEAF
10G
VCS
Fabric
10G 10G 10G
DC POD N
SPINE
LEAF
VCS
Fabric
10G 10G
10G
VCS
Fabric
10G 10G 10G
DC POD 1
Compute and Infrastructure/Management Racks Compute and Infrastructure/Management Racks Edge Racks
Edge Services POD
SUPER SPINE
WAN EDGE
INTERNET DC INTERCONNECT
40G
L2 Links
L3 Links
VXLAN
![Page 15: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/15.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 15
Building scalable physical networks
L3 Clos architectures
![Page 16: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/16.jpg)
L3 Clos based Datacenter Site(3-stage folded Clos)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 16
SPINE
LEAF
10G 10G 10G 10G
Compute and Infrastructure/Management Racks Edge Racks
10G 10G
BORDER LEAF
INTERNET DC INTERCONNECTL2 Links
L3 Links
WAN EDGE
DC POD Edge Services POD
![Page 17: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/17.jpg)
Multi-fabric VCS and L3 Clos hybrid architecture(5-stage folded Clos)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 17
10G 10G
10G 10G 10G 10G
DC POD N
SPINE
LEAF
Compute and Infrastructure/Management Racks Edge Racks
Edge Services POD
SUPER SPINE
BORDER LEAF
WAN EDGE
INTERNET DC INTERCONNECT
L2 Links
L3 Links
10G 10G 10G 10G
DC POD 1
Compute and Infrastructure/Management Racks
L3 Clos
![Page 18: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/18.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC 18
Physical network architectures for the
SDDC
Logical networking with VMware NSX
Agenda
Provisioning, automation and
visibility/monitoring
![Page 19: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/19.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 19
NSX Components in the physical network
Servers/Blades
10G
SPINE
LEAF
Servers/Blades
10G
IP Storage
10G
Compute RacksManagement Rack Infrastructure Rack
Data Center Pod
NSX vSwitch
![Page 20: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/20.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 20
NSX Components in the physical networkEdge Services Pod
BORDER LEAF
Servers/Blades
10G
Edge Racks
Load Balancer
10G
Firewall
![Page 21: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/21.jpg)
Routed Traffic flows in the network (Distributed Routing)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 21
SPINE
LEAF
10G 10G
DC POD N
SPINE
LEAF
DC POD 1
Infrastructure Racks Edge Racks
Edge Services POD
SUPER SPINE
BORDER LEAF
WAN EDGE
DC INTERCONNECT
INTRANET
Compute RacksCompute Racks
East West Routed Traffic
North South Traffic
VM1 VM2
Infrastructure RackCompute Rack
Load Balancer
10G
Firewall
Brocade VDX Gateway
VM3
![Page 22: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/22.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 22
NSX Hardware VTEP integration
Brocade VDX Gateway
• High-performance VXLAN gateway (line-rate bridging)
• Full integration with VMware NSX
• Logical chassis: Single entity of management through NSX
• Resilient logical gateway: VTEP resides on all the switches. Stateful redundant g/w.
VXLAN
Compute Rack
Virtualized Workloads
Brocade VDX Gateway for
VMware NSX
Servers/Blades
10G
Physical Workloads
VCS
Fabric
SPINE
LEAF
VLAN 10G
VTEP = VIRTUAL TUNNEL END POINT
![Page 23: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/23.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC 23
Physical network architectures for the
SDDC
Logical networking with VMware NSX
Agenda
Provisioning, automation and
visibility/monitoring
![Page 24: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/24.jpg)
Auto Provisioning
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. INTERNAL USE ONLY 24
L2 Links
VCS
Fabric
SPINE
LEAF
Servers/Blades
10G
Servers/Blades
10G
Servers/Blades
10G
Compute Clusters
Increasing cluster capacity in L2 Clos Topology
Servers/Blades
10G
Cluster A
VM3VM1 VM2 VM4
1. Auto-Fabric Deployment
2. ESXi host auto deployment and configuration*
3. Automatic cluster inclusion and NSX Host Preparation
4. DRS balances the cluster
*LACP Configuration may be pushed after new switches are part of VCS Fabric
![Page 25: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/25.jpg)
Auto Provisioning
25
L3 Links
Servers/Blades
10G
Servers/Blades
10G
Servers/Blades
10G
Compute Clusters
Increasing cluster capacity in L3 Clos Topology
Servers/Blades
10G
Cluster A
VM3VM1 VM2 VM4
1. Auto-Provisioning
2. ESXi host auto deployment and configuration
3. Automatic cluster inclusion and NSX Host Preparation
4. DRS balances the cluster
DRS = Dynamic Resource Scheduling
![Page 26: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/26.jpg)
Auto Provisioning for VDX in L3 Clos
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 26
DH
CP
Re
qu
est
DH
CP
Re
spo
nse
w/
Op
tio
ns
Imag
e/C
on
fig
ura
tio
n L
oca
tio
n
SF
TP
/TF
TP
Re
qu
est
Im
ag
e/C
on
fig
ura
tio
n
SW Image
Configuration
1
2
34
5
6
Reloads w/ New
7
8Ready
Imag
e &
Co
nfig
ura
tio
n d
ow
nlo
ad
TFTP Server
DHCP Server
DHCP Mapping
Automation
Engine
BGP
Profile Templates
![Page 27: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/27.jpg)
Datacenter automation tools
Brocade Vyatta Controller (ODL based controller)
REST API/NETCONF/YANG Model
Python Neutron ML2 PlugIn
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 27
Puppet integration
![Page 28: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/28.jpg)
Analytics Packs for vRealize OperationsGreater visibility and actionable analytics
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC.
Intelligent Network Operations
Unified Virtual & Physical Networking
Simplified Policy Automation
Go to Brocade G13 booth to see vRealize Operations and VDX integration
![Page 29: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/29.jpg)
Content Pack for vRealize Log InsightAccelerate troubleshooting with actionable analytics
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC.
Powerful Filtering Capabilities
Simplifies Root-Cause Analysis
Unified Management
![Page 30: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/30.jpg)
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 30
Summary
![Page 31: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/31.jpg)
• Brocade provides choices for building reliable and scalable underlay networks for the VMware SDDC
• Brocade VDX switches are easy to deploy and manage
• Brocade VDX gateway provides a highly resilient and easy to manage Hardware VTEP gateway for VMware NSX
• Integration with VMware vRealize in Brocade VDX switches provides visibility and monitoring for the network
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 31
VMware and Brocade – “Better Together”
![Page 32: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/32.jpg)
Key takeaways
• Reviewed choices provided by Brocade in the underlay architecture
• Reviewed scalable and fault resilient model for VMware NSX
• Reviewed automation and deployment mechanisms
• Brocade and VMware – “BETTER TOGETHER”
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 32
![Page 33: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/33.jpg)
33
• Brocade and VMware alliance page:
http://www.brocade.com/en/partners/alliances/vmware.html
• Configuration guide for Brocade Hardware VTEP:
http://www.brocade.com/content/html/en/configuration-guide/nos-601-l2guide/GUID-773FF857-F62D-4A4A-89AA-B2301BF3ED8E.html
• Deployment guide for NSX with Brocade VCS:
http://www.brocade.com/downloads/documents/html_product_manuals/brocade-vcs-gateway-vmware-dp/index.html
• Brocade VCS Gateway and VMware NSX Video on Demand (VoD):
https://www.youtube.com/watch?v=khjBszMoM9s
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC.
More information
![Page 34: VMWorld 2014 - Scaling Your SDDC Network](https://reader031.vdocument.in/reader031/viewer/2022020112/577c82541a28abe054b04cb4/html5/thumbnails/34.jpg)