vdx 110 wbt_vdx 6710 6730 hw overview(full permission)

Revision 1011

VDX 110 VDX 6710 and 6730 Hardware Overview

1

Revision 1011


2

The Brocade VDX 6710-54 is a low-cost Ethernet switch that is VCS capable.

Revision 1011


3

Footnote 1: Ports on Demand (POD) enables ports to be added. Default is 16 ports enabled with a single 8 POD license available to support a total of 32 ports

Footnote 2: Twinax and SFP optical connectivity options.

Footnote 3: Complete FCoE support including multi-hop (license required) and iSCSI Data Center Bridging support (DCB).

Revision 1011


4

Footnote 1: Ports on Demand (POD) enables ports to be added. Default is 40 ports enabled with two 10 POD licenses available to support a total of 60 GE ports

Footnote 2: Twinax and SFP optical connectivity options

Footnote 3: Complete FCoE support including multi-hop (license required) and iSCSI Data Center Bridging support (DCB)

Revision 1011


5

Revision 1011


6

TOR is top of rack

Revision 1011


7

The VDX 6710 and 6730 switches support convergence through iSCSI, FCoE, and FC protocol support and also are part of a VCS fabric. The VDX 6710 is a Ethernet switch that can be part of a VCS fabric.

Footnote 1: The 1GbE ports do not support DCB so the iSCSI TLV is not supported however iSCSI traffic can be still go across these ports. iSCSI TLV is supported on the 10 GbE ports.

Footnote 2: Cannot attach an FCoE device to a port on this switch however FCoE traffic can flow through the 10 G (Trill) ports as long as the destination is not on that switch. As the switch would look at the destination RB and modify the outer header with next hop information so the switch would never look at the type of traffic in that frame.

Footnote 3: The 1 GbE ports can not be used as ISL connections to other switches in the fabric.

Footnote 4: The FC ports can only be used as E_Port (VDX switch) to EX_Port (SAN router) connection. Cannot directly attach a FC end device to any of the FC ports on the VDX 6730

Revision 1011


8

Traditional networks have three tiers: Core, aggregation and access. The VDX products allow the aggregation and access tier to be combined into an edge tier. This is not a requirement as networks could still be setup with the traditional three tiers.

This is a network convergence use case. Tier 1 applications still have native FC connections to the SAN for an air-gap, and to provide the highest performance and resilient connection to block resources. Servers with CNAs can access FC and FCoE resources with a DCB connection from the Ethernet fabric into the core of the FC SAN.

Revision 1011


9

Revision 1011


10

One LED (green) to indicate valid system power.

One LED (green/amber) to indicate system status.

Console Port: RJ-45 port using RS-232 for console access such as configuring the switch and maintenance.

Out of Band Management: RJ-45 Ethernet port for out-of-band management.

Two Ethernet LEDs (integrated with RJ-45 connector) to indicate speed and link status.

RLOM port: Remote Lights Out Management (RLOM) port for switch management. Review release notes for usage information.

USB port: Brocade branded USB only, used for firmware management and downloading system support (log) information.

Switch ID and MAC Address tab: Switch ID pull-out tab containing serial number and MAC address.

SFP+ ports 6 1/10 Gbps SFP+ ports and 48 1 Gbps RJ45 copper ports

Port LEDs (green/amber) to indicate status for each port

Revision 1011


11






RLOM port: Remote Lights Out Management (RLOM) port for switch management . Review release notes for usage information.



SFP+ ports 6 1/10 Gbps SFP+ ports and 48 1 Gbps RJ45 copper ports


VDX 110

Revision 1011

VDX 6710 and 6730 Hardware Overview

12

Note: The illustration shows only port numbers, not port groups. Port groups are described in the Architecture section.

Revision 1011


13

The integrated power supply/fans for the VDX 6710-54 and 6730-32 share the same part number. You can interchange the integrated power supply/fans but make sure the power supply/fan uses the correct airflow. The airflow options are described in more detail later in this module.

Also, the integrated power supply/fan FRU can also be used with the VDX 6720-24.

On the non-port side of the switch enclosure, each power supply/fan FRU has a green/amber LED to indicate the status of the FRU. A steady green light indicates that the FRU is on and operating normally. If there is an amber light, the power is faulty, indicates power is on or off.

Revision 1011


14






RLOM port: Remote Lights Out Management (RLOM) port for switch management . Review release notes for usage information.



SFP+ ports: 24 1/10 Gbps SFP+ ports and 8 Gbps FC ports

Port LEDs (green/amber) to indicate status for each port.

Revision 1011


15


Revision 1011


16

The integrated power supply/fans for the VDX 6710-54 and 6730-32 share the same part number. You can interchange the integrated power supply/fans but make sure the power supply/fan uses the correct airflow. The airflow options are described in more detail later in this module.

Also, the integrated power supply/fan FRU can also be used with the VDX 6720-24.

On the non-port side of the switch enclosure, each power supply/fan FRU has a green/amber LED to indicate the status of the FRU. A steady green light indicates that the FRU is on and operating normally. If there is an amber light, the power is faulty.

VDX 110

Revision 1011


17






RLOM port: Remote Lights Out Management (RLOM) port for switch management. Review release notes for usage information.



SFP+ ports 60 1/10 Gbps SFP+ ports and 16 8 Gbps FC ports


Revision 1011


18


Revision 1011


19

The VDX 6730-76 power supply can be used with the VDX 6720-60 switch. You can interchange the power supply FRU but make sure the power supply FRU uses the correct airflow. The airflow options are described in more detail later in this module.

On the non-port side of the switch enclosure, each power supply FRU has a green/amber LED to indicate the status of the FRU. A steady green light indicates that the FRU is on and operating normally. If off, then no AC power. If there is an amber light, the power is faulty. If off, then normal operation.

Revision 1011


20

Footnote 1: When ordering FRUs, verify that the part number supports the correct airflow.You must replace a failed unit with the same type of unit. This applies to both power supplies and fan assemblies.

A new FRU must have the same part number (P/N) as the FRU being replaced. The manufacturing P/N is located on the top of the FRU.

The P/N ends in either -F (front-to-back airflow) or -R (back/rear-to-front airflow). You must use a replacement FRU that the same airflow designator with the part number.

Additionally, you can use external labels as a guide. Some FRUs are labeled with an airflow symbol on the faceplate to indicate whether the assembly takes in or exhausts air. The symbol also appears on the top of the assembly.

Revision 1011


21

Footnote 1: Fully-loaded Brocade 6710-54 with two integrated fans and powers supply assemblies, and zero SFPs installed. For more information on specifications, review the Brocade 6720 data sheet available from www.brocade.com or review the Brocade 6710 Hardware Reference Manual.

Revision 1011


22

Revision 1011


23

Footnote 1: Optical media port status is for both 1 Gbps and 10 Gbps ports.

Revision 1011


24

Footnote 1: Fully-loaded Brocade 6730-32 with two integrated fans and powers supply assemblies, and zero SFPs installed. For more information on specifications, review the Brocade 6730 data sheet available from www.brocade.com or review the Brocade 6730 Hardware Reference Manual.

Footnote 2: Fully-loaded VDX 6730-76 with two power supplies, three fan assemblies, and zero SFPs installed. For more information on specifications, review the Brocade 6730 data sheet available from www.brocade.com or review the Brocade 6730 Hardware Reference Manual.

Revision 1011


25

Revision 1011


26

Revision 1011


27

Footnote 1: Replacement of the integrated power supply/fan FRU must match the airflow direction of the failed FRU. If the airflow does not match, a warning message is generated.

Footnote 2: Replacement power supply or fan must match airflow direction of the failed FRU.

When ordering FRUs, verify that the part number supports the correct airflow. You must replace a failed unit with the same type of unit. This applies to both power supplies and fan assemblies.

A new FRU must have the same part number (P/N) as the FRU being replaced. The manufacturing P/N is located on the top of the FRU.

If the P/N ends in either -F (front-to-rear airflow) or -R (rear-to-front airflow), you must use a replacement FRU that the same airflow designator with the part number.

Additionally, you can use external labels as a guide. Some FRUs are labeled with an airflow symbol on the faceplate to indicate whether the assembly takes in or exhausts air. The symbol also appears on the top of the assembly.

Revision 1011


28

VDX 110

Revision 1011


29

Footnote 1: An FCoE license enables FCoE on the Brocade VDX 6720 platforms. Since FCoE requires a VCS fabric, a VCS Fabric license is a prerequisite for enabling FCoE in a fabric with more than two switches. In addition, a separate FCoE license is required to enable FCoE on a VCS edge port. Without an FCoE license, FCoE logins are not permitted, and all FCoE commands with the exception of a few commands return an error of “No FCoE license present” when executed.

Footnote 2: Brocade Multi-Node license . Enables configuring a VCS Ethernet fabric with up to ten Brocade VDX 6710 or 6730 switches. (With NOS v2.1.1, you can have up to 24 Brocade VDX 6710 or 6730 switches in an Ethernet fabric.) When there are more than two switches in the fabric, each switch must have a VCS Multi-node license installed. You do not need a VCS multi-node license if your VCS fabric does not exceed a total of two Brocade VDX 6710 or 6730 switches.

Footnote 3: A Dynamic POD license allows you to instantly scale the fabric by provisioning additional ports on the Brocade VDX 6730 platforms. Licenses are assigned dynamically from a pool of resources based on auto-detection of active links. There is no POD license available for the VDX 6710 as all ports are active.

switch# show license id

rbridge-id License ID

========================================

2 10:00:00:05:1E:00:4C:80

Footnote 4: See release notes for more information.

Revision 1011


30

Note: You can also specify the rbridge id as shown below:

VDX3# show license rbridge-id 3

rbridge-id: 3

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

FCoE Base license

Feature name:FCOE_BASE


Ports on Demand license - additional 8 port upgrade license

Feature name:PORTS_ON_DEMAND_1


VCS Fabric license

Feature name:VCS_FABRIC

VDX 110

Revision 1011


31

For the VDX 6730-32, by default, FC ports 1 – 8 and ports 1-16 are active. Ports 17 – 24 can be activated with a POD license as shown in the illustration.

VDX 110

Revision 1011


32

For the VDX 6730-76 by default, FC ports 1 – 16 and ports 1 – 40 are active. Ports 41 – 60 can be activated with POD licenses (one license per 10 ports) as shown in the illustration.

VDX 110

Revision 1011


33

Revision 1011


34

Footnote 1: The management port 10/100/1000 Ethernet (RJ-45) includes two LEDs: link and activity. For link, on indicates link is active, off indicates no link. For Activity, blinking indicates activity and off indicates no activity.

The serial port parameters are fixed at the following: • 9600 baud• 8 data bits• No parity• No hardware flow control

The USB port is used for Brocade branded-USB drives which are used for firmware download and storing support information such as logs.

Footnote 2: Review the release notes for information on RLOM support.

Revision 1011


35

Revision 1011


36

As shown above, the VDX 6710-54 platform contains three eAnvil2 ASICs.

eAnvil2 – 1: Front end ports are 14 x 1 Gbe ports and 6 x 10 Gbe ports. It also has 4 x 10 Gbe back end connections to the eAnvil2 – 2 ASIC.

eAnvil2 – 2: Contains 13 x 1 Gbe front end ports and acts as a back end core ASIC for frame routing between the ASICs. There are 2 x 10 Gbe connections from the front end to the back end of the ASIC for routing to the other two ASICs.

eAnvil2 – 3: Contains 21 x 1 Gbe front end ports and 3 x 10 Gbe back end ports

Over subscription: There is no over subscription.

Revision 1011


37

VDX 110

Revision 1011


38

As shown above, the VDX 6730-32 platform contains one eAnvil2 and one Condor2 ASIC. The eAnvil2 ASIC support 2 RTE(Routing Engine) and each RTE supports 12, 10/1 Gbps Ethernet Ports. So every packet coming in through the external SFP+ interfaces destined to external ports are switched in a single stage within the eAnvil2 ASIC.

There is no over subscription for network traffic.

FC Traffic over subscription worst case would be 240:64 (15:4)

• 240 24 x 10 GbE FCoE devices

• 64 8 x 8 Gbps FC traffic between the eAnavil2 ASIC and the Condor 2

Revision 1011


39

Revision 1011


40

As shown above, the forwarding plane on VDX6730-76 platform contains nine eAnvil2 ASICs and one Condor2 ASIC. There are six eAnvil2 ASICs, each providing 10 external SFP+ interfaces, which are connected to three additional eAnvil2 ASICs providing the interconnectivity. The six front facing eAnvil2 ASICs support local switching. i.e if port-1 needs to send the data to port-2, the packet can be switched locally within a single eAnvil2 ASIC. However unlike the VDX6730-32 design, the incoming packets on SFP+ ports destined to an external port can now go through three different eAnvil2 ASICs if the source and destination port are on different eAnvil2 ASICs.

The Condor2 ASIC provides Fiber Channel switching functionality. Each of the six eAnvil2 ASICs are connected to the Condor2 ASIC using a 4 link trunk. The Condor2 ASIC provides 16 external 8G Fiber Channel interfaces.

Over subscription: There is no over subscription for traditional network traffic (non-FCoE) as each front end ASIC has 10 x 10 Gbe front end ports and 4x10 to each of the 3 back end ASICs to the maximum front end bandwidth would be 10 x 10 Gbe = 100 Gbe. The back end connections are 4 links x 10 Gbe x 3 (ASICs) = 120 Gbe bandwidth.

FC over subscription: The FC connections the front end eAnvil2 ASICs and the Condor2 is 4 x 8 so the worst case would be to have 10 FCoE devices on one front end ASIC (example ports 1-10). In that case the worst case FCoE traffic would be 100 Gbe to 32 FC (bandwidth connection from eAnvil2) to Condor2) 100:32 (25:8).

FCoE best practice: Unless you know the FCoE usage limit the FCoE connections 3 per ASIC. If this is done there would be no over subscriptions on the internal connections. Of course there would still be worst case over subscriptions 3 (FCoE connections) x 10 Gbe x 6 ASICs = 180 Gbe to 16 front end links x 8 Gbps = 128 Gbps (180:128 or 45;32). To insure no over subscription limit the FCoE device to 12 and put no more then 3 per eAnvil2 ASIC.

VDX 110

Revision 1011


41

Revision 1011


42

Revision 1011


43

Footnote 1: For information on updated optic (transceiver) part numbers, go to www.brocade.com. Search on the phrase, transceivers, to locate information on available optics and part numbers.

Revision 1011


44

Footnote 1: For information on updated optic (transceiver) part numbers, go to www.brocade.com. Search on the phrase, transceivers, to locate information on available optics and part numbers.

Revision 1011


45

Footnote 1: The maximum distance between VDX ILS’s is 200 m.

Revision 1011


46


47Revision 1011

Revision 1011


48

Revision 1011


49

Revision 1011


50

Footnote 1: The following items are required for configuring and connecting the VDX for use in a network and fabric:

• VDX installed and connected to a power source• Workstation with an installed terminal emulator, such as HyperTerminal• Two unused IP addresses and corresponding subnet masks and gateway addresses.

(One for the virtual IP address on the cluster interconnect and another for the management port.)

• Serial cable (provided)• Three Ethernet cables• SFPs and compatible cables, as required• Access to an FTP server for backing up the switch configuration (optional)• A USB stick for collecting the support data (optional). Only those commands supported

by Network OS, such as copy support-interactive. Refer to the troubleshooting module later in this course for specific commands and their usage.

Footnote 2: Follow the installation instructions shipped with the applicable rack mount kit.

Footnote 3: When mounting into a slide-rail rack, you can mount the chassis to slide from either the port side or the non-port side.

Revision 1011


51

Revision 1011


52

Revision 1011


53

Footnote 1: The integrated power supply/fans for the VDX 6710-54 and 6730-32 share the same part number. You can interchange the integrated power supply/fans but make sure the power supply/fan uses the correct airflow. Also, the integrated power supply/fan FRU can also be used with the VDX 6720-24.

Footnote 2: On the non-port side of the switch enclosure, each power supply/Fan FRU has a green/amber LED to indicate the status of the FRU. A steady green light indicates that the FRU is on and operating normally. If there is an amber light, the power is faulty.

Revision 1011


54

Footnote 1: Power is supplied to the switch as soon as the first power supply is connected and powered on.

Footnote 2: All devices are returned to their initial state the next time the switch is powered on.

Revision 1011


55

Revision 1011


56

For more information, refer to the Brocade VDX 6710 and 6730 Switch Power Supply/Fan Assembly Replacement Procedure.

Footnote 1 : If the airflow does not match, a warning message is generated. Below are example warning messages:

WARNING, Brocade6730, MISMATCH in PSU-FAN FRUS Air Flow direction. Replace PSU with fan air flows in same direction.

WARNING, Brocade6730, MISMATCH in FAN Air Flow direction. Replace FRU with fan air flows in same direction.

Revision 1011


57

Revision 1011


58

Footnote 1: The VDX 6730-76 power supply can be used with the VDX 6720-60 switch. You can interchange the power supply FRU but make sure the power supply FRU uses the correct airflow.

Footnote 2: On the non-port side of the switch enclosure, each power supply FRU has a green/amber LED to indicate the status of the FRU. A steady green light indicates that the FRU is on and operating normally. If off, then no AC power. If there is an amber light, the power is faulty. If off, then normal operation.

Revision 1011


59

Footnote 1: If the airflow does not match, a warning message is generated. Below are example warning messages:



Revision 1011


60

Revision 1011


61

Footnote 1: The VDX 6730-76 fan FRU can be used with the VDX 6720-60 switch. You can interchange the fan FRUs but make sure you order fan FRU uses the correct airflow.

Footnote 2: The three fan FRUs are designed as hot-swappable in a redundant N+1 configuration to ensure that the VDX 6720-60 continues to operate indefinitely and non-disruptively in the event of a single fan FRU failure.

Footnote 3: On the non-port side of the switch enclosure, each fan FRU has a green/amber LED to indicate the status of the FRU. A steady green light indicates that the FRU is on and operating normally. If off, then there is no AC power. If there is an amber light, the fan is faulty. If off, then that indicates normal operations.

Revision 1011


62

Footnote 1: If the airflow does not match, a warning message is generated. Below are examples of warning messages:



Revision 1011


63

Revision 1011


64

Revision 1011


65

Footnote 1: Here is example of the show version command:

VDX3# show version

Network Operating System Software

Network Operating System Version: 2.1.0

Copyright (c) 1995-2010 Brocade Communications Systems, Inc.

Build Time: 23:39:40 Aug 31, 2011

Firmware name: v2.1.0_beta1

Control Processor: Freescale Semiconductor 8548E with 2000 MB of memory

Appl Primary/Secondary Versions

------------------------------------------

NOS v2.1.0

v2.1.0

Revision 1011


66

Revision 1011


67

vdx 110 wbt_vdx 6710 6730 hw overview(full permission)

Documents