data center cable standar

8/12/2019 Data Center Cable Standar

1/65


2/65


3/65

3 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Introduction to new standards-based data

center & storage area network designSelecting the optimal fiber structuredcabling system for your data center &

storage area network

Todays AgendaDesigning a Fiber SCS for the Data Center


4/65


5/65


2002 new information production: 5 exabytes 1 exabyte 1,000,000,000,000,000,000 bytes New digital information = 1 Library of Congress every 15 minutes

Four primary physical media

Print Film Magnetic Optical

350% more information communicated than stored (2002: 18 exabytes)Four electronic channels Telephone Radio Television

InternetSource: How Much Information 2003?, School of InformationManagement & Systems at University of California at Berkeley

New information doubled in last 3 years

New Information GenerationSignificant Annual Increases


6/6511/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Why is Network Traffic Growing? A Global Bandwidth Binge

New bandwidth intensiveapplications growing

62% new capacity added in 200342% increase in bandwidthdemand in 2004

Demand for video could strainnetworks

Source: TeleGeography, April 2005

2002 2003

W or l d wi d

eA v ai l a b l eB an d wi d t h


7/657 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Why Are Data Center & SANs Growing?U.S. Legislation & Recommendations

Sarbanes-Oxley Act

Health Insurance Portability & Accountability Act (HIPAA)

Graham-Leach-Bliley Financial Services Modernization Act U.S Federal Reserve

Securities & Exchange Commission Rule 17a

SB 1386 - California



Introduction to new standards-based datacenter & storage area network design Information generation & storage trends Data center & storage area network growth Introduction to the new TIA-942 data center

standard



DefinitionsData Center & Storage Area Network

Data Center The factory floor of the

information age

ISP : Specialized facility thathouses web sites & providesdata serving & other servicesfor other companies

Enterprise: Central dataprocessing facility and/or thegroup of people who managethe enterprises data

processing & networks

Storage Area Network (SAN) High-speed special purpose network

(or subnetwork) that interconnects

different kinds of data storagedevices with associated dataservers on behalf of a largernetwork of users

Usually located in Data Center

Source: http://www.whatis.com



The Integrated Enterprise NetworkLAN, Data Center & SAN

Physical layer Copper & optical

fiber cablingsubsystems

Interconnectdevices Hubs, switches &

directors

Translation devices Host bus adapters Routers Gateways Bridges


11/65


12/6511/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Networked Storage GrowthOutpaces Overall Storage Market Growth

Network Attached Storage (NAS)& Storage Area Networks (SANs) 2004: 50% of overall storage market 12% CAGR vs. 5% 2005: 38% Fibre Channel port

shipment growth

Dollars invested 18% of total I.T. budget 60% of hardware budget

Source: Dell Oro Group 2005, iSuppli Corporation, 2004

0.0

20.0

40.0

60.0

80.0

100.0

120.0

140.0

2004 2005

Fibre Channel Port Shipments



Data Center/SAN Media MixEstimated Percentages Copper & Fiber

80%

20%

Copper Fiber

Data Center Media Mix

10%

90%

Copper Fiber

SAN Media Mix



Fibre Channel Technology in SANsShort Wavelength VCSELs the Dominant Device

0

5,000

10,000

15,000

20,000

2001 2002 2003 2004 2005 2006 2007 2008

8 Gbps4 Gbps2 Gbps1 Gbps

Source: High Speed Optical Data Link Modules,Market Review & Forecast, Strategies Unlimited, 2002

Fibre Channel Units in Thousands



Fiber ServicePlatform




FSP ManagementSuite

CWDM or DWDMover single-mode fiber Channel director Channel director

DataCenter

Servers

Storage

BackupCenter

Servers

Storage

Source: Lightwave , January 2004,Todd Bundy, ADVA Optical Networking

Remote Data Centers & SANsCost-effective DWDM/CWDM Technology



Data Center Upgrade ExampleFor 50% Annual Storage Capacity Growth

10,000 ft 2 data center50% annual capacity increase typical

Doubling of floor space required every 3-5 yearsData center floor space cost: $700-1200/ft 2

Upgrade cost: $8-12 million over 3 year period

Source: The Meta Group, Room at the Data Center? 8-01



Insufficient DC/SAN Infrastructure InvestmentThe Costs are Staggering

Ramifications Minimized customer transactions, interactions

& sales volumes

Decreased revenuesNetwork downtime estimates: Pay-per-view TV operator: $125,000 per hour

Credit card authorization company:$2,600,000 per hour Retail brokerage: $6,400,000 per hour

Source: Lightwave , January 2004Todd Bundy, ADVA Optical Networking


18/65


19/65



Do We Really Need Another Standard?Dont We Already Have Too Many?



Data Center Cabling StandardsStructured Cabling Systems for the Data Centers & SANs

TIA-942 Telecommunications Infrastructure Standard for Data Centers Published: April 2005 Order from Global Engineering Documents ( www.global.ihs.com )

CENELEC EN 50173-5

Information technology - Generic cabling systems Part 5: Data Centres Expected publication: Early 2006

EN 50174-2 Amendment Adds Annex on Data Center planning & installation

ISO/IEC Generic Cabling for Data Centres Proposed

ISO/IEC JTC-1/SC 25/WG 3



TIA-942 Data Center StandardObjective

Requirements & guidelines for the design &installation of a data center or computer roomIntended for use by designers needing thoroughunderstanding of data center designComprehensive document

Access

Redundancy Electrical design Location

Water intrusion Environmental design Network Design

Fire protection Architectural design Cabling



Data Center Structured Cabling System9 Elements Comprise TIA-942

1. Computer room2. Telecommunications room3. Entrance room4. Main distribution area5. Horizontal distribution area6. Zone distribution area7. Equipment distribution area8. Backbone cabling9. Horizontal cabling

Spaces

Cabling subsystems


24/65


25/65


TIA-942 Data Center StandardSupported Architectures

Basic data center topology

Distributed data center topologyReduced data center topology

Centralized fiber optic cabling topology


26/65


Basic Data Center Topology And TIA/EIA-568-B Counterparts

Entrance Room Analogy: Entrance Facility

Main Distribution Area (MDA) Analogy: Equipment Room

Horizontal Distribution Area(HDA) Analogy: Telecom Room

Zone Distribution Area (ZDA) Analogy: Consolidation Point

Equipment Distribution Area(EDA) Analogy: Work Area


27/65


Distributed Data Center TopologyWith Multiple Entrance Rooms

May be required for largedata centersCircuit distancelimitations may require

multiple entrance roomsPrimary entrance roomhas no directconnections to HDA

Secondary entranceroom may be directlyconnected to HDAconditionally


28/65


Reduced Data Center TopologyFor Many Enterprise Installations

HDA combined with MDATelecom room can alsobe consolidated intoMDACopper or fiber in the

horizontal


29/65


Data Center Centralized Fiber CablingSignificant Cost Savings Possible

Alternative to optical cross-connection in the horizontaldistribution areaNo electronics in horizontaldistribution area (HDA)Centralized electronicsCost reduction factors Smaller, simpler HDA Faster & easier installation &

testing Fewer idle ports Centralized administration Simplified moves, adds &

changesVisit TIA Fiber Optics LAN Section web site forinformation on centralized fiber cabling: www.fols.org


30/65


TIA/EIA-942 (2005) EN 50173-5 (2006)

ZD

ZD

MD

ENI

EO

EO

LDP

ENI

EO

EOEO

EO

M ai n

Di s

t r i b u t i onAr e

a

Entrance Room

H or i z

on

t al

Di s

t r i b u t i o

nAr e

a

EquipmentDistribution

Area

Z on

e

Di s

t r i b u t i on

Ar e

a

TIA-942 & Draft EN 50173-5 ComparedSimilarities & Differences

Courtesy: Mike Gilmore, e-Ready Building Limited (2004)

Equipment Outlet (EO)Connection point within the EDA

Local Distribution Point (LDP)Connection point within the ZDA

Zone Distributor (ZD)Functional distribution element within the HDA

Main Distributor (MD)Functional distribution element within the MDA

Equipment Network Interface (ENI)Connection point to the outside world


31/65


Media SelectionDesign Considerations per TIA-942

Flexibility with respect to supported services

Required useful life of cabling

Facility site/size & occupant population

Channel capacity within the cabling system

Equipment vendor recommendations or specifications

Same facility architecture if different media types used


32/65


33/65


Data Center CablingDesign Recommendations (Informative) - Optional

Copper design (informative) Adequate spacing for labeling on each patch panel Label each port per Annex B and ANSI/TIA/EIA-606-A

Fiber design (informative) Installation time reductions Multi-fiber increments & multi-fiber connectors Pre-calculated, pre-terminated multi-fiber ribbon assemblies Consider performance effects of additional connections

Per TIA-942


34/65


35/65


Introduction to new standards-based datacenter & storage area network designSelecting the optimal fiber structuredcabling system for your data center &storage area network


36/65


37/65


Higher Speed Networks More DemandingFiber, Cable & Connectivity Choices Critical

Fiber cable plant loss budgets continue to decrease Widely perceived 2.6 dB budget for 10 Gbps Ethernet

& Fibre Channel Installation techniques more challenging Advanced fiber SCS technology provides new options


38/65


OFL = Overfilled launchEMB = Effective modal (laser) bandwidth

OM1, OM2, OM3 designationsPer ISO/IEC 11801, 2nd Edition

MinBandwidth

(MHz km) Fiber type Wavelength

(nm) MaxLoss

(dB/km) OFL EMB

1 Gb/sReach(meters)

10 Gb/sReach(meters)

62.5 m (OM1) 8501300 3.51.5 200500 n.s.*n.s. 275550 33300

50 m (OM2) 8501300

3.51.5

500500

n.s.n.s.

550550

82300

850-nm 10G Laser-Optimized

50 m (OM3)

8501300

3.51.5

1500500

2000 n.s.

1000 600

300 300

Multimode FibersIndustry Standard Types

*n.s. = Not specified


39/65


Multimode Fiber TypesBandwidth Comparison

62.5/125 m200/500 MHz-km

50/125 m500/500 Hz-kmOM3 (50/125 m)

2,000/500 MHz-km


40/65


Ethernet Fiber Loss Budgets DecreasingDue to Ever Increasing Speeds

2.60IEEE 802.3ae10GBASE-SR*10,000 Mbps10 Gigabit Ethernet 2004

3.56IEEE 802.3z1000BASE-SX1,000 Mbps1 Gigabit Ethernet 2000

4.0TIA/EIA-785100BASE-SX10/100 MbpsShort WavelengthFast Ethernet

Late 90s

11.0IEEE 802.3100BASE-FX100 MbpsFast Ethernet Early 90s

12.5IEEE 802.310BASE-FL10 MbpsEthernet Early 80s

Cable PlantLoss Budget(db)

StandardDesignationData RateApplicationYear

Insertion loss values are for maximum distance specified in the standard

& can vary based on the distance & number of connections


41/65


Fibre Channel Loss Budgets Also DecreasingThe Predominant Protocol in Storage Area Networks

2.60.5 300*1200-M5-SN-I10 GbpsFibre Channel




Cable Plant LossBudget (db)

SupportedDistance (m)*

DesignationDataRate

Application

*Supported distances using 2,000 MHz-km850 nm laser optimized 50 m multimode fiber

Insertion loss values are for maximum distance specified in the standard& can vary based on the distance & number of connections


42/65


Reliable, high bandwidth networks requiredThe optimal solution: systems engineered, manufactured &independently verified to meet & exceed worldwide standards

requirementsPerformance of individual fiber network elements critical1. Electronics: Fully qualified devices with high laser coupling efficiency

2. Fiber: Low DMD or high EMB c3. Cable: Low attenuation4. Apparatus: Reduced insertion loss per mated pair

Key Elements of a Robust DC/SANTo Support Multiple Generations of Electronics


43/65


850 nm laser spot projected

on 50 m fiber core

850 nm operating wavelength morecost effectiveSmall Form Factor Pluggable (SFP)modules dominant Broad manufacturer availabilityFully qualified devicesrecommended

Ethernet & Fibre Channel TransceiversLook For High Laser Coupling Efficiency

Most power is inside9-38 m donut


44/65


Cables with low attenuationtested & verified not todegrade fiber performancein 10 Gbps networksTight control over bufferuniformity & concentricity forhighest connectorperformance

Cable Design & ManufacturingCan Affect 10 Gbps Performance


45/65


46/65


Look for polishing techniques yielding ideal tip geometryEnd-face quality a key factor for maximum link performanceObjectives: minimum insertion loss; maximum return loss

Ideal polish : connector ferrule/fiber end-face scan showing ideal contour

Poor polish : fiber depressed intoferrule, causing poor performance

Optimum Connector PerformanceCreates a Lens at the Tip of the Connector

Maximum 10 Gbps system performance


47/65


Power budget consumed byvarious impairments Cross noise Receiver eye opening

Relative intensity noise Mode partition noise Inter-symbol interference (ISI) Channel insertion loss

Robust fibre solutions Low insertion loss Low Differential Mode Delay (DMD) Borrow budget from other areas for

channel insertion loss

Cross noiseReceiver eye opening

Relative intensity noise

Mode partition noise

Inter-symbol interference (ISI)

Channel insertion loss (ChIL) T o

t a l A v a

i l a b l e P o w e r

i n d B

10 Gbps Multimode Cabling SystemIEEE Link Model 850 nm Serial, 2,000 MHz-km MMF

75% of total penalty


48/65


Reallocating ISI Loss PenaltyUsing State-of-the-Art Fiber Technology

Ideal application to MTP/MPO-based systems

Ideal for data centers & SANs

Exchange ISI for channel insertion loss


49/65


FC Switch

FC-AL HubLC

MTP/MPO

MTP/MPO

Patch panel(interconnect)

Ribbon

backbonecable or distribution

cable

Modular pre-terminatedoptical cassette

systems

LCLC

M

Easy to Configure Data Center SystemsFibre Channel Example, 2 MTP /MPOs & 3 LC Connections

Example SAN or datacenter fiber link designStandard OM-3 fiber maynot support number ofconnectionsState-of-the-art LOMF fiber & low insertion lossconnectors


50/65


Why is the choice of a fiber structured cabling system soimportant in data centers & SANs?

Guidelines for selecting the fiber termination methodConnecting the system elements together

AgendaSelecting the Optimal Fiber SCS for your Data Center & SAN


51/65


Available Fiber Termination MethodsMultiple Solutions for Data Centers & SANs

Multimode Cassette-basedPre-terminatedField-terminated

Single-modeCassette-basedPre-terminatedField-terminated


52/65


Cassette-Based DC/SAN SolutionRibbon Backbone or Ribbonized Fiber Cable

Definition : Ribbon backbone or reduced diameter loose tubecable terminated with MTP/MPO connectors designed tointerface with optical cassette system

Ideal for use in the Zone Distribution Area (ZDA)


53/65


Cassette-Based DC/SAN SolutionSelection Criteria

Guaranteed optical performanceFactory terminated solution

Designed for interoperabilityIntegrated system

Integration with existing systemsDistributes optical signals to common LC & SC interfaces

Significant cost savingsEasy, fast, error-free installation

Standards-based systemCompliant with TIA SP-3-4424-AD7*

Greatly simplified connectivityCassette supports multiple fibers

Ideal for data centers & SANsHighly reliable

dvantageesign Element

*to become TIA/EIA-568-B.3, Addendum 7


54/65


Pre-Terminated DC/SAN SolutionTime & Labor Saving Backbone Cable Designs

Definition : Backbone cable with factory installed connectorsextending from rear of adapter panel to mating end of anotheradapter panel in another rack


55/65


Pre-Terminated DC/SAN SolutionSelection Criteria

Guaranteed optical performanceFactory terminated solution

Solution for every applicationDistribution, armored, or reduced diameter plenum cable

Better air flow & less congestionSmaller overall cable diameter & cross-sectional areas

Reduced on-site time & labor costsFast & easy installation

Facilitates cable routing & dressingMultiple optical links contained in one sheath

dvantageesign Element


56/65


57/65


Adhesive holds the fiber firmlyin the connector ferrule

Excess fiber isscored &removed

The remaining fiber and adhesiveis polished down to the end-faceof the ferrule

Fiber end polished to sameradius curve as ferrule end-face

Cordage secured inconnector by adhesivemethod

Adhesive/polish TerminationPopular Field-Installable Connector


58/65


No-polish TerminationReduced On-Site Labor Costs

Fiber endpolished andtested at thefactory to sameradius curve asferrule end-face

Adhesive holds thefactory-installed fiber stubfirmly in the connectorferrule

Drop of index-matching gel providesoptical interface for cleaved fibers

Mechanical splice joins factory-installedfiber stub and fiber being terminated


59/65


60/65


Why is the choice of a fiber structured cabling system soimportant in data centers & SANs?

Guidelines for selecting the fiber termination methodConnecting the system elements together

AgendaStructured Cabling Systems in Data Centers & SANs


61/65


Cassette-Based Data Center SolutionChannel Components for 10 Gbps Multimode System


62/65


63/65


Field-Terminated Data Center SolutionChannel Components for 10 Gbps Multimode System

Cable ManagementRack

Rack Mount

Fiber Patch Cabinet

Cable ManagementRack

LOMF Fiber Patch Cord

LOMF Fiber Patch Cord

Rack MountFiber Patch Cabinet

LC Adapter Panel24 Fiber

SC Adapter Panel12 Fiber


64/65


SummaryData Centers & SANs: Rapidly Growing SCS Applications

Vast amounts of new information being created,communicated & storedLegislation & other business priorities impacting data center &

storage area network growthThe TIA-942 Data Center Standard applies structured cablingprinciples as TIA/EIA-568 did for commercial buildings

Careful choice of structured cabling system products shouldspan multiple of generations of data center systems


65/65