saving energy with smart cabling

October 31, 2007

Saving Energy With 'Smart' Cabling

Mike Cooper, RCDD

Systems Application Engineer, Netconnect Data Center Solutions

[email protected]

October 31, 2007page 2 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute


• High bandwidth cabling?

• High density cabling?

• Intelligent cabling?

• Well designed cabling?

What is “ smart” cabling?


Impact of Power Density

• Power Density is increasing on average 15-20% per year within the data Center

– Individual server power density

– IT Technology refresh activity

– Server footprint

• Methods of measuring efficiency within the DC are outdated

– Watts/sq meter are no longer useful in deciding server

deployment strategies

• Key to success is balancing infrastructure investments with IT goals model


Power- Where is it Going?

Sources: EYP Mission Critical Facilities, Cisco IT, Network World, Customer Interviews, APC

Reducing Data Center power consumption is a multi-faceted challenge. All areas need to be addressed to maximize data center compute capacity and minimize power costs.

Netw ork Equip, 12%

Pw r Los s , 10%

Light ing, 3%

Cooling, 50%Server , 25%

NOTE: Industry rule of thumb is that approx 25% of Data Center Power goes to networking equipment and typically includes cooling and power requirements.


Application Cabling Power Measurements

• Power consumption due to Ethernet links

• Power measurement of

– LAN switch

– 1000 Base-T NIC

How much power use is direct from the network?



• Power use measurement

– 24-port LAN switch

– No. of Active configured links

83.771.971.98

80.271.171.66

76.770.071.14

72.970.170.22

69.1 W 69.1 W 69.1 W 0

1000 Mb/sec100 Mb/sec10 Mb/sec# ports

At 1000 Mb/sec it is about1.8 W added per active link

10 and 100 Mb/sec are about the same


• Power use measurements

Idle Link (no activity)

.6645.1113010

1.145.11224100

3.915.087701000

Power

(W)

Voltage

(V)

Current

(mA)

Rate

(Mb/s)

Active Link (file transfer)

.6335.1112410

1.145.11224100

3.905.087681000

Power

(W)

Voltage

(V)

Current

(mA)

Rate

(Mb/s)Difference between 1000 and 10 Mb/sec is about 3.2 W

Measured at PCI bus (DC)

No significant difference betweenidle and active link



Current application benefits

• Density, modularity & performance

on equipment and in infrastructure

• MRJ21™ provides Hi-D Green GbE

– Connector: 1/3 -1/4 RJ45 cassette

– Cable: 30% smaller, 20% lighter

• 1 cable vs. wrapped 6-cable bundle

– Eco-Friendly

– All components permanent link tested,

documented and serialized

– Pwr: 7-15% less than RJ45 in 2x ports

– 10G Shielded Version in process

1.14” x.74”

6 GbE ports

MRJ21™MPO

Euro


Network Vendors with Hi-Density GbE Equipment

• Alcatel – OmniSwitch– Lucent– TiMetra

• Barco Xenia• EIT• EntriSphere • Foundry Networks• Force10 Networks • Fujitsu • IBM • Motorola • NMS Communications • Proworks

• Shanghai Electronics• Stratex Networks• Tellabs / Vivace• UT Starcom

Force10 E120090 GbE ports/card

Foundry BigIron RX-4,8, & 1648 GbE ports/card

Note: The vendors listed and shown have publicly launched MRJ21 equipment into the marketplace. Vendors not listed should be contacted directly for program status updates.

IBM eServerBladeCenter Copper Pass-

thru module 15 GbE ports

Alcatel OmniSwitchNI48 card


• 10GB-T PHY optimized for 100m UTP Cabling

– 15-20W (in 90nm) (1000B-T: 500mW)

– Problem for High Density Line Cards, PCI Cards, MBs

– 2.5us latency (1000B-T: 250ns)

– Too high for some High Performance Applications, Fibre Channel,

InfiniBand

– Power Hungry AFE (Analog Front End)

– 50% of Power is in AFE

• Not likely to improve much over time

– Large percentage of the power is in the AFE

– Power reductions in smaller process geometries are questionable

10G Base-T Application Cabling Power


• Summary of power measurements

0

5

10

15

Link speed (Mb/sec)

Pow

er u

se (

W)

10 100 1000 10000

10G Base-T is a power concern

g00.xls

10G Base-T Application Cabling Power


• Power Dissipation

– 3W Typical, 4W Worst Case

• Latency

– Less than 500ns

– Goal of 250ns

• Low Cost

– Significant SNR Margin

(1000B-T: 10dB)

– Demonstrable Design of 1M Gates

(2x 1000B-T)

• Short Reach

– 30m on STP/FTP Cable (field

configurable)

– 2 Connector, 3 Links Segments

– Goal of 45m

• Auto Negotiation Compatible

– RJ-45 Connector

– Backwards Compatible with 100B-T /

1000B-T over UTP

10G Base-T Application Shielded Cabling Power


Characteristics of Data Center Cabling

• 90% of Links are in Server Rooms Less Than 1,524 m^2 (5,000’)

(100% <= 30m)

• 5% of Links are in S. Rooms Between 1,524 m^2 and 6,096 m^2 (5,000’~20,000’)

(80% <= 30m)

• 5% of Links are in Server Rooms Greater Than 6,096 m^2 (20,000’)

(55% <= 30m)

• => 97% Coverage with 30m

• => 99% Coverage with 45m


• Networking power consumption is a significant portion of energy use

in data Centers.

• Other elements within the data Center can modulate power

to required performance

• Installing shielded cabling can allow the reduction of Network power

requirements for 10G Base-T by up to 75%

10G Base-T Application Shielded Cabling Power


• Past / current practice

– Design for maximum performance and ensure maximum power

condition can be powered / cooled.

• Future practice needs

– Design for normal usage, ensuring maximum energy efficiency at

that operating point

– Lower energy use at lower utilization

– Design for minimum energy usage over operational lifetime

Energy Efficient Ethernet


• 1 Gb/s

– Most NIC’s and most energy to be saved

– Substantial benefits for homes and offices

– Battery life benefit for notebooks

• 10 Gb/s (copper)

– Reduces power burden in data centers

– Reduces cooling burden in data centers

– May increase switch/router port capacity



• Imagine:

• Some means of changing PHY speed for major copper PHY’s:

– Change between 1000BASE-T & 100BASE-TX based on actual

utilization.

– Change between 10GBASE-T & 1000BASE-T based on actual

utilization.



• Potential estimated energy savings:

• Commercial (Office)

– PCs, switches, printers, etc.

– 1.47 to 2.21 TWh/year

– $283 to $522 million/year

• Data Centers

– Servers, storage, switches, routers, etc.

– 0.53 to 1.05 TWh/year

– $106 to $211 million/year



• In the Data Center 10 GbE has

penetrated into the access layer

much faster than in the traditional

network environment

• Adoption of 10GbE on the server

infrastructure will drive the need for

100GbE uplinks from the access to

the core of the data centers.

Server Farms

Storage/Tape Farms

Edge

Core

A B

Next Generation Ethernet Networks



Power Consumption

Cooling Requirements

Transceiver Size

~2W ~8-15W

Fiber Copper

Data Center Area $ $$$$



•New high density MPO transceivers

•For 40 Gb/s, commercially available today

•12 channels running at BER <10-12, link length 316m using OM3 fibre

•Utilizing 12 core ribbon fibre cable

•12 channels, 9.9-11.0 Gb/s/channeltester designed and built.


• Fibre Optic Transceiver Power estimates

– High Bandwidth

– Low Power

30*1,200124 - 10

30*1,200128 - 12

60*2,400246

12*300 310

Total W per boardTotal Gb/s per board# Transceivers per

board

# Channels


* Based on Existing 850nm lasers



• Cabling Technology that allows the support of new technologies at low power consumption.

• Cabling that is forward compatible with data center technology trends.

• Cabling that utilises new connector technologies that will be compatible with the next generation interconnects.

• Cabling solutions that provide a positive impact in the power vs. bandwidth battle.

What is “ smart” cabling?

October 31, 2007

Thank You!

saving energy with smart cabling

Documents

power costs

power requirements

afe power reductions

data center power consumption

high density cabling

utp cabling

designed cabling

intelligent cabling