saving energy with smart cabling

October 31, 2007

Saving Energy With 'Smart' Cabling

Mike Cooper, RCDD

Systems Application Engineer, Netconnect Data Center Solutions

mike.cooper@tycoelectronics.com

October 31, 2007page 2 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Saving Energy With 'Smart' Cabling

• High bandwidth cabling?

• High density cabling?

• Intelligent cabling?

• Well designed cabling?

What is “ smart” cabling?

October 31, 2007page 3 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Impact of Power Density

• Power Density is increasing on average 15-20% per year within the data Center

– Individual server power density

– IT Technology refresh activity

– Server footprint

• Methods of measuring efficiency within the DC are outdated

– Watts/sq meter are no longer useful in deciding server

deployment strategies

• Key to success is balancing infrastructure investments with IT goals model

October 31, 2007page 4 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Power- Where is it Going?

Sources: EYP Mission Critical Facilities, Cisco IT, Network World, Customer Interviews, APC

Reducing Data Center power consumption is a multi-faceted challenge. All areas need to be addressed to maximize data center compute capacity and minimize power costs.

Netw ork Equip, 12%

Pw r Los s , 10%

Light ing, 3%

Cooling, 50%Server , 25%

NOTE: Industry rule of thumb is that approx 25% of Data Center Power goes to networking equipment and typically includes cooling and power requirements.

October 31, 2007page 5 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Application Cabling Power Measurements

• Power consumption due to Ethernet links

• Power measurement of

– LAN switch

– 1000 Base-T NIC

How much power use is direct from the network?

October 31, 2007page 6 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Application Cabling Power Measurements

• Power use measurement

– 24-port LAN switch

– No. of Active configured links

83.771.971.98

80.271.171.66

76.770.071.14

72.970.170.22

69.1 W 69.1 W 69.1 W 0

1000 Mb/sec100 Mb/sec10 Mb/sec# ports

At 1000 Mb/sec it is about1.8 W added per active link

10 and 100 Mb/sec are about the same

October 31, 2007page 7 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Power use measurements

Idle Link (no activity)

.6645.1113010

1.145.11224100

3.915.087701000

Power

(W)

Voltage

(V)

Current

(mA)

Rate

(Mb/s)

Active Link (file transfer)

.6335.1112410

1.145.11224100

3.905.087681000

Power

(W)

Voltage

(V)

Current

(mA)

Rate

(Mb/s)Difference between 1000 and 10 Mb/sec is about 3.2 W

Measured at PCI bus (DC)

No significant difference betweenidle and active link

Application Cabling Power Measurements

October 31, 2007page 8 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Current application benefits

• Density, modularity & performance

on equipment and in infrastructure

• MRJ21™ provides Hi-D Green GbE

– Connector: 1/3 -1/4 RJ45 cassette

– Cable: 30% smaller, 20% lighter

• 1 cable vs. wrapped 6-cable bundle

– Eco-Friendly

– All components permanent link tested,

documented and serialized

– Pwr: 7-15% less than RJ45 in 2x ports

– 10G Shielded Version in process

1.14” x.74”

6 GbE ports

MRJ21™MPO

Euro

October 31, 2007page 9 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Network Vendors with Hi-Density GbE Equipment

• Alcatel – OmniSwitch– Lucent– TiMetra

• Barco Xenia• EIT• EntriSphere • Foundry Networks• Force10 Networks • Fujitsu • IBM • Motorola • NMS Communications • Proworks

• Shanghai Electronics• Stratex Networks• Tellabs / Vivace• UT Starcom

Force10 E120090 GbE ports/card

Foundry BigIron RX-4,8, & 1648 GbE ports/card

Note: The vendors listed and shown have publicly launched MRJ21 equipment into the marketplace. Vendors not listed should be contacted directly for program status updates.

IBM eServerBladeCenter Copper Pass-

thru module 15 GbE ports

Alcatel OmniSwitchNI48 card

October 31, 2007page 10 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• 10GB-T PHY optimized for 100m UTP Cabling

– 15-20W (in 90nm) (1000B-T: 500mW)

– Problem for High Density Line Cards, PCI Cards, MBs

– 2.5us latency (1000B-T: 250ns)

– Too high for some High Performance Applications, Fibre Channel,

InfiniBand

– Power Hungry AFE (Analog Front End)

– 50% of Power is in AFE

• Not likely to improve much over time

– Large percentage of the power is in the AFE

– Power reductions in smaller process geometries are questionable

10G Base-T Application Cabling Power

October 31, 2007page 11 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Summary of power measurements

0

5

10

15

Link speed (Mb/sec)

Pow

er u

se (

W)

10 100 1000 10000

10G Base-T is a power concern

g00.xls

10G Base-T Application Cabling Power

October 31, 2007page 12 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Power Dissipation

– 3W Typical, 4W Worst Case

• Latency

– Less than 500ns

– Goal of 250ns

• Low Cost

– Significant SNR Margin

(1000B-T: 10dB)

– Demonstrable Design of 1M Gates

(2x 1000B-T)

• Short Reach

– 30m on STP/FTP Cable (field

configurable)

– 2 Connector, 3 Links Segments

– Goal of 45m

• Auto Negotiation Compatible

– RJ-45 Connector

– Backwards Compatible with 100B-T /

1000B-T over UTP

10G Base-T Application Shielded Cabling Power

October 31, 2007page 13 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Characteristics of Data Center Cabling

• 90% of Links are in Server Rooms Less Than 1,524 m^2 (5,000’)

(100% <= 30m)

• 5% of Links are in S. Rooms Between 1,524 m^2 and 6,096 m^2 (5,000’~20,000’)

(80% <= 30m)

• 5% of Links are in Server Rooms Greater Than 6,096 m^2 (20,000’)

(55% <= 30m)

• => 97% Coverage with 30m

• => 99% Coverage with 45m

October 31, 2007page 14 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Networking power consumption is a significant portion of energy use

in data Centers.

• Other elements within the data Center can modulate power

to required performance

• Installing shielded cabling can allow the reduction of Network power

requirements for 10G Base-T by up to 75%

10G Base-T Application Shielded Cabling Power

October 31, 2007page 15 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Past / current practice

– Design for maximum performance and ensure maximum power

condition can be powered / cooled.

• Future practice needs

– Design for normal usage, ensuring maximum energy efficiency at

that operating point

– Lower energy use at lower utilization

– Design for minimum energy usage over operational lifetime

Energy Efficient Ethernet

October 31, 2007page 16 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• 1 Gb/s

– Most NIC’s and most energy to be saved

– Substantial benefits for homes and offices

– Battery life benefit for notebooks

• 10 Gb/s (copper)

– Reduces power burden in data centers

– Reduces cooling burden in data centers

– May increase switch/router port capacity

Energy Efficient Ethernet

October 31, 2007page 17 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Imagine:

• Some means of changing PHY speed for major copper PHY’s:

– Change between 1000BASE-T & 100BASE-TX based on actual

utilization.

– Change between 10GBASE-T & 1000BASE-T based on actual

utilization.

Energy Efficient Ethernet

October 31, 2007page 18 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Potential estimated energy savings:

• Commercial (Office)

– PCs, switches, printers, etc.

– 1.47 to 2.21 TWh/year

– $283 to $522 million/year

• Data Centers

– Servers, storage, switches, routers, etc.

– 0.53 to 1.05 TWh/year

– $106 to $211 million/year

Energy Efficient Ethernet

October 31, 2007page 19 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• In the Data Center 10 GbE has

penetrated into the access layer

much faster than in the traditional

network environment

• Adoption of 10GbE on the server

infrastructure will drive the need for

100GbE uplinks from the access to

the core of the data centers.

Server Farms

Storage/Tape Farms

Edge

Core

A B

Next Generation Ethernet Networks

October 31, 2007page 20 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Next Generation Ethernet Networks

Power Consumption

Cooling Requirements

Transceiver Size

~2W ~8-15W

Fiber Copper

Data Center Area $ $$$$

October 31, 2007page 21 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Next Generation Ethernet Networks

•New high density MPO transceivers

•For 40 Gb/s, commercially available today

•12 channels running at BER <10-12, link length 316m using OM3 fibre

•Utilizing 12 core ribbon fibre cable

•12 channels, 9.9-11.0 Gb/s/channeltester designed and built.

October 31, 2007page 22 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

• Fibre Optic Transceiver Power estimates

– High Bandwidth

– Low Power

30*1,200124 - 10

30*1,200128 - 12

60*2,400246

12*300 310

Total W per boardTotal Gb/s per board# Transceivers per

board

# Channels

Next Generation Ethernet Networks

* Based on Existing 850nm lasers

October 31, 2007page 23 /Information is Tyco Electronics Confidential & ProprietaryDo Not Reproduce or Distribute

Saving Energy With 'Smart' Cabling

• Cabling Technology that allows the support of new technologies at low power consumption.

• Cabling that is forward compatible with data center technology trends.

• Cabling that utilises new connector technologies that will be compatible with the next generation interconnects.

• Cabling solutions that provide a positive impact in the power vs. bandwidth battle.

What is “ smart” cabling?

October 31, 2007

Thank You!