tef_gigfire_0 5

Ethernet Alliance - Technology Exploration Forum

Next Generation Ethernet Data Center

Impact of Exploding Bandwidth - 100G and Beyond

Raj Ojha

GigFire Microsystems

Disclaimer: For this presentation, GigFire Microsystems Inc does not warrant or assume any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed.

www.gigfiremicro.com

Data and Telecommunication

Market

GigFire Microsystems Ethernet Alliance - Technology Exploration Forum Santa Clara, February 2nd, 2010 1


• Data Center Map– 1478 collocation data centers from 65 countries

– USA 752 data centers from 43 states – Germany 107 data centers from 19 areas– United Kingdom 96 data centers from 32 areas– France 71 data centers from 26 areas– The Netherlands 46 data centers from 14 areas– Canada 44 data centers from 10 areas– Australia 33 data centers from 8 areasSource: http://www.datacentermap.com

Data Center MapIncreased Demand for Data Centers

Range of Traffic IncreaseTraffic Demand and New Data Center Equipment

• Traffic growth with parameter of the compound annual growth rate (CAGR)

• Newly required equipment CAGR in 2015 in 2020100% 97% 99,9%70% 93% 99,5%40% 80% 96,5%Source: Cisco 2008

Cisco forecasts 44 Exabytes per month in 2012

Source: Cisco 2008

Cisco forecasts 44 Exabytes per month in 2012

• Minnesota Internet Traffic Studies (MINTS)– Growth rates from publicly observed sites– Monthly Internet traffic estimate (end 2009)

7,500-12,000 PBytes (PB = 1015 B) (World) – Annual Internet traffic growth (end 2009)

40% - 50% (U.S. and World)

1024

118

29

Traffic Growth – Parameter: CAGR

5

14

32

1024

118

29

Traffic Growth – Parameter: CAGR

5

14

32

GigFire Microsystems Ethernet Summit Santa Clara, February 23nd, 2010 3

ToR-10G

ToR-100G

Data Center Roadmap?

ToR- 400G/1Tb

Today 2010 & Beyond 2014 & Beyond

100G/400G/1Tb LAN WDM

Aggregation Box


Advance Line-card ArchitectureBetter cost per bit performance


• What changes need to be made

on the Line Card

– Increased data rate with low latency

– N x 100G, 400G, 1T

– Higher bitrates

• Common electric interface CEI-25G/28G(OIF) CMOS

• 40G Serial CMOS

– Chip-to-chip connection

– CFP2 or smaller Chip-to-module

connection for 100G

– Serial memory -10G

– 50% or less reduction in

power consumption

CAM

CFP

PhysicalLayer

Interface

SwitchChipsSwitch

Chips

CAM

QDR III

DDR III

CFP

SRAMCAM

QDR III

DDR III

SDRAM

Interfaces: CAUI, CEI 11G, Interlaken/SPI-S, PCI Express

DataPlane

ControlPlane

SwitchFabric

SwitchChipsFabricFabric

Interface

ControlPlaneHost

Processor

ClockMngmt

PortMngmt

Memory

PCI Express

FramerMAC,

FEC, OTN

NetworkProcessing

Unit

TrafficManager

SwitchInterface

Strong Need for Low Power and Low Latency Semiconductors

Reference and Source : Refer next slide


1G Phy(300mW) 10G Optical Phy(1.5W) 10G base T(5W)one datacenter in US One Hour 0.03 0.15 0.5one datacenter in US 24 Hours 0.72 3.60 12.00one datacenter in US 30 days 21.60 108.00 360.00one datacenter in US 12 months 259.20 1,296.00 4,320.00752 Datacenters in US 752 DC/12 months 194,918.40 974,592.00 3,248,640.00

1478 Datacenters World wide 1478 DC/12 months 383,097.60 1,915,488.00 6,384,960.00

Summary

Power Dissipation/Gbps wrt

1478 Datacenters 383,097.60 191,548.80 638,496.00

1G Phy(300mW) 10G Optical Phy(1.5W) 10G base T(5W)one datacenter in US One Hour 3$ 15$ 49$ 752 Datacenters in US 752 DC/12 months $19,491,840 $97,459,200 $318,366,7201478 Datacenters World wide 1478 DC/12 months $38,309,760 $191,548,800 $625,726,080

SummaryCost of Power /Gbps wrt 1478 Datacenters 38,309,760.00 19,154,880.00 62,572,608.00

Total Power Dissipation/transceiver/100K port datacenter in MWh

Total Cost of Power Dissipation/transceiver/100K port datacenter @$97.40/MWh(Avg Electricity cost in US)

Datacenter(100K ports) Time/100K ports

Datacenter(100K ports)Cost of Power

Dissipation/100K ports

Source: 1.Department of Energy (DoE)2.http://tonto.eia.doe.gov/energyexplained/index.cfm?page=electricity_factors_affecting_prices3.http://www.eia.doe.gov/cneaf/electricity/esr/table5.html4.http://www.datacentermap.com5.http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-481374_ns827_Networking_

Solutions_White_Paper.html6.ESTIMATING TOTAL POWER CONSUMPTION BY SERVERS IN THE U.S. AND THE WORLD by Jonathan G. Koomey, Ph.D.

Reference and Source

Assumptions UnitsAvg 1G SerDes (1G base T) single channel

power dissipation 300mW10G Optical Phy(optical SFP+ and SerDes

Phy(SR)) single channel power dissipation 1.5W

10G Base T single channel power dissipation 5W

Avg Retail Price for electricity is 9.74 cents kWh as per DoE 9.74 cents

Cost for 1 MWh @ 9.74 cents kWh $97.40


ConclusionImpact of Exploding Bandwidth


• Impact on today’s and future datacenter

– Architectural changes to switch/router, line card, pluggable module, chip

• Strong need for low power, low latency and high speed interconnects

–Migration path to higher bitrates, e.g. CEI-25G/28G, 40G common electrical interfaces for 400G or 1Tb systems

Industry should aggressively invests in R&D to develop very low power semiconductors to reduce the cost of energy by 50% or less as well as increase the over all bandwidth by 10X resulting in better cost per bit performance

Thank You

[email protected]


Market


Market


tef_gigfire_0 5

Documents

collocation data centers

g data center roadmap

traffic growth parameter

g phy300mw

line card increased

g serial memory

areas source

g serial cmos chip