broadcom energy efficiency initiatives - calit2€¦ · enable end-to-end networks that allow...
TRANSCRIPT
www.broadcom.comBroadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Broadcom
April 1st, 2010Nicholas (Nick) IlyadisVP and CTOBroadcom Enterprise Networking Group
Energy Efficiency Initiatives
1Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Broadcom Energy Efficiency Vision and Mission
Traditional Networks
Next Generation Networks
Enable end-to-end networks that allow Broadcom’s strategic customers to lead the industry in performance and features in a
cost- and energy-competitive framework
Performance Cost
Energy
2Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Industry and Regulatory Trends
• Government and Industry Recognition– April 19, 2006 “Green Grid” formed– December 20, 2006 House Resolution 5646 signed into law– European code of conduct – Japanese government initiative “Top Runner”
• IEEE P802.3az – Energy Efficient Ethernet– Broadcom heavily involved in launching the project in 802.3– Project objectives based on Broadcom presentation. Continues to be largest contributor
• Energy Star– EEE requirements for Servers planned in future draft (2010) once P802.3az is ratified– EEE requirements for PCs planned in future draft (2010) once P802.3az is ratified– Historically, EU and other countries will follow suit– Energy Star has kicked off an enterprise storage elements specification– Discussion on starting a networking equipment specification to cover switches
• Lower energy usage means lower operating costs
3Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Broadcom’s Energy Efficiency Solutions
Energy Efficient Ethernet (EEE)– Phy level power savings– Standards based compliance and interoperability
Energy Efficient Networking (EEN)– Deeper power savings utilizing EEE as a foundation– Higher level protocol and coordination of power savings
Process and Integration Power Efficiency Benefits– Move to 40nm CMOS and higher levels of integration– Lower power per unit of BW and Functionality
Off-load Technologies within Server Controllers (NIC’s)– Off-load engine is more efficient than CPU in Networking functions– Saved capacity can reduce power or increase Power Utilization Efficiency
4Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
IEEE P802.3az (EEE) Progress and Timeline
Draft Progress Successful initial Working Group Ballot & Recirc (D2.0 - D2.3)
All comments against D2.0, D2.1, D2.2 and D2.3 considered
D2.4 will be published April 2010
LegendIEEE 802 PlenaryIEEE 802 Interim IEEE-SA Standards Board
Task Force
Sep2007
Jul2007
Nov2007
May2008
Mar2008
Jul2008
Nov2008
May2009
Nov2009
Mar2010
Sep2009
Sep2008
Mar2009
Jan2008
Jan2009
Jul2009
Jan2010
May2010
Jul2010
Sep2010
TF Review WG Ballot
You arehere
SponsorBallot
Std!
D3.0D2.0D1.0
Baseline
5Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
EEE Low Power Idle Overview
• Low Power Idle (LPI) – PHY powers down during idle periods• During power-down, maintain coefficients and synchronization
to allow rapid return to Active state• Wake times for the respective twisted-pair PHYs
100BASE-TX: Tw_PHY <= 30 usec1000BASE-T: Tw_PHY <= 16.5 usec10GBASE-T: Tw_PHY < ~8 usec (2 modes)
Low-PowerActive Active
Deassert LPI
Hold
TrTs
Quiet Quiet Quiet
Tq
Wait a minimum of Tw_Sys before sending data (Tw_sys >= Tw_PHY)
Sleep Data / IdleData / Idle Alert Wake IdleRefreshRefresh
Assert LPI
Tw_PHYTw_sys
Data or IdleTime -----
Energy on the Wire
Active
6Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved. 6
Broadcom Enabling Energy Efficient Ethernet
• 10GBASE-T PHYs10/100/1000BASE-T PHYs • Gig E and 10GE controllers• SMB switchesSwitches
Comprehensive Energy-Efficient Ethernet portfolio includes
Broadcom Proprietary & Confidential. © 2010 Broadcom Corporation. All rights reserved.
7Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
ControlPolicy
Broadcom’s EEN: End-to-End SavingsEND POINT SWITCH
PHY
MAC
Controller
Controller SW
OS
PHY
MAC
NWSW
NWSW SW
Application
OS
802.3azEEE
ControlPolicy
Coordinatedand Optimized
End-to-End Control Policy
Well Integrated Control Policy and EEE
Within a Box
EEN
8Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Broadcom’s In-System Control Policy
Link State:
Power:
Data:
~75%
~45%
No Control Policy
9Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
With Broadcom EEE Control Policy
Broadcom’s In-System Control Policy
Link State:
Power:
Data:
~55%
~45%
10Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Broadcom’s EEN: End-to-End SavingsEND POINT SWITCH
PHY
MAC
Controller
Controller SW
OS
PHY
MAC
NWSW
NWSW SW
Application
OSBroadcom Customizable and Optimized Control Policy
• Maximize energy efficiency by maximizing operation in saving states• Minimize performance, latency impact by avoiding unnecessary transitions• Customizable via FastPATH/SmartPATH Software
Broadcom Enabled
Broadcom Enabled
11Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Layer 1 Support Layer 2 Support
SwitchController
EEE Enhanced Layer 2 Operations
CPU
1000BASE-T MDI
Layer 2Control Policy
• Opportunity to save additional power within a box (link partner)– Additional circuits beyond the PHY can be turned off
• Additional RX wakeup time negotiated using 802.3az’s Layer 2 — Standards based
PCI-e
Server with Controller NIC Switch
12Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Easy Mix of 1G and 10G Rackswith 1/10Gbase-T
CAT 6e100m
1000BT / 10GT Top of Rack Switches
RJ45CAT6e
200mW/Gbit
Lowest cost 10G PHY optionPreserve 100 / 1000base-T
backward compatibilityLess Switches = Less Power
Low power – 2W for TORwith EEN
10GBASE-T Efficiency Trend
1GTop of Rack Switches
6 port 1000Base-T installation
400mW/Gbit
Better cable managementMore efficient bandwidth
SFP+Copper
10G SFP+ Top of Rack Switches
1000BTTop of Rack Switches
RJ45CAT5/6e
SFP+ Fiber(100m)
Dedicated Racks for 10G SFP+ & 1000BT
10GBASE-T link is costcompetitive vs. SFP+
10GBase-T double powerefficiency of 1000BT
13Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Improve Data Center Power EfficiencyOffload Significantly Improves Performance / Watt
MBps vs CPU vs Watts
0
50
100
150
200
250
512 1024 2048 4096 8192 16384 32768 65536 131072 262144 524288 1048576
Wat
ts / %
CPU
0
200
400
600
800
1000
1200
MBps
57711 iSCSI Offload – Sum of MBpsCompetitor’s L2 – Sum of MBps
57711 iSCSI Offload – Sum of WATTSCompetitor’s L2 – Sum of WATTS
Web,Paging
File Copy, OS Load, File Server, Database
Streaming Media,Video Rendering,
IPTV
Equipment Categories
Lighting SwitchGear
UPS /Generator
PDU ITEquipment
Chiller CRAC Humidifier
Data Center Power
• Improved PUE (Power Utilization Efficiency)• Permanent power savings for right-sizing
50-70% additional power savingsLowers non-IT infrastructure CAPEX
OffloadProvides
Data Centers
Broadcom hardware offload saves ~60W per port of powerwhile delivering higher throughput
14Broadcom Proprietary & Confidential. © 2009 Broadcom Corporation. All rights reserved.
Broadcom Improves Power UtilizationReduced power across full spectrum of data traffic patterns
PHY Level – 802.3azServer, Storage, Switch
Energy Efficient NetworkingControl Policy Driven (L2-L4)
Stateful Offloads ~60W per port!
Data Centers #1 Consumer of US Power by 2011 @ 120B kWh
100%
25%
Without EEE With EEE
Switch Server
120W per server
~4000W per Rack
Power and performance
optimization for Maximum Link
Utilization
Power optimization for Low Link
Utilization including Tunable Latency
Heavy traffic
Low traffic