industry standard green hpc systems · confidential hpc systems: what the industry is doing 41.4...
TRANSCRIPT
Confidential
© Supermicro 2014
Industry-Standard Green HPC Systems
Attila A. Nagy
Senior IT Consultant
HPC Advisory Council
Brazil Conference 2014
May 26, 2014
University of São Paulo
Confidential
HPC systems: What the industry is doing
84.6
15.4
Cluster
MPP
82.4
8.6
8.0 0.6 0.4
Xeon
Opteron
Power
Sparc
Other
Architecture Processor
system share (%) system share (%)
Source: The Top500 list of November 2013. http://www.top500.org
Confidential
HPC systems: What the industry is doing
41.4
27.0
15.4
10.0
4.0 2.2 Infiniband
GbE
10GbE
Custom
Cray
Other
96.4
2.2 1.4
Linux
Unix
Other
Interconnect Operating System
system share (%)
system share (%)
Source: The Top500 list of November 2013. http://www.top500.org
Confidential
Industry-standard HPC clusters
Infiniband and/or Ethernet networks
Main interconnect
Cluster management and administration
Out-of-band management
Standard x86 servers throughout
Compute nodes
Head/Management/Control nodes
Storage nodes
Linux OS environment
Comprehensive software stack for HPC
Large availability of HPC software tools
Large collaboration community
Confidential
Typical HPC Cluster
Campus
Network Head & Management Nodes
x86 servers/Linux IB Fabric
Ethernet Fabric
OOB Mgmt
Network
Infiniband
Network Ethernet
Network
Compute Nodes
x86 servers
Linux
Storage Nodes
x86 servers
Linux
Parallel FS
The Beowulf cluster concept
is as solid as ever!!
Confidential
Accelerator/Coprocessor usage
Accelerator/CP All top ten systems in the latest
Green500 list are coprocessor
based*
Two petaflop systems
89.4
7.4
2.4 0.8
N/A
Nvidia
Xeon Phi
Other
system share (%)
(*) The Green500 list of November 2013. http://www.green500.org
Source: The Top500 list of November 2013. http://www.top500.org
Up to 5x improvements in:
Power consumption
Physical space
Cost
GPUs/MICs: 80% of HPC users
at least testing them
Confidential
Green HPC?
Data centers consumed approximately 1.3% of worldwide electricity
production in 2010 (2% in the US) ¹
(1) Koomey, Jonathan. 2011. Growth in Data center electricity use 2005 to 2010.
Oakland, CA: Analytics Press. August 1. http://www.analyticspress.com/datacenters.html
Brazil LatAm US World
10.9
15.1
6.7 7.2
(2) DCD Industry Census 2013: Data Center Power. January 31, 2014 by DCD Intelligence. http://www.datacenterdynamics.com/focus/archive/2014/01/dcd-industry-census-2013-data-center-power
Power is not the only issue:
Cooling
Real estate
Management
Cost (OpEx)
Data center power usage growth 2012-2013 (%): ²
Confidential
The roadmap to Green HPC
Server design
Power
Processing efficiency
Heterogeneous computing
60%
65%
70%
75%
80%
85%
90%
95%
100%
0% 20% 40% 60% 80% 100%
Loading
Eff
icie
nc
y
PWS-920P-1R Platinum
PWS-721P-1R Gold
Previous Generation
Thermal
Mechanical
Power consumption
breakdown
50%
25%
9%
6%
6% 4% GPU
CPU
Memory
Fans
Power Supply
Other
Node configuration: 2x Xeon E5v2; 2x Nvidia Kepler;
128GB memory; no HDD
Confidential
The roadmap to Green HPC
Data center design
PUE (Power Usage Effectiveness)
Layout
AC/cooling
Cost Efficiency
Air cool
Liquid cool
KW / rack
~25kW
Management
Server, rack/system & data center level
Core on/off & speed control
Power monitoring/capping/policy setting
Agent based & OOB
Integrated data center mgmt & control
Confidential
Supermicro HPC
Innovation – HPC Optimized H/W Design and Manufacturing
Offer broadest line of x86 HPC server building blocks
Design to fit any HPC application – all about choices
Focus on high efficiency (performance per watt) to enable green HPC and scalability
Channel Enablement – First to Market with Building Block Solutions
Provide first to market competitiveness to our partners: HPC solution providers
Enable channel partners with fully validated HPC building blocks
End users get a solution that is optimized for their applications
Commoditization
Driving the technology curve from proprietary to open architecture and commodity
Commitment to the HPC community to make high-performance solutions affordable
in order to accelerate science & engineering research and development
Confidential
Thank you!
Attila A. Nagy
www.supermicro.com