welcome to the 42 st hpc user forum meeting september 2011
Post on 22-Dec-2015
213 views
TRANSCRIPT
Welcome To The 42st HPC User Forum
MeetingSeptember 2011
Welcome To The 42st HPC User Forum
MeetingSeptember 2011
Important Dates For Your Calendar Important Dates For Your Calendar
FUTURE HPC USER FORUM MEETINGS:
International Meetings: 2011 CEA in France, October 3 & 4 2011 HLRS/University of Stuttgart, October 6 & 7 2012 Imperial College, UK June 5 & 6
2012 US Meetings: 2012 April 16 to 17, Richmond, Virginia 2012 September 17 to 19, Dearborn, Michigan
Thank You To Our Sponsors! Thank You To Our Sponsors!
Gold Intel HP
Silver Altair AMD Appro International Platform Computing
Bronze Adaptive Computing Bright Computing General Atomics Mellanox Panasas Qlogic
DinnerThanks to:
General Atomics & Qlogic
DinnerThanks to:
General Atomics & Qlogic
Tuesday Dinner Vendor Updates: 10 MinutesTuesday Dinner Vendor Updates: 10 Minutes
• Qlogic• Panasas• Mellanox• General Atomics• DDN• Bright Computing• Appro• AMD• Altair• Adaptive Computing
Welcome To The 42st HPC User Forum
MeetingSeptember 2011
Welcome To The 42st HPC User Forum
MeetingSeptember 2011
DinnerThanks to:
General Atomics & Qlogic
BreakfastThanks to:
AMD
DinnerThanks to:
General Atomics & Qlogic
BreakfastThanks to:
AMD
Thank You To Our Sponsors! Thank You To Our Sponsors!
Gold Intel HP
Silver Altair AMD Appro International Platform Computing
Bronze Adaptive Computing Bright Computing General Atomics Mellanox Panasas Qlogic
Introduction: LogisticsIntroduction: Logistics
Ask Mary if you need a receipt We have a very tight agenda (as usual)
Please help us keep on time!
Review handouts Note: We will post most of the
presentations on the web site Please complete the evaluation form
www.hpcuserforum.comwww.hpcuserforum.com
New HPC Innovation Award Program:www.hpcuserforum.com/innovationaward/New HPC Innovation Award Program:www.hpcuserforum.com/innovationaward/
Welcome
Steve FinnHPC User Forum
Chairman
Welcome
Steve FinnHPC User Forum
Chairman
Important Dates For Your Calendar Important Dates For Your Calendar
FUTURE HPC USER FORUM MEETINGS:
International Meetings: 2011 CEA in France, October 3 & 4 2011 HLRS/University of Stuttgart, October 6 & 7 2012 Imperial College, UK July 5 & 6
2012 US Meetings: 2012 April 16 to 17, Richmond, Virginia 2012 September 17 to 19, Dearborn, Michigan
HPC User Forum MissionHPC User Forum Mission
To Improve The Health Of The
High Performance Computing Industry
Through Open Discussions, Information-sharing And Initiatives Involving
HPC Users In Industry, Government And Academia
Along With HPC Vendors
And Other Interested Parties
Steering Committee MembersSteering Committee Members
• Steve Finn, Cherokee Information Services, Chairman• Sharan Kalwani , KAUST, Vice Chairman • Earl Joseph, IDC, Executive Director• Vijay Agarwala, Penn State University• Alex Akkerman, Ford Motor Company • Doug Ball, The Boeing Company• Rupak Biswas, NASA Ames• Paul Buerger, Avetec• Steve Conway, IDC Research Vice President• Jack Collins, National Cancer Institute• Jeff Broughton. NERSC/Lawrence Berkeley National Lab • Merle Giles, NSCA/University of Illinois• Chris Catherasoo, Caltech• James Kasdorf, Pittsburgh Supercomputing Center• Doug Kothe, Oak Ridge National Laboratory• Paul Muzio, City University of New York• Michael Resch , HLRS, University of Stuttgart• Vince Scarafino, Industry Expert • Allan Snavely, San Diego Supercomputer Center
IDC HPC
Market Update
IDC HPC
Market Update
Top Trends in HPCTop Trends in HPC
The global economy in HPC is growing again 2010 grew by 10%, to reach $9.5 billion We are forecasting ~7% growth over the next 5 years
Major challenges for datacenters Power, cooling, real estate, system management Storage and data management continue to grow in importance
Software hurdles will rise to the top for most users
SSDs will gain momentum and could redefine storage
GPUs are seeing real tractions in certain verticals
The worldwide Race on Petascale is in full speed
18
1. The Worldwide Economic Recovery Will Restore HPC Growth
2. The Battle for HPC Leadership Will Become Increasingly Global and Strategic
3. More Real-World Applications Will Be Run at Trans-Petaflop Speeds
4. There May Be More Emphasis on Software…Finally5. The Alternative Processor Wars Will Keep Heating Up6. The HPC Staffing Shortage Will Grow More Acute7. Cloud Computing Will Ramp Up Slowly in HPC, But Will
Find a Number of Strong Niches 8. The HPC Storage Market Will Continue to Grow Faster
than the HPC Server Market9. InfiniBand Will Continue To Take Market Share from
Proprietary Interconnects While Ethernet Remains the Leader
10. Power and Cooling Will Become an Even Greater Concern
IDC Top 10 HPC Predictions for 2011IDC Top 10 HPC Predictions for 2011
HPC WW Market ResultsHPC WW Market Results
HPC Vendor Revenue Shares, 2010HPC Vendor Revenue Shares, 2010
HP32%
IBM30%
Dell15%
Cray3%
SGI3%
Sun2%
Fu-jitsu1%
NEC1%
Appro1%
Hi-tachi1%
Dawn-ing1%
Bull1%
Other10%
2010 HPC WW Market Results2010 HPC WW Market Results
Q110 Q210 Q310 Q410 Full Year
Supercomputer 669,521 780,655 847,960 1,183,441 3,481,577 36.6%
Divisional 273,752 299,286 316,688 379,009 1,268,735 13.3%
Departmental 688,785 791,416 842,511 956,507 3,279,219 34.5%
Workgroup 372,914 333,110 348,131 420,638 1,474,792 15.5%
Total 2,004,973 2,204,466 2,355,289 2,939,595 9,504,323 100.0%
Source: IDC HPC Qview 2012
Revenue Share by VendorSupercomputer SegmentRevenue Share by VendorSupercomputer Segment
IBM53.0%
HP25.3%
Cray7.8%
Dell4.6%
Bull2.7%
SGI2.4%
Appro1.2%
Sun0.6%
NEC0.5%
Dawning0.1%
Other1.8%
Revenue Share by VendorDivisional Segment Revenue Share by VendorDivisional Segment
IBM16.4%
HP38.8%
Dell8.2%
SGI8.0%
NEC5.2%
Appro4.3%
Sun3.9%
Fujitsu3.9%
Dawning1.7%
Other9.5%
Revenue Share by Vendor Departmental SegmentRevenue Share by Vendor Departmental Segment
HP32.2%
Dell31.9%
IBM12.7%
Sun2.3%
Fujitsu1.9%
Hitachi1.5%
Dawning0.8%
SGI0.2%
Appro0.2%
Bull0.1%
Other16.2%
Revenue Share by VendorWorkgroup SegmentRevenue Share by VendorWorkgroup Segment
HP39.8%
IBM24.2%
Dell10.3%
SGI4.4%
Sun2.3%
NEC1.4%
Fujitsu1.4%
Dawn-ing
0.7%
Appro0.5%
Other15.2%
Industry/Application Segments Industry/Application Segments
HPC Server Revenue by Application/Industry 2009 2010 GrowthBio-Sciences 1,171 1,294 10.4%CAE 913 1,060 16.1%Chemical Eng 187 203 8.6%DCC & Distribution 478 549 15.0%Economics/Fin 205 266 30.1%EDA/IT/ISV 559 629 12.5%Geosciences 564 605 7.2%Mechanical Design 75 80 6.5%Defense 894 951 6.3%Government Lab 1,418 1,520 7.2%University 1,721 1,832 6.4%Weather 371 412 11.0%Other 80 104 29.2%Total Revenue 8,637 9,504 10.0%Source: IDC 2011
By Region 1Q201By Region 1Q201
ROW1.2%
Japan6.8%
N.A. 47.0%
Asia/Pac13%
EMEA31.8%
By Operating System 1Q201By Operating System 1Q201
Linux 83.3%
UNIX9.5%
Windows 7.2%
The HPC Market
Beyond
The Servers
The HPC Market
Beyond
The Servers
The Broader HPC MarketThe Broader HPC Market
2009 2010
Servers 8,637,114 9,504,323
Storage 3,022,990 3,328,312
Middleware 1,062,365 1,103,797
Applications 2,971,167 3,164,293
Service 1,658,326 1,727,976
Total 17,351,963 18,828,701
HPC BuyerDriving factors
HPC BuyerDriving factors
2011 Buyer Driving Factors 2011 Buyer Driving Factors
Top Reasons for Acquiring HPC Systems Average rankings, 10 -- most important, 1 -- least importantAttribute: RankingAbility to do new/ better science 8.18Ability to run larger problems 7.69Performance on OUR applications 7.38Throughput 7.17Price/ Performance 6.99To improve our competitiveness 6.06 TCO 6.03Capacity mgmt 5.29Regulations/ certification 3.08Source: IDC, 2011
2011 Buyer Driving Factors 2011 Buyer Driving Factors
Barriers for Cluster Sites to Expanding HPC AdoptionWith 1 = Least prohibitive, 10 = Most proibitiveBarriers: Average RatingFinancial barriers 8.463rd party applications costs barrier 6.64Space limitations, facility issues, power, cooling 6.22Difficulties with scaling 4.93Technical limitations in processor, memory, interconnect 4.88Lack of parallel application development tools 4.58Lack of knowledge, or skilled computing staff 4.35Lack of application availability on parallel servers 4.13Lack of system management software 3.92Lack of data storage mechanisms 3.85Availability, turn-around, reliability issues 3.32Lack of support by management 3.18Source: IDC, 2011
HPC Market Forecasts
HPC Market Forecasts
HPC Server Revenue ($M) ForecastHPC Server Revenue ($M) Forecast
2010 2011 2012 2013 2014 2015 CAGR
HPC Revenues
9,504
10,034
10,564
11,397
12,371
13,449 7.2%
System Units
119,845
133,044
146,243
165,391
172,306
179,515 8.4%
Source: IDC 2011
HPC Server Revenue ($M) Forecasts Compared To Last YearHPC Server Revenue ($M) Forecasts Compared To Last Year
Comparison of Old and New HPC Revenue Forecasts 2009 2010 2011 2012 2013 2014 2015New Forecast 8,637 9,504 10,034 10,564 11,397 12,371 13,449 Previous Forecast 8,637 9,240 9,842 10,444 11,047 11,706 - Source: IDC 2011
2009 2010 2011 2012 2013 2014 2015 -
2,000
4,000
6,000
8,000
10,000
12,000
14,000
16,000
New Forecast
Previous Forecast
ConclusionsConclusions
2010 was a year of return to healthy growth in the worldwide HPC market
IDC predicts the HPC market will continue growth in 2011 and grow by 7% to 9% in 2011 And then will rebuild to reach $13.5 billion by 2015
The recovery will benefit HPC segments unevenly: With hard-hit verticals such as automotive recovering
more slowly than oil and gas, or government and academia
The Supercomputer segment growth will remain turbo-charged by government spending aimed at HPC leadership and “petaflop club” membership And could exceed our current forecasts
38
But There are Still Major Customer Pain PointsBut There are Still Major Customer Pain Points
Software is still the #1 roadblock Better management software is needed
– HPC clusters are still hard to setup and operate – New buyers – require “ease-of-everything”
Parallel software is lacking for most users– Many applications will need a major redesign – Multi-core will cause many issues to “hit-the-wall”
Clusters are still hard to use and manage System management & growing cluster complexity Power, cooling and floor space are major issues Third party software costs Weak interconnect performance at all levels RAS is a growing issue Storage and data management are becoming new bottle necks Lack of support for heterogeneous environment and accelerators
Agenda: Day One MorningAgenda: Day One Morning
Wednesday, September 7, 20117:15am Networking Breakfast 8:00am Welcome, Steve Finn, Sharan Kalwani and Earl Joseph Morning Session Chair: Steve Finn8:15am HPC Market Update, Earl Joseph and Steve Conway8:30am HPC in Materials Science
• Tim Germann, LANL • Bobby Sumpter, Oak Ridge National Laboratory• 9:30am - 10:00am Break• Duane Johnson, Ames Laboratory• Charles Robert Welch, US Army Corps of Engineers, Engineers
Research & Development Center (ERDC)11:00am The 1000 Genomes Project, Skip Garner,
Virginia Tech11:30am Invited Vendor Technology Updates: Intel and
HP12:00pm Networking Lunch
AM Break Thanks to: Mellanox
Lunch Thanks to: Platform
Please Return Promptly at 1:00pm
AM Break Thanks to: Mellanox
Lunch Thanks to: Platform
Please Return Promptly at 1:00pm
Thank You To: Platform Computing
For Lunch
Thank You To: Platform Computing
For Lunch
Agenda: Day One AfternoonAgenda: Day One Afternoon
Afternoon Session Chair: Rupak Biswas1:00pm Modeling and Simulation of Large Scale Reactive Systems in Extreme
Conditions, Andres Jaramillo-Botero, Caltech1:30pm HPC in Materials Science: Best Practices in Managing HPC & Simulation
Resources for Improving TTM, Eric Morales, Ping Golf2:00pm Successful HPC Cloud Examples: Teri Dewalt, IBM2:15pm Microsoft "Azure" Cloud Update, Ryan Waite 2:30pm Data-intensive Computing at SDSC, Allan Snavely, SDSC3:00pm Break3:30pm Update on Lustre and OpenSFS, Norm Morse 4:00pm Panel: The Future of Lustre, Moderator: Paul Buerger
• Norm Morse, OpenSFS• Peter Bojanic, Xyratex • Bob Ciotti, NASA Ames • John Josephakis, DDN • Tommy Minyard, TACC • Brent Gorda, Whamcloud • Stephen Simms, Indiana University
5:00pm Networking Break and Time for 1-on-1 Meetings 6:30pm Special Reception and Dinner Event
Thank You To:Adaptive Computing
For The Break
Thank You To:Adaptive Computing
For The Break
Dinner LogisticsDinner Logistics
Special Dinner Event Sponsored by Intel and HP
WelcomeTo Day 2 Of TheHPC User Forum
Meeting
WelcomeTo Day 2 Of TheHPC User Forum
Meeting
DinnerThanks to:
Intel and HP
BreakfastThanks to:
Appro
DinnerThanks to:
Intel and HP
BreakfastThanks to:
Appro
Thank You To Our Sponsors! Thank You To Our Sponsors!
Gold Intel HP
Silver Altair AMD Appro International Platform Computing
Bronze Adaptive Computing Bright Computing General Atomics Mellanox Panasas Qlogic
Important Dates For Your Calendar Important Dates For Your Calendar
FUTURE HPC USER FORUM MEETINGS:
International Meetings: 2011 CEA in France, October 3 & 4 2011 HLRS/University of Stuttgart, October 6 & 7 2012 Imperial College, UK July 5 & 6
2012 US Meetings: 2012 April 16 to 17, Richmond, Virginia 2012 September 17 to 19, Dearborn, Michigan
Agenda: Day Two MorningAgenda: Day Two Morning
8:10am Welcome, Earl Joseph and Steve Finn Morning Session Chair: Vince Scarafino 8:15am IDC Update on New EU HPC Parallel Software Programs and Initiatives 8:30am Exascale & Heterogeneous Programs and Addressing the Software Issues:
• Exascale Opportunities and Challenges, and HECToR update, Andy Jones, NAG
• Heterogeneous Systems, Sriram Swaminarayan, Los Alamos National Laboratory
• The Real Future of HPC Cloud Computing, Jeff Broughton, NERSC• 10:00am - 10:30am Break• The AFRL Heterogeneous Condor Cluster, Mark Barnell, Air Force
Research Laboratory (AFRL) 11:00am Panel on Power & Cooling in HPC
• Moderator: Tim Carroll, Dell• Janus: A Co-Designed Facility and Supercomputer, Henry M. Tufo,
Ph.D. , University of Colorado at Boulder• Power & Cooling Techniques at the Texas Advanced Computing Center,
Tommy Minyard, Ph.D. , University of Texas• DIY HPC Clusters: Deploying a high performance compute cluster at
Stanford, Steve Jones, Stanford University 12:00pm Networking Lunch
Am Break Thanks to: Panasas
Lunch Thanks to: Altair
Please Return Promptly at 1:00pm
Am Break Thanks to: Panasas
Lunch Thanks to: Altair
Please Return Promptly at 1:00pm
Thank You Altair Engineering
For Lunch
Thank You Altair Engineering
For Lunch
Agenda: Day Two Afternoon Agenda: Day Two Afternoon
Afternoon Session Chair: Sharan Kalwani1:00pm HPC as an Ecosystem, Michael Resch, University of Stuttgart,
High Performance Computing Center1:30pm Vendor Technology Update: Platform Computing1:45pm HPC Applications in Materials Science, George Fitzgerald,
Accelrys2:15pm International Exascale Software Project (IESP), Peter Beckman,
Argonne National Laboratory 2:45pm Break3:15pm Overview Of NITRD Activities Related To High Performance
Computing, Bryan Biegel 3:45pm IDC Update on Large HPC Systems in Japan and China4:15pm Exascale Directions, Jeff Nichols, Oak Ridge National
Laboratory4:45pm Meeting Wrap-Up, Steve Finn, Steve Conway and Earl Joseph 5:00pm Meeting Ends
Thank You To:Bright Computing
For The Break
Thank You To:Bright Computing
For The Break
Important Dates For Your Calendar Important Dates For Your Calendar
FUTURE HPC USER FORUM MEETINGS:
International Meetings: 2011 CEA in France, October 3 & 4 2011 HLRS/University of Stuttgart, October 6 & 7 2012 Imperial College, UK July 5 & 6
2012 US Meetings: 2012 April 16 to 17, Richmond, Virginia 2012 September 17 to 19, Dearborn, Michigan
Thank YouFor Attending The 42st
HPC User ForumMeeting
Thank YouFor Attending The 42st
HPC User ForumMeeting