isc goingarm sms june 2017 - microsoft · •new computer architectures are just starting to...

Isambard:The World’s First Large-Scale Production 64-Bit ARM Supercomputer

ProfSimonMcIntosh-SmithUniversityofBristol,UK

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 1

Recent trends in HPC:• Mostoftheworld’ssupercomputersarelargecollectionsofserversbasedoncommodityprocessors,typicallyIntel’sx86CPUs

• Newcomputerarchitecturesarejuststartingtoemerge,exploringdiversewaystoprovidethenextjumpinperformance

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 2

Why explore ARM-based supercomputers?• Thearchitecturedevelopmentisdrivenbythefast-growingmobilespace

• MultiplevendorsofARM-basedCPUs:• Greatercompetition• Morechoice• Excitinginnovations,e.g.invectorinstructionset

• Mont-Blancprovedtheapproachisfeasible

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 3

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 4

I.K.Brunel 1804-1859

'Isambard’, a new Tier 2 HPC service from GW4.Named in honour of Isambard Kingdom Brunel

Tier-2 HPC

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/

Tier 0: international

Tier 1: national

Tier 2: regional

Tier 3

The tiered model ofHPC provision

5

EPSRC’s new Tier 2 HPC centres:• Fundedwitha£20mcapitalinvestment• 6newcentres created• Aimistoexplorearchitecturaldiversity:

• Processors:GPUs,XeonPhi,ARM• Interconnect:Infiniband,Omnipath,Cray• Storage:burstbuffers,fastnon-volatilememories

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 6

Archer: The UK's national HPC service (£43m)

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 7

2 research councils:

Hardware:• Cray XC30• 118,080 x86 cores• 4,920 nodes• Cray Aries interconnect

Science:• ~1,500 users• Materials science • CFD• Climate/ocean modelling

Top 10 codes by core hours used:VASP, CP2K, GROMACS, CASTEP, HiPSTAR, UM, ONETEP, LAMMPS, WRF, Oasis

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 8

I.K.Brunel 1804-1859

Isambard system specification:

• Cray system• 10,000+ ARMv8 cores• Cray software tools

• Compiler, math libs, tools…• Technology comparison:

• x86, Xeon Phi, Pascal GPUs• Phase 1 installed March 2017• The ARM part arrives early 2018

• Early access nodes from Sep

Isambard's mission:

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 9

I.K.Brunel 1804-1859

To provide an open service for UK*

science and industry to evaluate ARM in a production HPC environment.

The project employs several staff to help port and optimise codes to ARM

* and beyond!

Someresults:• MyteamhashadremoteaccesstoCaviumThunderX2earlysiliconfor~10days

• Havealreadymanagedtocompileandrunlotsofrealcodes“outofthebox”• Listonnextslide

• UsingGNUandClang/LLVM• Performanceverypromising!

• HappytosharethenumbersunderNDASimon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 10

• CloverLeaf (2D/3D)• TeaLeaf (2D/3D)• SNAP• BookLeaf• GROMACS• CP2K• TheUnifiedModel(UM)• STREAM

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 11

Alsogoingtobeworkingon:• Thetop10mostheavilyusedcodesonArcher:

• VASP,CP2K,GROMACS,CASTEP,HiPSTAR,UM,ONETEP,LAMMPS,WRF,Oasis

• Note8ofthese10codesiswritteninFORTRAN• AdditionalcodesrelevanttoIsambardprojectpartners:• OpenFOAM,OpenIFS,…

• Wanttocollaboratewhereverpossible!• Let’savoidduplicatingeffort

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 12

Exciting times ahead!

• Inthenearterm:greaterchoice,competition,innovation,…

• Inthelongerterm:potentialfordisruptivechangetosignificantlyimpactscientificsoftwaredevelopment

• Weneedtobereadytoexploitnextgenerationtechnologiestodelivernewscience!

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 13

For more information:

• http://gw4.ac.uk/isambard/

• https://www.epsrc.ac.uk/blog/isambardhpc/

• Twitter:@simonmcs

• Pleasegetintouchtocollaborateonoptimising applications:simonm@cs.bris.ac.uk

• BristolishiringfacultystaffinCStofocusonHPC

Simon McIntosh Smith, simonm@cs.bris.ac.uk, @simonmcs http://gw4.ac.uk/isambard/ 14