hpc at inria

29
1 HPC at INRIA Thierry Priol INRIA Scientific Deputy Director Research Department European Partnerships Department Myriads IPT

Upload: janet

Post on 28-Jan-2016

40 views

Category:

Documents


0 download

DESCRIPTION

HPC at INRIA. Thierry Priol INRIA Scientific Deputy Director Research Department European Partnerships Department Myriads IPT. French Institute for Research in Computer Science and Control. Information and Communication Sciences and Technologies Research Experiment Transfer and innovate - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: HPC at INRIA

1

HPC at INRIA

Thierry PriolINRIA Scientific Deputy Director

Research DepartmentEuropean Partnerships DepartmentMyriads IPT

Page 2: HPC at INRIA

2

French Institute for Researchin Computer Science and Control

Information and Communication Sciences and Technologies • Research• Experiment• Transfer and innovate• Share and disseminate• Create references

A public institution of a scientific and technological character, and under the dual authority of the Ministry of Research and the Ministry of Industry

Page 3: HPC at INRIA

3

2,800 scientists1300 researchers and teaching-researchers1000 Ph.D. students500 postdoctoral fellows

8 research centers in France80 associated teams throughout the world4 300 scientific publications24 international conferences

230 active patents

96 innovative companies created

60 software deposited in 2008

INRIA today

On 1st January 2009

3,900 people A budget of €190 M before taxesOf which more than 20% from external resources

Page 4: HPC at INRIA

4

INRIA NancyGrand Est

INRIA Grenoble Rhône-Alpes

INRIA Sophia AntipolisMéditerranée

INRIA RennesBretagne Atlantique

INRIA BordeauxSud-Ouest

INRIA LilleNord Europe

INRIASaclayÎle-de-France

INRIA ParisRocquencourt

INRIA’s Research Centers

Page 5: HPC at INRIA

5An original research model: The INRIA Project-Teams

• From 15 to 20 people, with a scientific leader

• A focused scientific theme

• A limited lifespan: 8 years on average

• Medium-term objectives and work program

• Joint projects with industrial and scientific partners in France and around the world

• Financial and scientific autonomy

• From research to transfer

• A priori and a posteriori evaluation

198 INRIA Project-Teams & Teams in 2020

with the majority in partnership

An organization that complements the universities

Page 6: HPC at INRIA

6

INRIA Research Areas

• Applied Mathematics, Computation and Simulation

• Algorithmics, Programming, Software and Architecture

• Networks, Systems and Services, Distributed Computing

• Perception, Cognition, Interaction

• Computational Sciences for Biology, Medicine and the Environment

Page 7: HPC at INRIA

7

INRIA strategy in HPC• INRIA has the research potential to be a leader of HPC in Europe

• Culture of multidisciplinary research

• Culture of mixing methodologies within computer science (Strong collaborations between theoretical and experimental research)

• Culture of exploration tools (testbed)

• National initiatives• 2/3 of the ANR (French NSF) projects related to HPC include INRIA researchers

• Collaboration with Bull on Supercomputer design

• Strategic Partnership with EDF on simulation

• Collaboration with CEA on key system software (Kadeploy) for Supercomputers

• French Strategic Committee on HPC: ORAP, TER@TEC

• Collaborate in the establishment of the « House of Simulation », Grand Paris, …

• Participation to GENCI

• « Grand emprunt »…

Page 8: HPC at INRIA

8

HPC within INRIA Research Areas

• Applied Mathematics, Computation and Simulation• Computational models and simulation

• Algorithmics, Programming, Software and Architecture• Architecture and Compiling

• Networks, Systems and Services, Distributed Computing• Distributed and High Performance Computing

Page 9: HPC at INRIA

9

HPC research at INRIAFrom Computer Arithmetic to Scientific Platform

Compilation for processors, Multi-core & GPU

Single System Image

Microprocessor design

Computer Arithmetic

Runtime environments

Computing & Communication Libraries

Batch Schedulers

Mathematical Methods

Mesh generation

Computing Models

Scientific software platform (Scilab)

Modeling molecules

Scientific visualization; Visual analytics

Scientific Visualization(e.g. Plasma Physic)

Earth reconstruction(inverse problems)

Cardiac imaging and simulation

Modeling Tissue Growth

Modeling microprocessortemperature Modeling Air quality

Platform for numerical computation

MUMPS Parallel sparse direct Solver

PM2 Runtime Environment

Kerrighed Single System Image

Batch SchedulerFault tolerant MPI

Automatic Mesh Generation

Middleware forCyber infrastructures

SUPERLU

general purpose library

Page 10: HPC at INRIA

10

INRIA Project-Teams (37 IPT)

• Numerical simulation and HPC (17 IPT): numerical analysis,mesh generation, LA solvers, coupling, multi-scale, uncertainties

• Visualization/interaction (3 IPT): post-process, collaborative work

• Programming (18 IPT): models, compilers, code generation, GPGPU (hybrid architectures)

• Middleware/runtime/OS (10 IPT): virtualization, SSI, fault-tolerance, energy management, grid for HPC

Page 11: HPC at INRIA

11

INRIA NancyGrand Est

INRIA Grenoble Rhône-Alpes

INRIA Sophia AntipolisMéditerranée

INRIA RennesBretagne Atlantique

INRIA BordeauxSud-Ouest

INRIA LilleNord Europe

INRIASaclayÎle-de-France

INRIA ParisRocquencourt

Some project-teams involved in HPC activities

PARIS: operating systemsSAGE: scientific computingALF: multicore/GPU

PARIS: operating systemsSAGE: scientific computingALF: multicore/GPU

HIEPACS: scientific computingRUNTIME: communication/threadsCEPAGE: task management

HIEPACS: scientific computingRUNTIME: communication/threadsCEPAGE: task management

MOAIS: scheduling & programmingMESCAL: models & toolsGRAAL: middleware & programming

MOAIS: scheduling & programmingMESCAL: models & toolsGRAAL: middleware & programming

GRAND-LARGE: large scale parallel computingALCHEMY: compilers & programming

GRAND-LARGE: large scale parallel computingALCHEMY: compilers & programming

ALGORILLE: algorithms & modelsALGORILLE: algorithms & models

NACHOS: scientific computingOASIS: programmingOPALE: scientific computing

NACHOS: scientific computingOASIS: programmingOPALE: scientific computing

DOLPHIN: combinatorial problemsDOLPHIN: combinatorial problems

Page 12: HPC at INRIA

12

www.grid5000.frwww.grid5000.fr

Developed since 2003:• A nationwide experimental platform for Large scale experiments

The main feature is Grid’5000 is the level of control it provides to users who can reconfigure the soft stack on every node

>400 active Users Coming from >70 Laboratories>400 publications including Ph.Ds, HDRs, etc.>400 experiments done or planned (including >100 applications)

External impacts:• Used for testing of OpenMPI• Kadeploy to be used as the deployment tool for TERA100

Map of Grid’5000

Ray2Mesh:first non trivial MPI

applicationScaling linearly

On Grid’5000

Many success stories in combinatorial optimizations:-solve the n-Queens problem for n=25, in 2005-solve (exact solution) of the flowshop Ta056-50-20 instance

one of the most remarkable one, in 2008:Grid’5000 was used to design and improve the algorithm used in the first computer victory against a professional Go player (9x9) in the last Paris tournament!

ALADDIN/Grid’5000: Nation wide experimental platform

An Example of INRIA Specificity

Page 13: HPC at INRIA

13

INRIA strategy in HPC• INRIA has the research potential to be a leader of HPC in Europe

• Culture of multidisciplinary research

• Culture of mixing methodologies within computer science (Strong collaborations between theoretical and experimental research)

• Culture of exploration tools (testbed)

• National initiatives• 2/3 of the ANR (French NSF) projects related to HPC include INRIA researchers

• Collaboration with Bull on Supercomputer design

• Strategic Partnership with EDF on simulation

• Collaboration with CEA on key system software (Kadeploy) for Supercomputers

• French Strategic Committee on HPC: ORAP, TER@TEC

• Collaborate in the establishment of the « House of Simulation », Grand Paris, …

• Participation to GENCI

Page 14: HPC at INRIA

14

ANR supports HPC!

• HPC is seen as an important challenge to increase the competitiveness of the industry and the development of science

• Numerical simulation is the third pillar (in silicio) to develop knowledge (in vitro and in vivo experimentations, theory)

• Numerical simulation paves the way for new scientific discoveries

• Available 2009 funding:• Programme COSINUS – Numerical simulation

• Programme BLANC / JCJC – long term, young researchers

• Programme Materials & Processes – multiscale simulation

• Programme ARPEGE – large-scale infrastructures

• Programme DEFIS – Architectures, algorithms, languages

• Programme P3N (nano) – simulation for nanomaterials

• And in other programmes….

http://www.agence-nationale-recherche.fr:

Page 15: HPC at INRIA

15

“Les cahiers de l’ANR” - HPC

• N° 3 of the ANR book series

• Presentation of 80+ projects

• Introduction to domains• Infrastructures

• Tools

• Librairies

• Applications

• Available in French

Page 16: HPC at INRIA

16

Some numbers

• Count done for preparing ANR’s « HPC book »• 219 projects using or doing HPC

• 92 in the ICST dept

• 82 in the Nonthematic Dept

• 86 Projects have sent a one-page presentation as of today• 34 in the ICST dept

• 26 in the Nonthematic Dept

• 2005-2008: > 100M€ funding (>25M€/y.)

Page 17: HPC at INRIA

17

Page 18: HPC at INRIA

18

Page 19: HPC at INRIA

19

2010 ANR Calls

• COSINUS – Numerical simulation - Feb 2010

• Embedded System and Large infrastructures – Feb 2010

• Non-thematic programme (Blanc) – Jan 2010

• The G8 Research Councils Initiative on Multilateral Research Funding

• Interdisciplinary Program on Application Software towards Exascale Computing for Global Scale Issues – May 7th

Page 20: HPC at INRIA

20

INRIA strategy in HPC• INRIA has the research potential to be a leader of HPC in Europe

• Culture of multidisciplinary research

• Culture of mixing methodologies within computer science (Strong collaborations between theoretical and experimental research)

• Culture of exploration tools (testbed)

• National initiatives• 2/3 of the ANR (French NSF) projects related to HPC include INRIA researchers

• Collaboration with Bull on Supercomputer design

• Strategic Partnership with EDF on simulation

• Collaboration with CEA on key system software (Kadeploy) for Supercomputers

• French Strategic Committee on HPC: ORAP, TER@TEC

• Collaborate in the establishment of the « House of Simulation », Grand Paris, …

• Participation to GENCI

Page 21: HPC at INRIA

21Grand Equipement Nationalde Calcul Intensif

Centre National Jacques-Louis Lions

20% 10% 49% 20% 1%

Page 22: HPC at INRIA

22

Bruyères-le-Châtel

100 km

Centre

Nat

ional

Jacq

ues-L

ouis

Lions

Montpellier

Open supercomputer centres

Page 23: HPC at INRIA

23Total capacity of Tier1 HPC ressources available for the french scientific community in 2010

0

100

200

300

400

500

600

MPPSMP

VectorielTotal

GPU

139

451

7

596

192

2010

2010

NEC SX8 Brodie (IDRIS)NEC SX8R-SX9 Mercure (CCRT)

Cluster BULL Titane (CCRT)

Cluster SGI ICE Jade (CINES)Cluster IBM Hera (CINES)Cluster BULL Titane (CCRT)Cluster BULL Platine (CCRT)Cluster IBM Vargas (IDRIS)

IBM BG/P Babel (IDRIS)

596 T596 Tfflopslops

3 Computer 3 Computer CentresCentres

Comprehensive Comprehensive set of system set of system architecturesarchitectures

Page 24: HPC at INRIA

24Allocation of HPC resources : a single coordinated process at the national level

Requests from shareholders

Orientation CSCI

Annual reports by HPC centres

Reserved resources

Resources to be distributed trough two annual sessions

Submission

Peer-review based on scientific and technical excellence by an

Evaluation Committee (10 Thematic Committees)

Allocation Committee : decisions based on transparent and clear

criteria

Reserved parts for shareholders

Reserved parts allocated to industrial projects

Orientations

Page 25: HPC at INRIA

25

Others Missions

To promote simulation and high performance computingin fundamental and industrial research

To promote the organization of an European HPC area and to participate to its achievements 

To open its equipments to all interested scientific communities, academic or industrial, national, european or international

Page 26: HPC at INRIA

26

INRIA strategy in HPC (cont’d)

• European• Participation to PRACE-1IP (within GENCI)

• Participation to EESI (Exascale initiative led by EDF R&D)

• International• Associated teams with key HPC players

• Joint laboratory with UIUC-NCSA

Page 27: HPC at INRIA

27

INRIA and the Joint-Lab on PetaScale Computing

• Research and development in for Peta-ExaScale HPC needs international collaborations

• PetaScale Software are already raising many significant research problems

• ExaScale system design will open a very large domain of research and will require a huge effort from the community

• Projects like PRACE in Europe and IESP at the international level help establishing clear roadmaps and focusing on the right problems

• The economic situation is a threat for very large, single country, projects

• UIUC and NCSA with the BlueWaters project are in the forefront of research and development for Sustained PetaScale

• Strong opportunity for INRIA researchers to participate and contribute to the research on Key algorithmic and software challenges in PetaScale computing.

• Sustained PetaScale means a clear understanding of the applications and the design of truly scalable software

• May increase at INRIA the facet of HPC Research related to production

Page 28: HPC at INRIA

28

Technology Transfer

• A stream of Spin-offs• Kerlabs (OS)

• Caps Entreprise (GPGPUs compiler)

• ActiveEon (distributed objects for HPC)

• SysFera (Tools)

• INRIA/GENCI Initiative, with French competitiveness clusters, « national coordinated HPC program for SMEs »

Page 29: HPC at INRIA

29

To get more information

• project team-leaders involved in HPC

• Deputy Scientific Directors• Bernard Espiau (Applied Mathematics, Computation and Simulation)

• Hélène Kirchner (Algorithmics, Programming, Software and Architecture)

• Thierry Priol (Networks, Systems and Services, Distributed Computing)