hpc cloud at surfsara - compbiomed€¦ · hpc cloud at surfsara ander astudillo webinar 30th...
TRANSCRIPT
![Page 1: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/1.jpg)
— Offering computing resources as a service
HPC Cloud at SURFsara
Ander Astudillo <[email protected]>
Webinar30th January 2018
![Page 2: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/2.jpg)
The SURF family
2
![Page 3: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/3.jpg)
What is cloud computing?
3
Wikipedia:
Cloud computing is a jargon term without a commonly accepted non-ambiguous scientific or technical definition
Do we have a common ground?
“”(July 2013)
![Page 4: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/4.jpg)
A definition: cloud computing
4
Essential characteristics:• On-demand self-service• Broad network access• Resource pooling• Rapid elasticity • Measured service
Service models:• Software as a Service (SaaS)• Platform as a Service (PaaS)• Infrastructure as a Service (IaaS)
![Page 5: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/5.jpg)
Agenda
1.- SURFsara’s HPC Cloud service
2.- User experience
3.- Demo
![Page 6: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/6.jpg)
1SURFsara’s HPC Cloud service
![Page 7: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/7.jpg)
What do we (SURFsara) want to offer?
7
Services for scientists…scientists ⇏ systems gurus
… complex users’ problems• Data: big, dirty, non-structured…• Computation: complex (e.g.: modeling, simulation)
• Libraries nightmare• 3rd party, incompatibility, maintenance…
… flexibility
… trial and error
… test
… cooperate… share
… show
… scratch … privacy
1.- Our service
![Page 8: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/8.jpg)
What does our HPC Cloud offer?
8
Your own world
In a jar
1.- Our service
Virtualization
![Page 9: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/9.jpg)
Build your own (virtual) machine:
• Hardware• CPU• Memory• Input/Output
• Disk• Network interfaces
• Software• Operating System• Programs• Libraries
A place to build a running system
What do you see, as a user?
1.- Our service
![Page 10: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/10.jpg)
Build your own cluster:• Private network• Internet access
A place to build abunch of systems
What do you see, as a user? (and II)
1.- Our service
Our say:
IaaSPowered by…
![Page 11: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/11.jpg)
Cloud computing landscape
1.- Our service
Screen captures: https://clutch.co/cloud
![Page 12: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/12.jpg)
2User experience
![Page 13: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/13.jpg)
IaaS: Your place to run VMs
132.- User experience
Image Template VMs s
Instantiate
Check out the
AppMarket!
• CPU• RAM• I/O
• Disks• Network
• …
• Data store• Persistency• …
![Page 14: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/14.jpg)
IaaS: your interconnected VMs
142.- User experience
Private network
Internet
![Page 15: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/15.jpg)
Scaling
151.- Scaling possibilities
Your applicationmay need more…
Scale up Scale outvs.
![Page 16: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/16.jpg)
User applications
162.- User experience
• Flexible software mix• Big VMs
• Elasticity• Provide their own service to
their own users• Software that requires licenses• Set up, test and deploy workflows• Deliver training; courses• Intensive computing
…from diverse fields:
• Biology
• Genetics
• Informatics
• Chemistry
• Ecology
• Linguistics
• Robotics
• Business
• Social sciences
• Engineering
• Humanities
• Water management
• …
Users like & leverage…
![Page 17: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/17.jpg)
Demo
3
![Page 18: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/18.jpg)
<<EOFAnder Astudillo
CreditsImages: Wikipedia, Science Park, RRZE icons,
NIST, nVidia, CephSlides: SURFsara colleagues
Request:UI:
Doc:
https://e-infra.surfsara.nlhttps://ui.hpccloud.surfsara.nlhttps://doc.hpccloud.surfsara.nl
![Page 19: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/19.jpg)
Introduction to cloud computing for the VPH
Alessandro [email protected]
INSIGNEO Institute for in silico medicineDepartment of Mechanical Engineering
The University of SheffieldSheffield, UK
VPH Webinar Series 30/01/2018
![Page 20: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/20.jpg)
Webinar - 30/01/ 2018
Outline
● Introduction to openBF○ What it does
○ How it does it
○ What you get
● Typical application○ From individual to population studies
○ Serial vs parallel (desktop vs cloud)
○ MC results
■ Convergence
■ Biomarker distributions
![Page 21: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/21.jpg)
Webinar - 30/01/ 2018
openBF
● Finite volume 1D solver based on Navier-Stokes
equations
● Written in Julia
● Computes the solution of pulsatile flow in
networks of elastic vessels
● Open-source (Apache 2.0)
https://github.com/INSIGNEO/openBF
Mel
is A
., G
auss
ian
proc
ess
emul
ator
s fo
r 1D
vas
cula
r mod
els,
PhD
The
sis,
201
7ht
tp://
ethe
ses.
whi
tero
se.a
c.uk
/191
75/
![Page 22: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/22.jpg)
Webinar - 30/01/ 2018
Single vessel
● Arteries are narrow and elastic
● Only radial displacement
● No bends
● Parameters○ Length
○ Internal radius
○ Young’s modulus (elastic properties)
○ Thickness
○ Blood properties
■ Density
■ Viscosity
E
model.csv
model_constants.jl
![Page 23: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/23.jpg)
Webinar - 30/01/ 2018
Network
● Conjunction
● Bifurcation
● Anastomosis
model.csv
![Page 24: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/24.jpg)
Webinar - 30/01/ 2018
Inlet boundary condition
● Inlet○ Time varying volumetric flow rate
model_inlet.dat
![Page 25: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/25.jpg)
Webinar - 30/01/ 2018
Results
● Pulse waveforms all over the network○ Pressure
○ Volumetric flow rate
○ Cross sectional area
● Pulse wave analysis
![Page 26: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/26.jpg)
Webinar - 30/01/ 2018
Predictions
● Change input parameters to
simulate a specific cardiovascular
condition
● Compare new results with baseline
waveforms (healthy subject)
![Page 27: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/27.jpg)
Webinar - 30/01/ 2018
Population simulation
● Explore the entire input
space
● Filter results accordingly to
physiology
● Test clinical hypothesis on
the population
![Page 28: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/28.jpg)
Webinar - 30/01/ 2018
Population results
● Common clinical
cardiovascular biomarkers
● Distribution across the entire
population
![Page 29: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/29.jpg)
Webinar - 30/01/ 2018
Serial vs parallel
● Single simulation runtime ~ 20’
● MC run required 15k simulations
● Expected total runtime if executed sequentially ~ 200 days
● Embarrassingly parallel strategy
● Cloud: scale UP (better hardware) and scale OUT (more cores)
● By running over a multi-cores VM, the total computational time decreases linearly
with the number of cores available ~ 1 day
![Page 30: HPC Cloud at SURFsara - CompBioMed€¦ · HPC Cloud at SURFsara Ander Astudillo Webinar 30th January 2018. The SURF family 2. What is cloud computing?](https://reader033.vdocument.in/reader033/viewer/2022050418/5f8e0623a3b1be011b75a70f/html5/thumbnails/30.jpg)
Webinar - 30/01/ 2018
openBF installation
● Install git and wget
● Install Python, matplotlib, … (post-processing tools)
● Clone openBF from GitHub
● Run installation script
Demo on SURFsara cloud