david p. anderson · david p. anderson space sciences lab uc berkeley magic october 5, 2016 ....
TRANSCRIPT
![Page 1: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/1.jpg)
Volunteer Computing and BOINC
David P. Anderson
Space Sciences Lab
UC Berkeley
MAGIC
October 5, 2016
![Page 2: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/2.jpg)
Scientific computing
Consumer electronics
Volunteer
computing
![Page 3: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/3.jpg)
BOINC
● Middleware for volunteer computing
– Open-source, NSF-funded development
– Community-maintained
● Server: used by scientists to make “projects”
● Client: runs on consumer devices
– “attach” to projects
– fetches/runs jobs in background
![Page 4: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/4.jpg)
Example projects
● Climateprediction.net
● Rosetta@home
● Einstein@home
● IBM World Community Grid
● CERN
![Page 5: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/5.jpg)
Current volunteered resources
● 500,000 active devices
– BOINC + Folding@home
● 2.3M CPU cores, 290K GPUs
● 93 PetaFLOPS
● 85% Windows, 7% Mac, 7% Linux
![Page 6: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/6.jpg)
Performance potential
● 1 billion desktop/laptop PCs
– CPUs: 10 ExaFLOPS
– GPUs: 1,000 ExaFLOPS
● 5 billion smartphones
– CPUs: 20 ExaFLOPS
– GPUs: 1,500 ExaFLOPS
![Page 7: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/7.jpg)
Realistic potential
● Study: 5-10% of people who learn about VC
would participate
● Devices compute 60% of the time
● So if we can tell the world about VC, could get
100 ExaFLOPS
![Page 8: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/8.jpg)
Cost
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
CPU cluster Amazon EC2 BOINC
cost of 1 TFLOPS/year
cost ($M)
![Page 9: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/9.jpg)
BOINC job model
● An app can have many versions
● Submit jobs to apps, not versions
● The BOINC scheduler decides what version(s)
to use in response to a particular request
![Page 10: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/10.jpg)
Per-platform apps
● Windows/Intel, 32 and 64 bit
● Mac OS X
● Linux/Intel
● Linux/ARM (works for Android too)
![Page 11: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/11.jpg)
Other types of apps
● Multicore
● GPU apps
– CUDA (Nvidia)
– CAL (AMD)
– OpenCL (Nvidia, AMD, Intel)
![Page 12: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/12.jpg)
VM apps
● App is VM image + executable
● BOINC client interfaces via “Vbox Wrapper”
● Advantages:
– No Win/Mac compilation
– sandbox security
– checkpoint/restart using Vbox “snapshots”
● Docker apps
![Page 13: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/13.jpg)
Issues with VM apps
● Host must have VirtualBox installed
– included with default BOINC install
● To run 64-bit VMs or Docker, host must have
VM CPU features enabled
● Doesn’t work with GPUs (currently)
● Doesn’t work with ARM/Android
![Page 14: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/14.jpg)
What workload can VC handle?
● Variable turnaround, so best for bags of tasks
– but can handle DAGs/workflows too
● Moderate RAM, storage requirements
● Network: server capacity limits
● Data privacy
![Page 15: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/15.jpg)
Areas where VC is useful
● Compute-intensive data analysis
– particle colliders (LHC)
– astrophysics
– genomics
● Simulations of physical systems
– nanosystems
– drug discovery, protein folding
– climate modeling
– cosmology
![Page 16: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/16.jpg)
BOINC system structure:
the original model
● Dynamic “ecosystem” of projects
● Projects compete for computing power by
publicizing their research
● Volunteers browse projects, support what they
think is important
● Best science gets most computing power
● Public learns about science
![Page 17: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/17.jpg)
Original model hasn’t worked
● Creating a project is too hard
● Creating a project is risky
● It’s hard to publicize VC: too many “brands”
● Volunteers are static
![Page 18: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/18.jpg)
A new model
● Volunteers see “Science@home”, not separate
projects
● Can express “science preferences”
● Science@home allocates computing power
Science@home
Projects
![Page 19: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/19.jpg)
New model, part 2
● Instead of single-scientist projects, “umbrella”
projects that serve many scientists, and are
operated by organizations
● Prototypes under development:
– TACC
– nanoHUB
![Page 20: David P. Anderson · David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016 . Scientific computing Consumer electronics Volunteer ... 85% Windows, 7% Mac, 7% Linux](https://reader033.vdocument.in/reader033/viewer/2022042300/5eca921c7009be5b9d77a3cf/html5/thumbnails/20.jpg)
Corporate partnerships
● Past/current:
– IBM World Community Grid
– Intel Progress Thru Processors
– HTC Power to Give
– Samsung Power Sleep
● In development:
– Blizzard Entertainment (games)
– EE (British cell phone provider)