comsolgrid – a framework for performing large-scale ... · boinc (berkely open infrastructure for...
TRANSCRIPT
![Page 1: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/1.jpg)
1 / 21
ComsolGrid – A Framework forperforming large-scale Parameter Studies using Comsol Multiphysics and BOINC
Christian Benjamin Ries
E-Mail: Christian_Benjamin.Ries [at] fh-bielefeld [dot] deWebseite: http://www.christianbenjaminries.de | .org
COMSOL Conference, Paris, 18th November 2010
Presented at the COMSOL Conference 2010 Paris
![Page 2: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/2.jpg)
2 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
● Briefly Introduction
● ComsolGrid
● Test-Cases
● Conclusion
Outline
![Page 3: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/3.jpg)
3 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
Introduction
High effort of maintaining!
High amount of invest is needed!
Additional buildings are needed!
New infrastructure!
Not energy-efficient!
etc. pp..
Common style!
![Page 4: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/4.jpg)
4 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
Introduction
Huge computational problems couldbe splitted into small valuable packages, so-called workunits,e.q. large-scale parameter studies!
Company members downloadthese workunits, perform the computation and send back the result
![Page 5: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/5.jpg)
5 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
Introduction
Huge computational problems couldbe splitted into small valuable packages, so-called workunits,e.q. large-scale parameter studies!
Company members downloadthese workunits, perform the computation and send back the result
![Page 6: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/6.jpg)
6 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
Introduction
![Page 7: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/7.jpg)
7 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
Introduction
Huge computational problems couldbe splitted into small valuable packages, so-called workunits,e.q. large-scale parameter studies!
Company members downloadthese workunits, perform the computation and send back the result
![Page 8: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/8.jpg)
8 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework for solving large-scale compuational problems by means of public resource computing (PRC).
In contrast to massive parallel computing, PRC applicationsare distributed onto a large number of heterogeneous client computers connected by the Internet where each computeris assigned an individual task that can be solved independently without the need of communication upon the clients.
Introduction
![Page 9: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/9.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 9 / 21
BOINC Client● Computers, which are registered at one BOINC project● Heterogeneous infrastructure (Linux, Mac OS X, Windows, …)● 32-/64-Bit, CPU, GPU, Multi-Thread
TechnologyBOINC Server
![Page 10: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/10.jpg)
10 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
ComsolGrid
Implementation of 3 main components: - ComsolGridFCGI Interface for maintainer of simulations← - ComsolGridQt Uses ComsolGridFCGI to create ← parameter-studies - ComsolGridStarter Handler for COMSOL Multiphysics ← (Start, Stop, Pause, Abort)-of simulations
![Page 11: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/11.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 11 / 21
Roles:
(1) Administrator Open for some definitions... :-) ←
(2) Developer Developer can add new scientific ← applications
(3) Scientist Persons of this role can add new simulations← and add new parameter values of one simulation
(4) Tester testing purposes, should be removed in← productive releases
ComsolGrid
![Page 12: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/12.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 12 / 21
A graphical user interface to create new parameter studies.
Small and focused on use.
ComsolGridQt
![Page 13: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/13.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 13 / 21
ComsolGridQt
![Page 14: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/14.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 14 / 21
BOINC Manager displays the progress in percent of each calculation.
COMSOL Multiphysics creates a log file of the performing process. This value is shown in the BOINC Manager.
ComsolGrid
![Page 15: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/15.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 15 / 21
ComsolGrid
![Page 16: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/16.jpg)
16 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
● COMSOL Multiphysics Version 4.0a shared with Network File System (NFS) Protocol
● Test clients are in the same subnet
● 32-/64-Bit COMSOL versios is used
● Ubuntu Linux 10.4 (LTS)
Test Case
![Page 17: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/17.jpg)
17 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
● Validator checks the results
● Assimilator stores the results in a database of file system
Test Case
![Page 18: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/18.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 18 / 21
Name of the simulation model falling_sand.mph
- (1) objWidth, width of the model (default: 0,006m) - (2) objHeight, height of the model (default: 0,014m)
Variations of Parameter (1) & Parameter (2):
Start Stop Step Default(1) 0.001 : 0.015 : 0.0005 : 0.006(2) 0.001 : 0.025 : 0.001 : 0.014
54 Simulations!→
→ 108 Workunits!
Test Case
![Page 19: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/19.jpg)
ComsolGridComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering 19 / 21
Rate of Success: 95%
5% are misconfigured client machines, not aproblem of ComsolGrid!
Test Case
![Page 20: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/20.jpg)
20 / 21ComsolGrid · 18.11.10 · Christian Benjamin Ries, University of Applied Sciences Bielefeld, Computational Materials Science & Engineering
● It works!
● We use available and maintained infrastructures!
● BOINC is open-source, for free, and you can modify it!
● ComsolGrid is an cheap way the install your own high-performance cluster!
Conclusion
![Page 21: ComsolGrid – A Framework for performing large-scale ... · BOINC (Berkely Open Infrastructure for Network Computing) is the key technology of Seti@home. It is an open-source framework](https://reader034.vdocument.in/reader034/viewer/2022052002/6014ed768f419473e9465f87/html5/thumbnails/21.jpg)
Thanks,Dipl.-Ing. (FH) Christian Benjamin Ries, M.Sc.
Telefon: +49 (0) 521 106 71222e-Mail: Christian_Benjamin.Ries [at] fh-bielefeld.deWebsite: http://www.christianbenjaminries.de
Computational Materials Science & Engineering (CMSE)Raum 202, Werner-Bock-Straße 3633602 D-Bielefeld