Download - Adaptive Grid Computing
![Page 1: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/1.jpg)
www.globus.org
Adaptive Grid Computing
Detecting and Adjusting for Dynamic Grid Conditions
![Page 2: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/2.jpg)
www.globus.org
Experiments with a Grid-Enabled Computational Framework
Dave Angulo, Ian FosterChuang Liu, Matei Ripeanu, Michael Russell, Lingyun Yang
Distributed Systems Laboratory
University of Chicago & Argonne National Laboratory
Gabrielle Allen, Thomas Dramlitsch,
Gerd Lanferman, Ed Seidel, Thomas RadkeMax-Planck-Institut für Gravitationsphysik
![Page 3: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/3.jpg)
www.globus.org
Acknowledgements
This work was supported in part by the NSF-funded Grid Application Development Software project under Grant No. 9975020.
We are grateful to our GrADS project colleagues for discussions on the topics discussed here.
![Page 4: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/4.jpg)
www.globus.org
Research Goals
Investigate methods and structures for efficient Grid execution via in-depth study of a demanding application, including– Constructs for adapting to heterogeneity
– Constructs for dynamic resource acquisition Create testbed for GrADSoft components,
as they emerge Investigate utility of computational
frameworks as facilitator of Grid computing
![Page 5: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/5.jpg)
www.globus.org
Migrate to “faster/ cheaper” system– When better system
discovered
– When requirements change
– When characteristics change (e.g., competition)
Adaptation to Dynamic Grid Environments
![Page 6: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/6.jpg)
www.globus.org
Migrate to “faster/ cheaper” system– When better system
discovered
– When requirements change
– When characteristics change (e.g., competition)
Adaptation to Dynamic Grid Environments
![Page 7: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/7.jpg)
www.globus.org
External Processes / Services
Cactus Worm Architecture
Cactus “flesh”
CactusWormServer
Cactus WormMigrationThorn
Resource Selector Client Thorn
App & other thorns
Performance Degradation Detection
Globus Toolkit™GRAM
Resourceselector
GlobusToolkit™
GIIS
GlobusToolkit™
GRISs
GlobusToolkit™
GRISsResources
NWS Migration Logic Manager
(Under Development)
![Page 8: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/8.jpg)
www.globus.org
Migration Demonstration
GIIS Running on jupitor.isi.edu
Cluster at UIUC Cluster at UCSD
Resource Selector Service Running on
hamachi.cs.uchicago.edu
Cactus Worm Server Running on
amajor.cs.uiuc.edu
![Page 9: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/9.jpg)
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Computational application begins run
NetLogger records performance and displays
visual graph
![Page 10: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/10.jpg)
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Competing application on one node steals
CPU cyclesNetLogger
![Page 11: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/11.jpg)
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Resource Selector Service contacted
NetLogger
![Page 12: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/12.jpg)
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
resource list sent to Worm Server
NetLogger
![Page 13: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/13.jpg)
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Worm Server shuts down app
NetLogger
![Page 14: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/14.jpg)
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Worm Server starts app on new resouces
NetLogger
![Page 15: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/15.jpg)
www.globus.org
Performance Results
![Page 16: Adaptive Grid Computing](https://reader036.vdocument.in/reader036/viewer/2022070401/568135cb550346895d9d2de4/html5/thumbnails/16.jpg)
www.globus.org
Gabrielle Allen; Dave Angulo; Ian Foster; Gerd Lanfermann; Chuang Liu; Thomas Radke; Ed Seidel; John Shalf. The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment. In International Journal of High-Performance Computing Applications Volume 15, Number 4, 2001
http://people.cs.uchicago.edu/~dangulo/papers/
This presentation: http://www.cs.uchicago.edu/~dangulo/scdemo.ppt