adaptive computing on the grid using apples francine berman, richard wolski, henri casanova,...
TRANSCRIPT
![Page 1: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/1.jpg)
Adaptive Computing on Adaptive Computing on the Grid Using AppLeSthe Grid Using AppLeS
Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman,
Silvia Figueira, Jim Hayes, Graziano Obertelli, Jennifer Schopf, Gary Shao, Shava Smallen,Neil Spring, Alan Su, and Dmitrii Zagorodnov
IEEE Transactions on Parallel and Distributed Systems, Vol. 14, No. 5, May 2003
![Page 2: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/2.jpg)
AgendaAgenda
• Introduction
• Problems
• AppLeS and its components
• Result products
• Related works
• Discussions
• Conclusions
![Page 3: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/3.jpg)
IntroductionIntroduction
• What is a Grid?– A collection of resources that can be used as
an ensemble
• What are resources?– Computational devices, networks, online
instruments, storage archives, and etc
![Page 4: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/4.jpg)
ProblemsProblems
• Heterogeneity– Different performance
• Inconsistentcy– Shared– Fail– Upgraded
![Page 5: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/5.jpg)
AppLeS ProjectAppLeS Project
• Application Level Scheduling
• Goals– Investigate adaptive scheduling for Grid
computing– Apply research results to applications for
validating the efficacy of the approach and extracting Grid performance for the end-user
![Page 6: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/6.jpg)
StepsSteps
(6) ScheduleAdaptation
(1) ResourceDiscovery
(2) ResourceSelection
(3) ScheduleGeneration
(4) ScheduleSelection
(5) ApplicationExecution
![Page 7: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/7.jpg)
Resource DiscoveryResource Discovery
• Depend on the Grid– A List of user’s logins– Resource discovery services of each Grid
![Page 8: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/8.jpg)
Resource SelectionResource Selection
• Simple SARA– Synthetic Aperture
Radar Atlas– Developed by JPL and
SDSC– Provide access to
satellite images distributed in various repositories
– End-to-end available bandwidth is predicted using NWS
![Page 9: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/9.jpg)
Performance ModelingPerformance Modeling
• Jacobi 2D• Main loop
– Loop until convergence– For all matrix entries
Ai,j
• Ai,j = ¼(Ai,j + Ai+1,j + Ai-1,j + Ai,j+1 + Ai,j-1)
– Compute local error
• Model– Ti = Areai * Operi *
AvailCPUi + Ci ; 1 <= I <= p
i,ji-1,j i+1,j
i,j-1
i,j+1
Area - the size of the strip, Oper - execution time to compute one entryAvailCPU - percentage of available CPU, C - Communication time
![Page 10: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/10.jpg)
Scheduling GenerationScheduling Generation
• Complib– A computational biology application– Compare a library of unknown sequences
against a database of “known” sequences using FASTA scoring method
• Parallization– Master/Worker– Work size
• Small unit size (Self-scheduling) - high overhead• Big unit size - load imbalance
![Page 11: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/11.jpg)
AppLeS’s ApprochAppLeS’s Approch
![Page 12: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/12.jpg)
Scheduling AdaptationScheduling Adaptation
• MCell– A computational
neuroscience application
– Study biochemical interactions within living cells at molecular level
– Multiple independent tasks
– Shared input
![Page 13: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/13.jpg)
XSufferageXSufferage
• Based on Sufferage• Sufferage value =
second best - first best
• XSufferage concerns data replication time (zero for locally available)
![Page 14: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/14.jpg)
OutcomeOutcome
• APST - AppLeS Parameter Sweep Template
• AMWAT - AppLeS Master/Worker Application Template
• SA - Supercomputer AppLeS
![Page 15: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/15.jpg)
APSTAPST
• Parameter Sweep Applications– Mostly independent
• Provide– Transparent deployment– Automatic scheduling
• Capabilities– Launching tasks– Moving and storing data– Discovering and monitoring
resources
![Page 16: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/16.jpg)
AMWATAMWAT
• Master/Worker• Provide
– APIs for• Discovering• Scheduling• Predicting
SS - Self-SchedulingFSC - Fixed Size ChunkingGSS - Guided Self-SchdulingTSS - Trapezoidal Self-SchedulingFAC2 - Factoring
![Page 17: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/17.jpg)
SASA
• Space-shared• Moldable jobs• Reduce response
times
![Page 18: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/18.jpg)
Related WorksRelated Works
• Environment– MARS and Dome - Run-time checkpointing environment
• Structure– MARS - SPMD– VDCE and SEA - Task graph– IOS - Real-time, fine-grained, task graph– Dome and SPP - Abstract language
• Dome - SPMD• SPP - Task graph
• Performance model– Depend on program structure
• Objective– Minimize execution time
![Page 19: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/19.jpg)
Related WorksRelated Works
Env Struct Perf Approach
AppLeS Any Any Provided Adaptive
MARS ChkPnt SPMD Statistics Data Dist
Dome ChkPnt SPMD Data Dist Data Dist
VDCE TG Derived List Sched
SPP TG Derived
SEA TG Data Flow Expert Sys
IOS TG Derived GA
GrADS
![Page 20: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/20.jpg)
DiscussionsDiscussions
• Performance of distributed applications depend on both application and platform-specific information
• Storage and service are usually separated
• Communication must be concerned in the model
• Multi-applications environment has not been addressed
![Page 21: Adaptive Computing on the Grid Using AppLeS Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Marcio Faerman, Silvia Figueira,](https://reader036.vdocument.in/reader036/viewer/2022062519/5697bff41a28abf838cbce6e/html5/thumbnails/21.jpg)
ConclusionsConclusions
• AppLeS– An application-level scheduling framework– Provide adaptive, flexible, and reusable
components– being integrated into GrADS for building next
generation Grid applications
• Each part has been demonstrated its improvement