grid computing yoab gorfu abe guerra kay odeyemi renel smith
Post on 15-Jan-2016
219 views
TRANSCRIPT
![Page 1: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/1.jpg)
Grid Computing
Yoab GorfuAbe GuerraKay OdeyemiRenel Smith
![Page 2: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/2.jpg)
Presentation Outline
Introduction Architecture Large Deployment Example - National
Fusion Grid Grid Toolkits
– Globus Toolkit – Stateful Web Services
![Page 3: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/3.jpg)
Introduction
“A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive, and inexpensive access to high-end computational capabilities.”
Criteria for a Grid• Coordinates resources that are not subject to
centralized control.• Uses standard, open, general-purpose protocols
and interfaces.• Delivers nontrivial qualities of service.
![Page 4: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/4.jpg)
Introduction
‘Grid Problem’ - ‘coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations’ [1]
Virtual Organizations (VOs) • Vary dramatically• Core set of requirements
![Page 5: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/5.jpg)
Introduction
VO requirements• Flexibility• Control• Varied resources• Usage modes
![Page 6: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/6.jpg)
Introduction
![Page 7: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/7.jpg)
Introduction
Grid Computing Benefits:• Exploit underutilized resources• Resource balancing• Virtualize resources across an enterprise• Enable collaboration for virtual organizations
![Page 8: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/8.jpg)
Companies involved in Grid Computing
Avaki Axceleon CapCal Centrata DataSynapse Distributed Science Elepar Entropia.com Grid Frastructure GridSystems Groove Networks IBM Intel
Powerllel ProcessTree Sharman Networks Kazza Sun Gridware Sysnet Solutions Tsunami Research Ubero United Devices Veritas Xcomp
Jivalti Mithral Mind Electric Mojo Nation NewsToYou.com NICE, Italy Noemix, Inc. Oracle Parabon Platform Computing Popular Power
Source: http://www.gridcomputing.com/
![Page 9: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/9.jpg)
Computation Grid Projects
Particle Physics –global sharing of data and computation
Astronomy–‘Virtual Observatory' for multi-wavelength astrophysics
Chemistry–remote control of equipment and electronic logbooks
Engineering–industrial healthcare and virtual organizations
Bioinformatics–data integration, knowledge discovery and workflow
Healthcare –sharing normalized mammograms
Environment–Ocean, weather, climate modeling, sensor networks
![Page 10: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/10.jpg)
Grid Architecture
Protocol architecture Standards-based open architecture offers:
• Interoperability• Services• API flexibility
![Page 11: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/11.jpg)
Grid Architecture
![Page 12: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/12.jpg)
Grid Architecture
Fabric Layer – ‘provides the resources to which shared access is mediated by Grid protocols’• Resource-specific operations• Functionality vs. simplicity
![Page 13: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/13.jpg)
Grid Architecture
Fabric layer should provide:• Enquiry mechanisms• Resource management mechanisms
![Page 14: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/14.jpg)
Grid Architecture
Connectivity Layer – ‘defines core communication and authentication protocols required for Grid-specific network transactions’• Data exchange• Verification
![Page 15: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/15.jpg)
Grid Architecture
Connectivity layer should provide:• Single sign on• Delegation• Integration with various local security solutions• User-based trust relationships
![Page 16: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/16.jpg)
Grid Architecture
Resource Layer – ‘defines protocols for the secure negotiation, initiation, monitoring, control, accounting, and payment of sharing operations on individual resources’• Use Fabric Layer functions• Information vs. Management protocols
![Page 17: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/17.jpg)
Grid Architecture
Resource layer should provide:• Fabric layer functionality• ‘exactly once’ semantics• Error reporting
![Page 18: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/18.jpg)
Grid Architecture
Collective Layer – ‘contains protocols and services which capture interactions across collections of resources’• General vs. specific purpose
![Page 19: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/19.jpg)
Grid Architecture
Collective layer could provide:• Software discovery services• Community accounting and payment services• Collaboratory services
![Page 20: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/20.jpg)
Grid Architecture
Applications Layer – ‘comprises the user applications that operate within a VO environment.’
![Page 21: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/21.jpg)
National Fusion Grid
A Collaboratory Pilot project that is creating and deploying collaborative software tools throughout the magnetic fusion research community
![Page 22: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/22.jpg)
National Fusion Grid
Simple Goals To advance scientific understanding and innovation
in magnetic fusion research by enabling more efficient use of existing experimental facilities and more effective integration of experiment, theory, and modelling.
To advance scientific understanding and innovation in fusion research
Making widespread use of Grid technologies http://www.fusiongrid.org/
![Page 23: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/23.jpg)
National Fusion Grid
VISION FOR THE FUSION GRID Data, Codes, Analysis Routines, Visualization Tools should be
thought of as network accessible services
Shared security infrastructure
Collaborative nature of research requires shared visualization applications and widely deployed collaboration technologies
— Integrate geographically diverse groups
Not focused on CPU cycle scavenging or “distributed” supercomputing (typical Grid justifications)
— Optimize the most expensive resource - people’s time
![Page 24: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/24.jpg)
National Fusion Grid
The problems of data sharing and rapid data analysis the National Fusion Collaboratory community adopted: – a common data acquisition and management
system – common relational database run-management
schema
![Page 25: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/25.jpg)
National Fusion Grid
Geographically Diverse Community
3 Large Experimental Facilities — Alcator, C-Mod, DIII-D — NSTX ~$1B replacement cost
40 U.S. fusion research sites— Over 1000 scientists in 37 state
Efficient collaboration is a requirement! — Integrate geographically diverse groups
One future worldwide machine — Not based in US — US needs collaboration tools to benefit
![Page 26: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/26.jpg)
National Fusion Grid
National Magnetic Fusion Research Community FUSION COMMUNITY HAS 40 US SITES IN 37 STATES
![Page 27: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/27.jpg)
National Fusion Grid
Design and Implementation of Access Grid Produced of both design and architecture
documents for review by public (beginning introduction into GGF document process)
Demonstrated full-featured prototypes in Nov 2002 at SC2002 of new venue architecture, venue client, workspace docking complete with application sharing
![Page 28: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/28.jpg)
National Fusion Grid
Building the Fusion Grid (Progressive testbeds) Deployment Phrase Use Policies and Issues of Trust Moving to Real-Time Wrapping it up
![Page 29: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/29.jpg)
Globus & the Globus Toolkit
Globus– Open source community focused on Grid computing
Globus Toolkit– Started in the late 1990’s to address common Grid
application problems– … found at www.globus.org– Includes
A set of services focused on infrastructure management Tools for building new Web services, in Java, C, and Python Standards-based security infrastructure Client APIs and command line programs
![Page 30: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/30.jpg)
Globus Toolkit & Web Services
Grid
Web
WSRF
Started far apart in apps & tech
OGSI
GT2
GT1
HTTPWSDL,
WS-*
WSDL 2,
WSDM
Have beenconverging
Grid
Web
WSRFWSRFWSRF
Started far apart in apps & tech
Started far apart in apps & tech
OGSI
GT2
GT1
HTTPWSDL,
WS-*
WSDL 2,
WSDM
Have beenconverging
OGSI
GT2
GT1
HTTPWSDL,
WS-*
WSDL 2,
WSDM
OGSI
GT2
GT1
HTTPWSDL,
WS-*
WSDL 2,
WSDM
Have beenconverging
![Page 31: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/31.jpg)
Modeling Stateful Resources with Web Services
Web Services Background What is a Web Service? Web Service Environments A Brief Taxonomy of State and Services Stateless Implementations, Stateful
Interfaces
![Page 32: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/32.jpg)
Modeling Stateful Resources with Web Services
What is a Web Service?
Machine to Machine over a network via exchange of SOAP messages
Conveyance via HTTP
Key facility in distributed environment known as SOA
![Page 33: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/33.jpg)
Modeling Stateful Resources with Web Services
Why Web Service in Grid Discussion?
Convergence in Grid and SOA
Many grid implementations use Web Services
![Page 34: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/34.jpg)
Modeling Stateful Resources with Web Services
Web Services are usually Stateless
All information needed by the service is contained in the input message
All results are return via the output message The service does not ‘remember’ what it just
did on completion Not that useful for Grid
![Page 35: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/35.jpg)
Modeling Stateful Resources with Web Services
State and Web Services
Most applications are not stateless
Grid application need their components to keep state
Web services can be components of Grid applications
![Page 36: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/36.jpg)
Modeling Stateful Resources with Web Services
State and Web Services
Two general ways for representing state
The service keep track of it’s state
The service has other systems keep track of state for it
Ideally, Option 2 preferred
![Page 37: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/37.jpg)
Modeling Stateful Resources with Web Services
WS-Resource
Protocol for modeling stateful resources
Standards for read, update and querying of state values.
![Page 38: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/38.jpg)
Modeling Stateful Resources with Web Services
WS-Resource Lifecycle
Assignment & Use
Destruction
Creation
![Page 39: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/39.jpg)
Modeling Stateful Resources with Web Services
WS-Resource Example
![Page 40: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/40.jpg)
Modeling Stateful Resources with Web Services
WS Resource – ACID properties
Atomicity
Consistency
Isolation
Durability
![Page 41: Grid Computing Yoab Gorfu Abe Guerra Kay Odeyemi Renel Smith](https://reader036.vdocument.in/reader036/viewer/2022081512/56649d555503460f94a33610/html5/thumbnails/41.jpg)
References
Foster, Ian; “Globus Toolkit Version 4: Software for Service-Oriented Systems:, IFIP International Conference on Network and Parallel Computing, Springer-Verlag LNCS 3779, pp 2-13, 2005
Foster, Ian; “WS-Resource Framework: Globus Alliance Perspectives”, GlobusWORLD, January 20, 2004
Foster, I., C. Kesselman, and S. Tuecke, The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications, 2001. 15(3): p. 200-222.
Foster, I., Frey, J., Graham, S., Tuecke, S., Czajkowski, K., Ferguson, D., Leymann, F., Nally, M., Storey, T. and Weerawaranna, S. Modeling Stateful Resources with Web Services. Globus Alliance, 2004.
Keahey, K, Fredian, T., Peng, D.P. Schissel, M. Thompson, I. Foster, M. Greenwald, D. McCune, Computational Grids in Action: The National Fusion Collaboratory, submitted to Future Generation Computer System, October 2002. 18(8): p. 1005-1015.