1 grid d. royo, o. ardaiz, l. díaz de cerio, r. meseguer, a. gallardo, k. sanjeevan computer...

24
1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

Post on 21-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

1

GRID

D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture DepartmentUniversitat Politècnica de Catalunya

Page 2: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

2

Outline

• Internet• GRID• Globus• ULabGrid• Summary

Page 3: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

3

Internet

• 1962 (tcp/ip)• 1994 (www)• Used for:

• EXCHANGE information (documents, messages, images, etc.)

Page 4: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

4

Outline

• Internet• GRID• Globus• ULabGrid• Summary

Page 5: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

5

GRID

• GRID (96): infrastructure that enables the use of computers (and resources in general) owned and managed by multiple organizations

Networked virtual supercomputers:networks connecting supercomputers, DB, scientific instruments... distributed geographically

Page 6: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

6

GRID Applications

• Smart instruments: Advanced scientific instruments coupled with supercomputers, users and databases.

• Distributed supercomputing: to solve problems too large to fit on any single computer

• Teraflop desktops: transfer intensive operations to more capable resources

Page 7: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

7

GRID Applications

• Aplication Service Provider (ASP) and Computing farms• Service-oriented: Out-sourcing hardware,

software, services in general• Access any resource through WWW

• Software and hardware.

Idea: the end-users do not acquiere the resources only uses them and pay for it

Page 8: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

8

Advantages

• Save money• only a PC to access the net (save 30%)

• management and maintenance (save up

65%)

• Avoid hardware and software updates• ASP’s ensures the updating

• Flexible information access • From anywhere at anytime

Page 9: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

9

Advantages

• Possibility to solve new problems• Interoperability• Small users can access the service

• Out-source the service is cheap

Page 10: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

10

System Key Characteristics

• Heterogeneity at multiple levels• Hardware, software, networks, users,

etc.

• Multiple administrative domains• Security problems: authentication

mechanism, acces policies, etc.• Fiability• Accounting

Page 11: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

11

Outline

• Internet• GRID• Globus• UlabGrid• Summary

Page 12: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

12

Globus

• What is Globus?

Research and development project focused on enabling the application of Grid concepts to scientific and engineering computing

To help to build GRIDS and develop GRID applications

Page 13: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

13

Globus Services

• Basic modules• Resource Management (GRAM)• Communication (Nexus)• Information (MDS)• Security (GSI)• Helth & Status (HBM)• Remote Data Access (GASS)• Executable Management (GEM)

Page 14: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

14

Globus Services

Metacomputing TestbedsI-WAY/GUSTO

Globus Toolkit modules

Applications andHigher level services

Page 15: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

15

Globus Services: Nexus

• Communication services• Flexible Nexus Communication Library

• Define communication links• Perform Remote Service Request (RSR)• Select the protocol for a RSR depending

when, where and what is being communicated

MPI: if diferent nodes of a parallel computerTCP/UDP: if different computers reliable/unreliable

Page 16: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

16

Globus Services: GridFTP

• Data Transfer Protocol: GridFTP• Parallel data transfer: multiple TCP

streams

• Partial file transfer• Striped data transfer: partitioning data

across multiple servers

Page 17: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

17

Outline

• Internet• GRID• Globus• ULabGrid• Summary

Page 18: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

18

ULabGrid

ULabGrid

Student Student Student Student

Web Browser Web Browser Web Browser Web Browser

School 1 School 2

Page 19: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

19

Pcribes.ac..upc.es

ReplicaMgr MetadataDirec

toryServer

Grid-Proxy GassServer

GlobusPortalUser Directory

Session Scheduler

Resource Mgr

GassServerGlobus-Gatekeeper

File Server

GSSHFTPGlobus-

Gatekeeper

avant.upc.es

Pentium IV pcmartino.ac.upc.es

1->Deploy Application

Student

Instructor: Manages Ulab Apps

%Vnc-server:1%nam &

GassServerGlobus-Gatekeeper

Pentium IV pc3.ac.upc.es

GassServerGlobus-Gatekeeper

Pentium IV pc5.ac.upc.es

GassServerGlobus-Gatekeeper

Pentium IV pc4.ac.upc.es

GassServerGlobus-Gatekeeper

Pentium IV pc5.ac.upc.es

ULab Grid

Web Browser

VNC-client

2->Launch NAM

3->Put User Files

4->Exec VNC, Exec NAM

5-Return VNC port

6->Interact with NAM

Page 20: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

20

ULabGrid Modules

• Session Scheduler• Resource Management• Collaborative services• File Management• Tool management and deployment

Page 21: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

21

Advantages of using ULabGrid

• Software installing and maintenance

• Licensing• Easy acces to hardware and

software resources• Easy to change the lab contents• Simplified interfaces

Page 22: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

22

More advantages ...

• Students can be exercices at home without physical presence at the educational center

• Students can familiarize with the execution tool environment before the course starts• Manuals• examples

Page 23: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

23

Outline

• Internet• GRID• Globus• ULabGrid• Summary

Page 24: 1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya

24

Summary

• Information of interest• GRID Forum• www.globus.org• The Grid: Blueprint for a New

Computing Infrastructure, I. Foster and C. Kesselman

Morgan Kaufmann