vo dca wp5 eurovo-dca review, 10 january 2007 giuliano taffoni & fabio pasian - inaf eurovo dca...

22
Giuliano Taffoni & Fabio Pasian - INAF VO DCA WP5 EuroVO-DCA Review, 10 January 2007 EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni – WP5 coord F. Pasian – INAF VO-DCA coord

Upload: aileen-joseph

Post on 18-Jan-2016

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

EuroVO DCA WP5 Coordination with Computational Grid Projects

G. Taffoni – WP5 coord

F. Pasian – INAF VO-DCA coord

Page 2: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

What is WP5?

• Interest area: massive and distributed computing, Grid computing

• Promote coordination between computational Grid(s) and VObs

• Point of view of Data Centres• GRID(s) through Data Centres

DeliverablesWP5-D12: Euro-VO – Computational Grids WorkshopWP5-D13: Final Report on WP5 activities

Page 3: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

…in practice

• How can Data Centres benefit of GRID computing?

• How can Astronomers benefit of Grid computing through Data Centres?

• We give suggestions and more!

Page 4: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

Where did we start?

• Partners and collaborators

• Kick off meeting (30 Nov – 1 Dec 2006)

• Periodic teleconf

Name Affiliation Project

G. Taffoni INAF DCA

M. Sponza INAF DCA

P. Osuna ESAC DCA

R. Alvarez Timon ESAC DCA

G. Lemson MPG DCA

J. Zuther MPG DCA

H. Enke IAP AstroGrid-D

E. Solano INTA DCA

J. Santander Vela IAA-CISC Spanish Grid

A.Schaaff CNRS DCA

K. Noddle LU DCA

G. Rixon IAC AstroGrid

E. Valentyn NOVA DCA

A. Belikov NOVA DCA

Page 5: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

What we should do?

• Gathering information on the different mechanisms for users to access the individual computational Grid infrastructures (middleware, authentication procedures, user interfaces, etc) through contacts with various computational Grid projects

• How to interface Data Centre VObs computing tasks with the different computational Grids, through contacts with user communities (in coordination with WP4 and the TEG) and technical groups (e.g. VO-TECH)

• Fostering access by Data Centre to own national Grids, through the organization of a dedicated workshop

• Dissemination of the acquired knowledge • Verifying that requirements from the VObs community are taken in the

appropriate consideration by the individual computational Grid projects, through contacts with computational Grid projects and the OGF.

…from Annex 1.

Page 6: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

1. Knowledge Acquisition • Survey of European/National/Campus Grid initiatives• We currently see different flavors of Grids deployed

– Because of application needs, legacy constraints, funding, etc – Diversity is essential to find best solutions

• Grid computing standards are only being defined (OGF)– de jure and de facto standards

• Do Astronomers that use the Grid exist?– YES:

• National projects, No Astronomy-specific Grid project.

• Give DCs a “link” to Grid projects and to Standards.

Page 7: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

Core topics

• Authentication & Authorization

• Data Management• Job Management• Information system

• Single-sign-on• VOSpace• Workflows• Information System

(Registries)

Grids VObs

Page 8: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

2. Coordination• Internal:

• WP4, WP3

• External• GRID Project

– OGF, EGEE, DEISA, National and Campus Grids

• IVOA – Grid and WebSservices, AstroRG@OGF, Theory Interest

Group

• EuroVO-TECH – DS3 architecture, Theory

Page 9: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

Theory• Theory is becoming important in the VObs

• Inclusion of theory data in the IVObs– data already produced– data produced on the fly

• Theory:– VO-DCA WP4, VO-TECH, IVOA

• GRIDs

Page 10: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

EuroVO DCA and Grids

• EGEE:– We can (and do) use EGEE infrastructure– Interoperability– A new application specific environment for EGEE

• What are the other Grid projects and what are their peculiarities?

• ex: AstroGrid-D will use Globus, NOVA and Astro-Wise• How can we access also those resources?• INTEROPERABILITY is a keyword!!!

Page 11: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

3. Suggestions and guidelines

• HOWTOs– best practice procedures to access Grid facilities

from Data Centres

• Suggestions (e.g.):– Similar/compatible auth&auth procedures ?– Data sharing between Data Centres and Grid ?– Interoperable workload management systems ?

Page 12: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

4. Dissemination• Pervasive knowledge of Grid systems to Data

Centres:– HOWTOs– Single knowledge repository: up-to-date pointers to

documents on Grid Initiatives– Workshop– Schools (in coordination with Grid projects)

• Collections of Data Centres requirements• Make Grid initiatives aware of the VObs

requirements• Interoperating is a two way interaction!!!

Page 13: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

First year checkpoint

…everything is related

Page 14: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

1. Knowledge Acquisition

Survey of EU grid initiative is a living document, available at the DCA wiki page

Grid standards on Authentication and Authorization, Data Management and Job Management– Correlated with the IVOA standards

Page 15: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

Methodology

• Documents are not enough….• We identify some Data Centres that want to use

Grid • We identify two use cases:

– data oriented

– theory oriented

• Experiences drive our work.

Page 16: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

Single-sign-on

• DCA requirements on SSO

• EuroVO-TECH DS3 + IVOA GWS

• Delegation Service– GSI+X509+PMA standard

• Prototype available– VOMS plug-in

• Document on SSO– Standards, (PMA, GSI,

VOMS)

– Recommendations

– Suggestions.

– Single-sign-onGuideline

Page 17: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

2. Interaction/Interoperability

New VOrg in EGEE: “dca.eurovo.org” Data Centres and EGEE sitesEGEE-III “Astro” clusterParticipation to Grid conferences and

forums (in particular OGF, EGEE)OGF Interoperability Group (work in

progress in coordination with IVOA)

Page 18: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

3. Coordination

Coordination with WP4 (back2back workshop)Coordination with VO-TECH DS3 architectureCoordination with IVOA Grid&WS groupCoordination with NA3 EGEE for trainingCoordination between National VObs projects and

Grid projects

Page 19: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

NOVA example

Page 20: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

4. Dissemination

Wiki page for links and documentsEGEE NA4 and NA3Local and Campus Grids

• Point Data Centres to workshops and training events organized by Grid projects

Page 21: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007

Next Milestone: EuroVO Computational Grids Workshop

• 9-11 April 2008• back2back with WP4• Aim:

“lay the groundwork to build the bridge between the VObs and the standard Grid infrastructures making developers from the different fields meet and exchange experiences and solutions.”

• http://www.si.inaf.it/eurovow2008

Page 22: VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni

Giuliano Taffoni & Fabio Pasian - INAF

VO DCA WP5 EuroVO-DCA Review, 10 January 2007