vo dca wp5 eurovo-dca review, 10 january 2007 giuliano taffoni & fabio pasian - inaf eurovo dca...
TRANSCRIPT
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
EuroVO DCA WP5 Coordination with Computational Grid Projects
G. Taffoni – WP5 coord
F. Pasian – INAF VO-DCA coord
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
What is WP5?
• Interest area: massive and distributed computing, Grid computing
• Promote coordination between computational Grid(s) and VObs
• Point of view of Data Centres• GRID(s) through Data Centres
DeliverablesWP5-D12: Euro-VO – Computational Grids WorkshopWP5-D13: Final Report on WP5 activities
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
…in practice
• How can Data Centres benefit of GRID computing?
• How can Astronomers benefit of Grid computing through Data Centres?
• We give suggestions and more!
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
Where did we start?
• Partners and collaborators
• Kick off meeting (30 Nov – 1 Dec 2006)
• Periodic teleconf
Name Affiliation Project
G. Taffoni INAF DCA
M. Sponza INAF DCA
P. Osuna ESAC DCA
R. Alvarez Timon ESAC DCA
G. Lemson MPG DCA
J. Zuther MPG DCA
H. Enke IAP AstroGrid-D
E. Solano INTA DCA
J. Santander Vela IAA-CISC Spanish Grid
A.Schaaff CNRS DCA
K. Noddle LU DCA
G. Rixon IAC AstroGrid
E. Valentyn NOVA DCA
A. Belikov NOVA DCA
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
What we should do?
• Gathering information on the different mechanisms for users to access the individual computational Grid infrastructures (middleware, authentication procedures, user interfaces, etc) through contacts with various computational Grid projects
• How to interface Data Centre VObs computing tasks with the different computational Grids, through contacts with user communities (in coordination with WP4 and the TEG) and technical groups (e.g. VO-TECH)
• Fostering access by Data Centre to own national Grids, through the organization of a dedicated workshop
• Dissemination of the acquired knowledge • Verifying that requirements from the VObs community are taken in the
appropriate consideration by the individual computational Grid projects, through contacts with computational Grid projects and the OGF.
…from Annex 1.
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
1. Knowledge Acquisition • Survey of European/National/Campus Grid initiatives• We currently see different flavors of Grids deployed
– Because of application needs, legacy constraints, funding, etc – Diversity is essential to find best solutions
• Grid computing standards are only being defined (OGF)– de jure and de facto standards
• Do Astronomers that use the Grid exist?– YES:
• National projects, No Astronomy-specific Grid project.
• Give DCs a “link” to Grid projects and to Standards.
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
Core topics
• Authentication & Authorization
• Data Management• Job Management• Information system
• Single-sign-on• VOSpace• Workflows• Information System
(Registries)
Grids VObs
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
2. Coordination• Internal:
• WP4, WP3
• External• GRID Project
– OGF, EGEE, DEISA, National and Campus Grids
• IVOA – Grid and WebSservices, AstroRG@OGF, Theory Interest
Group
• EuroVO-TECH – DS3 architecture, Theory
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
Theory• Theory is becoming important in the VObs
• Inclusion of theory data in the IVObs– data already produced– data produced on the fly
• Theory:– VO-DCA WP4, VO-TECH, IVOA
• GRIDs
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
EuroVO DCA and Grids
• EGEE:– We can (and do) use EGEE infrastructure– Interoperability– A new application specific environment for EGEE
• What are the other Grid projects and what are their peculiarities?
• ex: AstroGrid-D will use Globus, NOVA and Astro-Wise• How can we access also those resources?• INTEROPERABILITY is a keyword!!!
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
3. Suggestions and guidelines
• HOWTOs– best practice procedures to access Grid facilities
from Data Centres
• Suggestions (e.g.):– Similar/compatible auth&auth procedures ?– Data sharing between Data Centres and Grid ?– Interoperable workload management systems ?
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
4. Dissemination• Pervasive knowledge of Grid systems to Data
Centres:– HOWTOs– Single knowledge repository: up-to-date pointers to
documents on Grid Initiatives– Workshop– Schools (in coordination with Grid projects)
• Collections of Data Centres requirements• Make Grid initiatives aware of the VObs
requirements• Interoperating is a two way interaction!!!
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
First year checkpoint
…everything is related
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
1. Knowledge Acquisition
Survey of EU grid initiative is a living document, available at the DCA wiki page
Grid standards on Authentication and Authorization, Data Management and Job Management– Correlated with the IVOA standards
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
Methodology
• Documents are not enough….• We identify some Data Centres that want to use
Grid • We identify two use cases:
– data oriented
– theory oriented
• Experiences drive our work.
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
Single-sign-on
• DCA requirements on SSO
• EuroVO-TECH DS3 + IVOA GWS
• Delegation Service– GSI+X509+PMA standard
• Prototype available– VOMS plug-in
• Document on SSO– Standards, (PMA, GSI,
VOMS)
– Recommendations
– Suggestions.
– Single-sign-onGuideline
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
2. Interaction/Interoperability
New VOrg in EGEE: “dca.eurovo.org” Data Centres and EGEE sitesEGEE-III “Astro” clusterParticipation to Grid conferences and
forums (in particular OGF, EGEE)OGF Interoperability Group (work in
progress in coordination with IVOA)
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
3. Coordination
Coordination with WP4 (back2back workshop)Coordination with VO-TECH DS3 architectureCoordination with IVOA Grid&WS groupCoordination with NA3 EGEE for trainingCoordination between National VObs projects and
Grid projects
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
NOVA example
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
4. Dissemination
Wiki page for links and documentsEGEE NA4 and NA3Local and Campus Grids
• Point Data Centres to workshops and training events organized by Grid projects
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007
Next Milestone: EuroVO Computational Grids Workshop
• 9-11 April 2008• back2back with WP4• Aim:
“lay the groundwork to build the bridge between the VObs and the standard Grid infrastructures making developers from the different fields meet and exchange experiences and solutions.”
• http://www.si.inaf.it/eurovow2008
Giuliano Taffoni & Fabio Pasian - INAF
VO DCA WP5 EuroVO-DCA Review, 10 January 2007