May 29th, 2012

French – Asia Grid Activities

Joint FJ / FK Particle Physics Laboratory WorkshopDominique Boutigny

Credits :

Yonny Cardenas

Sylvain Reynaud

History of the French – Asia Grid

May 29th, 2012

The Grid has been one of the major technical project within all the 3 French – Asia LIAs : FJPPL – FCPPL – FKPPL and to a lesser extent within the FVPPL (Grid deployment and tutorial in 2007, 2009 and 2011 )

Part of the activity was related to LCG

Another part was related to different projects (often multidisciplinary) and to computing development :

• Distributed storage

• Interoperability tools• CPU cycles

After a few years of work it has been decided to build a common French / Korean Grid infrastructure, then Japan has been added

We now have a functional global France / Korea / Japan / China distributed infrastructure at the disposal of the LIA projects

Extra services

May 29th, 2012

Federation of iRODS systems between KEK and CC-IN2P3 VO sites

GLite / SRM storage system is often not flexible enough to satisfy standard users' needs

Considerable expertise at CC-IN2P3 and KEK on iRODS

Deploy iRODS as an alternative Grid storage system

Implement advanced data management policies / data replication

A DIRAC service will be implemented to facilitate job submission and reliability

Storage

Job Management

VO Infrastructure

SE

CE

WMS

VOMS

WMSCE

UISE

SE

CE

LFC

VOMS

WIKICE

WMS

CE

A few examples of LIA projects using the France / Asia Grid

May 29th, 2012

FCPPL :

• Autonomous Cosmic radio detection system : TREND – Use GLite / iRODS

• Cosmology projects in the framework of the Tsinghua Center for Astrophysics

FJPPL :• g-2 EDM project @ JPARC

Simulation GEANT4 Data analysis and reconstruction Data sharing

Requirements : 26 000 millions of CPU HS06-hours (preliminary estimate !!! ) – Enormous amount of CPU

A few examples of AIL projects using the France / Asia Grid

May 29th, 2012

FKPPL :

• A lot of activity in 2010 / 2011 on Lattice QCD, GEANT4 and drug discovery

• Grid tutorials and trainings

FJPPL :

• Project to setup a data recovery system based on iRODs for disaster recovery

• See talk from Takashi

FVPPL :

• Analysis of Next Generation Sequence data

• Grid-enabled Drug Discovery

• Generation of Tsunami scenarii

Interoperability tools a.k.a. SAGA

May 29th, 2012

Ideally a standard user wants to have access to "unlimited" computing resources in a uniform and simple way

The reality is often much more complicated :

• Different middleware

• Different storage system

• Different authentication mechanism

• Grid Vs non Grid (simple batch system)

• Cloud / virtualization

• etc…

A lot of work in France and Japan around the Open Grid Forum standard SAGA see Takashi's talk

9

Logical Physical

Supported technologies

in progress

done

Data

Execution

Security

gatekeeper

gLite-W

MS

wsgram

LF

C

SR

B

iRO

DS

Local catalog

gsiFT

P

SR

M

ftp

Grid

techno.

Grid

techno.

Grid

techno.O

thers

Others

Others

BE

S

AR

C

Genesis II

Unicore6

Cream

SS

H

local

Batch S

SH

Unicore6

iRO

DS

HT

TP

HT

TP

S

SF

TP

SR

B

file

zip

InMem

Cred

Globus

G. L

egacy

G. R

FC

820

MyP

roxy

VO

MS

JKS

SS

H

Login / pw

d

X509

.netrc

Secret S

vc

Conclusions

May 29th, 2012

The Grid computing projects are very active within the 3 LIAs

They are now converging on a global coherent project built around the French – Asia Grid

This computing infrastructure is fully functional and at the disposal of the scientific projects. New services will be added to increase the flexibility.

Yonny Cardenas from CC-IN2P3 is providing an efficient support to help people to port their applications on the Grid.