french – asia grid activities
Post on 05-Jan-2016
33 Views
Preview:
DESCRIPTION
TRANSCRIPT
May 29th, 2012
French – Asia Grid Activities
Joint FJ / FK Particle Physics Laboratory WorkshopDominique Boutigny
Credits :
Yonny Cardenas
Sylvain Reynaud
History of the French – Asia Grid
May 29th, 2012
The Grid has been one of the major technical project within all the 3 French – Asia LIAs : FJPPL – FCPPL – FKPPL and to a lesser extent within the FVPPL (Grid deployment and tutorial in 2007, 2009 and 2011 )
Part of the activity was related to LCG
Another part was related to different projects (often multidisciplinary) and to computing development :
• Distributed storage
• Interoperability tools• CPU cycles
After a few years of work it has been decided to build a common French / Korean Grid infrastructure, then Japan has been added
We now have a functional global France / Korea / Japan / China distributed infrastructure at the disposal of the LIA projects
Extra services
May 29th, 2012
Federation of iRODS systems between KEK and CC-IN2P3 VO sites
GLite / SRM storage system is often not flexible enough to satisfy standard users' needs
Considerable expertise at CC-IN2P3 and KEK on iRODS
Deploy iRODS as an alternative Grid storage system
Implement advanced data management policies / data replication
A DIRAC service will be implemented to facilitate job submission and reliability
Storage
Job Management
VO Infrastructure
SE
CE
WMS
VOMS
WMSCE
UISE
SE
CE
LFC
VOMS
WIKICE
WMS
CE
A few examples of LIA projects using the France / Asia Grid
May 29th, 2012
FCPPL :
• Autonomous Cosmic radio detection system : TREND – Use GLite / iRODS
• Cosmology projects in the framework of the Tsinghua Center for Astrophysics
FJPPL :• g-2 EDM project @ JPARC
Simulation GEANT4 Data analysis and reconstruction Data sharing
Requirements : 26 000 millions of CPU HS06-hours (preliminary estimate !!! ) – Enormous amount of CPU
A few examples of AIL projects using the France / Asia Grid
May 29th, 2012
FKPPL :
• A lot of activity in 2010 / 2011 on Lattice QCD, GEANT4 and drug discovery
• Grid tutorials and trainings
FJPPL :
• Project to setup a data recovery system based on iRODs for disaster recovery
• See talk from Takashi
FVPPL :
• Analysis of Next Generation Sequence data
• Grid-enabled Drug Discovery
• Generation of Tsunami scenarii
Interoperability tools a.k.a. SAGA
May 29th, 2012
Ideally a standard user wants to have access to "unlimited" computing resources in a uniform and simple way
The reality is often much more complicated :
• Different middleware
• Different storage system
• Different authentication mechanism
• Grid Vs non Grid (simple batch system)
• Cloud / virtualization
• etc…
A lot of work in France and Japan around the Open Grid Forum standard SAGA see Takashi's talk
9
Logical Physical
Supported technologies
in progress
done
Data
Execution
Security
gatekeeper
gLite-W
MS
wsgram
LF
C
SR
B
iRO
DS
Local catalog
gsiFT
P
SR
M
ftp
Grid
techno.
Grid
techno.
Grid
techno.O
thers
Others
Others
BE
S
AR
C
Genesis II
Unicore6
Cream
SS
H
local
Batch S
SH
Unicore6
iRO
DS
HT
TP
HT
TP
S
SF
TP
SR
B
file
zip
InMem
Cred
Globus
G. L
egacy
G. R
FC
820
MyP
roxy
VO
MS
JKS
SS
H
Login / pw
d
X509
.netrc
Secret S
vc
Conclusions
May 29th, 2012
The Grid computing projects are very active within the 3 LIAs
They are now converging on a global coherent project built around the French – Asia Grid
This computing infrastructure is fully functional and at the disposal of the scientific projects. New services will be added to increase the flexibility.
Yonny Cardenas from CC-IN2P3 is providing an efficient support to help people to port their applications on the Grid.
top related