grid deployment status and plan at kek isgc2007 takashi sasaki kek computing research center

GRID Deployment Status and Plan at KEK

ISGC2007

Takashi SasakiKEK Computing Research Center

ISGC2007 27/MAR/2007 [email protected] 2

Who we are?

KEK (High Energy Accelerator Research Organization)Inter University Research Institute Corporation since 2004 National Institute previouslyStill 100% funded by the government

Mission Carry out research related accelerator science

Particle Physics, Material Science, Life Science and so on Supporting collaborating universities

Universities have a freedom for the choice and they can be independent of us


KEKNagoya U.

U. Tokyo

Tokyo Inst. of Tech.

Tsukuba U.

Osaka U.

ICRR/Tpkyo

Kyoto U.JAEA Tokai

Waseda U.

Hiroshima U

Niigata U.

Nara Women U.

Osaka city U.

Shinshu U.

RIKEN

Okayama U.Kobe U.

Kanazawa U.

Kamioka

SuperSINET nodesSINET nodes

High Energy Physics in Japan

ATLAS at LHC CDF at FNAL

KEK BELLE

J-PARC

KamLand

SuperKamiokandeTohoku U.

Tokyo Metropolitan U.

Major High Energy Activities in JapanTerminated in the JFY2005

K2K Experiment at Kamiokande and KEK

Active ExperimentsBelle Experiment at KEKKamLAND at KamiokaCDF at FermiLab/USA

Under constructionJ-PARC

T2K Experiment at Tokai and KamiokaATLAS and ALICE at LHC

Future PlanSuperB FactoryInternational Linear Collider (ILC)

HEPnet-J: High Energy Physics Network in JapanKEK provides the network facility, NEPnet-J,

on the SINET/SuperSINET (NII) 。


TsukubaTsukuba

Tokai

High Energy Accelerator Research OrganizationHigh Energy Accelerator Research OrganizationHigh Energy Accelerator Research OrganizationHigh Energy Accelerator Research Organization

J-PARCJ-PARC

B-FactoryB-Factory

Photon-FactoryPhoton-Factory

LC-Test FacilityLC-Test FacilityNarita Airport


KEKB e+ e- ColliderKEKB e+ e- Collider

e+ source

Ares RF cavity

SCC RF(HER)

ARES

(LER)

3.5 GeVe+

8 GeVe-

B0J/KS

B0J/KS

Observation of CPV in the B meson systemObservation of CPV

in the B meson system

Belle Experiment13 countries, 57 institutes, ~400 collaborators


Strategy on GRID deployment

Highest priority is support on Belle and ILCLCG deployment

Help Universities to start overR&D

Preparing for ILCJapan has strong will to host ILC

NAREGIJapanese flagship project on developing a GRID middleware May substitute LCG/gLite in the future

GRID interoperability is the key


LCG at KEK

Computer Systems relatedCentral Information System since Feb. 20. 2006

Central Computer System 　■ GRID System 　■ Mail System, etc.B Factory Computer System since Mar. 23. 2006

CPU : 45,662 SI2K rate ■ Disk : 1 PB ■ Tape : 3.5 PB1st Phase

KEK Grid CA approved by APGRID PMA and has been in operation since Jan. 2006.

The third official Grid CA in JapanNAREGI CA software was modified to use at KEK.KEK employee and their collaborators are eligible for this service.

LCG and SRB for production usage are available on the GIRD Systemnot for public usage, but for supporting projects

WN: 36 nodes x 2 =72 CPUStorage: Disk (2TB) + HPSS(~200TB)Supported VO: Belle, APDG, Atlas_J

in operation since May 20062nd Phase

since Jan. 2007, LCG is going to be deployed in the Belle production.


LCG Sites at KEKLCG Sites at KEK

JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01

since Nov. 2005.since Nov. 2005.Site Role:Site Role:

ExperimentalExperimentalResource and Component:Resource and Component:

SL-3.0.5 w/ gLite-3.0 laterSL-3.0.5 w/ gLite-3.0 laterCPU: 14, Storage: ~1.5TBCPU: 14, Storage: ~1.5TBFTS, FTA, RB, MON, BDII, LFC, CE, SEFTS, FTA, RB, MON, BDII, LFC, CE, SE

Supported VOs:Supported VOs:belle, apdg, g4med, ppj, dteam, ops and ailbelle, apdg, g4med, ppj, dteam, ops and ail

JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02

since early 2006.since early 2006.Site Role:Site Role:

Production Production Resource and Component:Resource and Component:

SL or SLC w/ gLite-3.0 laterSL or SLC w/ gLite-3.0 laterCPU: 48, Storage: ~1TB (w/o HPSS)CPU: 48, Storage: ~1TB (w/o HPSS)Full componentsFull components

Supported VOs:Supported VOs:belle, apdg, g4med, atlasj, ppj, ilc, dteam, ops belle, apdg, g4med, atlasj, ppj, ilc, dteam, ops and ailand ail

88

We depends on services by APROC We depends on services by APROC members in ASGC, Taiwan.members in ASGC, Taiwan.We depends on services by APROC We depends on services by APROC members in ASGC, Taiwan.members in ASGC, Taiwan.


Belle GRID

LCG services are provided by the Central Computer systemOnly storage system is used in B Factory computer system Almost the same size of LHC tier-1 centersCPU’s are served in the future

JP-KEK-CRC-02 is the production site Belle data is exported by SRB-DSI

Very useful to export existing data SRB-SRM is desirable still

iRODs?


LCG at KEK (2)

Data Trans in Belle Grid

CRC-01 CRC-02

HPSSDisk/HSM

AS(Taiwan)

Melbourne

LCG/gLiteLCG/gLite

SRB-DSI

B Factory-system

SRBMCAT

SRB server

File servers

WS

Kracow

CPUs

SRB files Local files

Nagoya

Grid files

Grid-system


B Factory Computer SystemB Factory Computer System

- New B Factory Computer System since March 23. 2006- New B Factory Computer System since March 23. 2006- History of B Factory Computer System- History of B Factory Computer System

Moore’s Law: 1.5y=x2.0　 4y=x~6.3 5y=x~10


Total Number of Jobs at KEK in Total Number of Jobs at KEK in 20062006

1212

JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01 JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02

200200

700700

400400

1,0001,000

1,4001,400

BELLEBELLEBELLEBELLEBELLEBELLEBELLEBELLE


Total CPU Time at KEK in 2006Total CPU Time at KEK in 2006(Normalized by 1kSI2K)(Normalized by 1kSI2K)

1313

JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01 JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02

4,0004,000

3,0003,000

1,000 [hrs kSI2K]1,000 [hrs kSI2K]

12,00012,000

10,00010,000

4,0004,000

BELLEBELLEBELLEBELLEBELLEBELLEBELLEBELLE


JLCG

Sponsored by the s-Science promotion program of National Institute of InformaticsLCG federation among Japanese Universities and KEKNagoya: ATLAS, Belle University of Tohoku :ILC, KamLandUniversity of Tsukuba :ATLAS, ILCKobe University: ATLAS, ILCHiroshima Institute of Tech.: ATLAS, Information science KEK: Belle, ILC, ATLAS…

KEK behaves as GOC


NAREGI at KEK

NAREGINational Research GRID Initiative

What we expect? Better quality Better functionality

Job submissions with NAREGI is almost 3times faster than gLite3 now

Better support

We may substitute LCG/gLite with NAREGI if NAREGI works as advertised GRID interoperability is the key

We are working together with NAREGI for this issue

Support on operation and application adoption is necessary LCG is very excellent in support on deployment and operations


NAREGI at KEK (2)

NAREGI-betatest bed6nodes+3nodes(DG)Installation

Naregi-beta 1.0 : Nov. 2006Information, PSE, WFT, GVS

Naregi-DG : Feb 2007Test by Application

P152 (Heavy ion) experimentData analysisdata processing, then stored the results to SRB through SRB-DSI gate way

Belle event simulation

We found several inconvenient differences between gLite and NAREGI

ask NAREGI group to improve

nrg05

nrg00

nrg03

nrg01

nrg09

nrg02

nrg04

Portal node:

Super Scheduler:SS

Inforamtion Server:IS

Grid VM Sever:GVMGridVM engine node-1

GridVM engine node-2

User Manag. Serv.: VOMS

nrg10

nrg11

Gfarm FS

DG MCS(Metadata)

DG RMS(Resource Manag.)


GRID at KEK

GRID environment at KEK

gLite/CRC-01

gLite/CRC-02

HPSS

gLite/EGEEgLite/EGEE

SRB-DSI

SRBMCAT

SRB server

CPUs

SRB filesLocal files

Grid files

Naregi-kek

2007.2.9


Plan

More production use of LCGBelle

Collaboration with ASGC, National Central Univeristy(Taiwan), U. of Melborne, Krakow and so on

ILC GRIDCollaboration with CC-IN2P3 Start with CALICE

NAREGI-LCG(gLite) interoperability More tests locally and discussion with NAREGI

Seeking a possible scenario to have a tier-1 center in Japan in the future (2012?)Good practice for hosting the tier-0 center of ILC


Collaboration in Asia Pacific

Belle GRID was established by the collaboration of people in Asia PacificASGC. KNU Korea, NCU Taiwan and U. of Melbourn

We depends on efforts of ASGC very much for the operation of LCGWe sent our stuffs to ASGC for their training

We seek further collaboration in this region LCG operationAnyone who has interests in NAREGI deployment? (anybody, not only people in this region)


Summary

KEK Grid CA (member of APGRID PMA)LCG

JP-KEK-CRC-01 and 02Belle Experiment

B Factory Computer SystemSize 　：　 Tier1 level

LCG deploymentshare the simulation data among the collaborating institutionsnear future:

share the experimental data and mutual job submissionJLCG

Tohoku U. / Tsukuba U./ Kobe U./ Hiroshima Tech. / Nagoya U. / KEKNAREGI at KEK

NAREGI-beta Test bedTest by the data analysis programUsage of SRB through SRB-DSIInstallation of NAREGI-DG in progress

From now onTest of NAREGI-DGTest of Interoperability between gLite and NAREGI


Acknowledgements

We thank ASGC for their great support on the LCG/gLite operation A.E. Chen, Hide Nakazawa (NCU Taiwan), Glenn Moloney, Marco La Rosa (U. of Melbourne), Simon Lin and his stuffs at ASGC helped us for Belle GRID. We appreciate very much for them. We thank people in NAREGI for their supports on us

grid deployment status and plan at kek isgc2007 takashi sasaki kek computing research center

Documents

osaka u

kanazawa u

kobe u

rikenokayama u

icrrtpkyokyoto u

shinshu u

tsukuba u

osaka city u