Fotis KarayannisFotis KarayannisHellasGrid Scientific CoordinatorHellasGrid Scientific Coordinator

GRNETGRNET

HellasGrid – The National Grid Initiative in

Greecewww.hellasgrid.gr

EGI SEE Workshop Athens, 19 April 20062

OutlineOutline

GRNET dual mission: Research Networking and Grid infrastructure

The HellasGrid National Grid initiative Infrastructure Organisation Applications communities

HellasGrid as part of the European efforts Networking and Grid projects

Challenges/Experiences

EGI SEE Workshop Athens, 19 April 20063

GRNET Dual MissionGRNET Dual Mission The EU e-Infrastructure vision: Integrated Networking + Grid

infrastructures

GRNET was one of the first NRENs* in Europe adopting the EU e-Infrastructure initiative: Providing both networking and grid infrastructures * NREN: National Research and Education Network

Being infrastructure-oriented and application-neutral serving all user eScience communities

Expanding its scope to e-Business and e-Government

GÉANT+SEEREN+other

EGEE+ SEE-GRID +other

Pan-European e-Infrastructure

Source: European Commission

Unit F3: Research Infrastructures

EGI SEE Workshop Athens, 19 April 20064

GRNET strategic projects and GRNET strategic projects and fundingfunding Research Network projects

GRNET2 project, 2000-2005, 20 MEuro• 2,5 Gbps leased lambda backbone

network• Pilot dark fiber acquisition projects (15

years lease) + optical equipment• Pilot Grid node @ Demokritos (Isabella)

Access project (called “105”), 2005-2008, 10 MEuro

• 1 Gigabit Access for ~50 institutes GRNET3 project, 2005-2008, 30 MEuro

(recently approved!)• Dark fiber research back-bone network

in Greece• Optical MANs for Athens, Thessaloniki

(the rest to be covered by regional MANs (called “93”)

• Optical equipment RFI already published

PanEuropean connectivity & integration project: GEANT2, 2004-2008

Regional Support Projects: SEEREN-SEEREN2, Eumedconnect

Grid projects Hellasgrid Task Force, 2002-2004,

(support money)• Hellasgrid Strategy Document• Pilot Grid node @ Demokritos (0,5M by

GRNET2) Hellasgrid Project, 2004-2007, ~2

MEuro

• ~800 CPUs, ~ 90TB storage (30TB disks + 60 TB tape libraries), 4 advanced video-

conferencing Access Grid nodes Grid Applications Call, 2006-

2007,~0,5M PanEuropean integration projects:

EGEE Project, 2004-2006, 1,3MEuros EGEE-II, 2006-2008, 1,8M Euros

• Supported operations, training, policies

Regional Support projects: SEEGRID, SEEGRID2, Eumedgrid, EuChinaGrid

Other projects: GridCC, e-IRGSP

EGI SEE Workshop Athens, 19 April 20065

The GRNET NetworkThe GRNET Network

932 km of dark fibre932 km of dark fibre

Backbone is currently based on 2,5 Gbps leased lambdas Dark fiber has been acquired for 3 network spans (pilot phase) Dark fiber tender for the whole backbone on-going (one offer received) International connectivity 2 * 10 Gbps any day (currently 2* 2,5 Gbps)

EGI SEE Workshop Athens, 19 April 20066

The HellasGrid National Grid The HellasGrid National Grid InitiativeInitiative

HellasGrid Task Force appointed by the Ministry of Economy and Finance at the end of 2002 (MNEC is running the national InfoSoc programme) A strategy group supported by a scientific committee

• Produced a strategy document The Task Force prepared the National Integration Proposal The HellasGrid MoU was signed at the end of 2003

Pilot Phase (Phase I): 2003-2004 GRNET Pilot Infrastructure installation

• Isabella site: 64 CPUs, 10 TB SAN, 12 TB Tape Library Participation in EGEE proposal, Coordination of SEE-GRID

Consolidation Phase (Phase II): 2004-2006 HellasGrid project implementation

• Extension of Grid infrastructure (~800 CPUs, 30TB disks, 60TB tape libraries) – (~2 MEuros)

• Integration in EGEE• The HellasGrid MoU was used to form a Joint Research Unit (JRU)• GRNET provided a recognition letter by the Ministry after EC request• Further application support (~0,5M – 1M Euros)• Investigation for further infrastructure support (~1 MEuros)

EGI SEE Workshop Athens, 19 April 20067

The HellasGrid membersThe HellasGrid members Coordinator

National Research and Education Network, GRNET –www.grnet.gr Universities (10)

Aristotle University of Thessaloniki, AUTH www.auth.gr Athens University of Business, AUEB www.aueb.gr National Technical University of Athens, NTUA www.ntua.gr University of the Aegean www.aegean.gr University of Athens, UoA www.uoa.gr University of Crete, UoC www.uoc.gr University of Ioannina, UoI www.uoi.gr University of Macedonia, UoM www.uom.gr University of Patras UPATRAS www.upatras.gr University of Pireus UNIPI www.unipi.gr

Research Centres (8) Research and Academic Computer Technology Institute, CTI www.cti.gr Centre for Research and Technology Hellas, CERTH www.certh.gr Institute of Computer Science – FORTH, www.ics.forth.gr Institute of Accelerator Systems and Applications, IASA www.iasa.gr Institute of Communication and Computer Systems, ICCS

www.iccs.ece.ntua.gr National Meteorology Service, EMYwww.emy.gr National Observatory of Athens, NOA www.noa.gr Research Centre Demokritos, DEMOKRITOS www.demokritos.gr

EGI SEE Workshop Athens, 19 April 20068

HELLASGRID HELLASGRID infrastructureinfrastructure

• HG-01 cluster @ Demokritos: 64 CPU, 10TB FC SAN, 12TB Tape Library, EGEE LCG2 middleware

• HG02-HG06 clusters located in:

•Athens (NDC/EKT, IASA)•Thessaloniki (AUTH)•Crete (ICS-FORTH)•Patras (CTI)

~800 CPUs (x86_64, 2 GB RAM,

80GB HDD, 2x Gbit) ~30 TBytes total raw SAN storage capacity~80TBytes Tape Library

• 4 Access Grid nodes

Leased lambda 2,5 Gbps PoS

Athens MAN (2,5 Gbps PoS)

Dark Fibre (not yet lit)

Patra

Larissa

Heraclion

Syros

Athens

Chania

Rethymnon

Xanthi

Thessaloniki

Ioannina

Leased lambda 1,25 Gbps Gigabit Ethernet

HG-06-AUTH

HG-04-IASA

HG-05-NDC

HG-03- CTI-CEID

HG-01-GRNET Isabella @ Demokritos

HG-02- ICS-FORTH

Hellasgrid Grid Node

http://www.hellasgrid.gr/infrastructure

EGI SEE Workshop Athens, 19 April 20069

HG organisation: Teamwork!HG organisation: Teamwork!

Overall coordination: GRNET headquarters Cooperation with HellaGrid partners:

Main site + ROC operator : HG-01-GRNET (Isabella, cslab@ICCS/NTUA)

HG-02…HG-06 sites + operation centers (NDC, IASA, AUTH, FORTH, CTI)

5 smaller private sites (AUTH, UoM, FORTH, Demokritos, HEP-NTUA)

HG CA and VOMS (GridAUTH, Dept. of Physics, AUTH) HG helpdesk (CTI) Regional monitoring tools (ICS-FORTH) HG user support/apps (Demokritos + all site teams) 4 AccessGRID sites

HG membership: ~18 members (10 Universities + 8 Research Institutes)

6 HellasGrid+5 private sites > 900 CPUs in total

EGI SEE Workshop Athens, 19 April 200610

HG-01-GRNET HG-01-GRNET IsabellaIsabella

EGI SEE Workshop Athens, 19 April 200611

HellasGrid Infrastructure, Phase II, EKT HellasGrid Infrastructure, Phase II, EKT (2/2006)(2/2006)

National Documentation Center (EKT)

EGI SEE Workshop Athens, 19 April 200612

HG Local Users distribution per HG Local Users distribution per DisciplineDiscipline

EGI SEE Workshop Athens, 19 April 200613

CPU Hours per SiteCPU Hours per Site

EGI SEE Workshop Athens, 19 April 200614

HellasGrid CA statistics:HellasGrid CA statistics:HellasGrid CA statistics:HellasGrid CA statistics:

EGI SEE Workshop Athens, 19 April 200615

CPU time: distribution of overall EGEE CPU time: distribution of overall EGEE VOs usage of HG infrastructureVOs usage of HG infrastructure

Normalised CPU Time

28%

10%12%

40%

8% 2% atlas

biomed

cms

lhcb

see

others

EGI SEE Workshop Athens, 19 April 200616

HellasGrid as part of European HellasGrid as part of European effortsefforts

Leased lambda 2,5 Gbps PoS

Athens MAN (2,5 Gbps PoS)

Dark Fibre (not yet lit)

Patra

Larissa

Heraclion

Syros

Athens

Chania

Rethymnon

Xanthi

Thessaloniki

Ioannina

Leased lambda 1,25 Gbps Gigabit Ethernet

HG-03-AUTH

HG-02-IASA

HG-06-EKT

HG-04-CTI-CEID

HG-01-GRNETIsabella @Demokritos

HG-05-ICS-FORTH

Hellasgrid Grid Node(1 Gbps uplink)

Scale> 170 sites in 39 countries> 17 000 CPUs> 5 PB storage> 10 000 concurrent jobs per day> 60 Virtual Organisations

EGI SEE Workshop Athens, 19 April 200617

SEE Europe promoting the NGI/EGI SEE Europe promoting the NGI/EGI modelmodel

NGI: National Grid Initiative Infrastructure oriented & application

neutral• Not driven by applications

GRNET acts as an early champion for the SEE area One partner per country since EGEE

Phase I! EGEE-SEE and SEE-GRID countries

adopted the same model!

EGI SEE Workshop Athens, 19 April 200618

Challenges/Experiences/Challenges/Experiences/ConclusionsConclusions

Building the HG infrastructure proved difficult Housing, SLAs with local institutes are slow, tedious and expensive!

Getting applications /users to exploit the infrastructure is slow! Training/education and dissemination is important Application projects and funding are essential!

• Received 45 proposals in last Grid-Applications call! Sustainability of the infrastructure and services

Equipment will need to be changed after 3-5 years Local “incubators” for GRID technology needed:

Experts in local sites Operators should have appropriate mentality (shifts, support)

Gained a lot from networking experience (NOCs, NOC-ROC cooperation)

Regional, Pan-European and International collaborations are vital Our European friends lead the way: Middleware, VOs, support projects

EGI SEE Workshop Athens, 19 April 200619

www.hellasgrid.gr

www.egee-see.orgmailto:fkara@grnet.gr

For more: