polish grid: national grid initiative in poland

Cracow Grid Workshop, October 15-17, 2007

Polis

h

Gri

d

Polish Grid:National Grid Initiative

in Poland

Jacek KitowskiInstitute of Computer Science AGH-UST

ACK CYFRONET AGH

Cracow Grid Workshop, October 15-17, 2007 2

Polis

h

Gri

d

Polish Grid (PL-Grid) Foundations Infrastructure Generic Architecture Grid Structure

PL-Grid Project Aims Workpackages

Sample problemsCollaboration with EGI_DS

Content


Polis

h

Gri

dPL-Grid Initiative Foundations

European e-

Infrastructure

2000 Testbeds 2010 Utility ServiceRoutine Usage

National

International

Evolution of European Grid infrastructure development within the space of years

Response to the needs of Polish scientists and ongoing Grid activities in Poland, other European countries and all over the world

SGI Grid, Progress(Clusterix, National Data Store ...)

Chemomomentum, Virolab, CoreGrid, Gredia, int.eu.grid, Baltic Grid, GridLab,

Porta Optica, RINGRid, Phosphorus, QoSCoSGrid, Intelligrid, K-WfGrid, Unicore...


Polis

h

Gri

dPL-Grid Initial Activities

Creation of Polish Grid (PL-Grid) Consortium

Agreement signed in January 2007

Preparation of PL-Grid Project (2008-2010, 2011-2013)

Consortium made up of five largest Polish supercomputing and networking centres (founders)

GEANT2GEANT2

♦ Academic Computer Center Cyfronet AGH (ACK CYFRONET AGH) – Coordinator ♦ Poznań Supercomputing and Networking Center (PCSS)♦ Wrocław Centre for Networking and Supercomputing (WCSS)♦ Academic Computer Center in Gdańsk (TASK)♦ Interdisciplinary Center for Math. and Computat. Modelling, Warsaw University (ICM)


Polis

h

Gri

dPL-Grid motivation and aims

e-Science approach to research Computer experiments Huge, distributed and diversely structured

data Tools for data accessing, integration and

processing Versality of disciplines:

• physics, astronomy, astrophysics,• chemistry, • biology, bioinformatics,• meteorology, climatology,• medicine,• Earth sciences,• advanced text processing,• processing and management of knowledge,• e-learning.

PL-Grid vision: To enable realization of e-Science model

in various scientific fields through:• Creation of a stable Grid infrastructure fully

compatible and interoperable with European and World Grids thanks to cooperation (EGEE, DEISA, OMII, C-OMEGA, ESFRI),

• Ensuring the operation of this infrastructure in the production mode,

• Enabling the operation of domain Grids, • Using and propagating Grid standards,• Adjusting PL-Grid to user needs,• Integration, testing and installation of software

produced by leading Grid Projects (Polish and international),

• Organization of support for PL-Grid users (training, helpdesk, consultations),

• PL-Grid management.


Polis

h

Gri

dPL-Grid Infrastructure

Assumptions Polish Grid will have a common base

infrastructure – similarly to solutions adopted in other countries

Specialized, domain Grid systems – including services and tools focused on specific types of applications – will be built upon this infrastructure.


Polis

h

Gri

dPL-Grid infrastructure

These domain Grid systems can be further developed and maintained in the framework of separate projects. Such an approach should enable efficient use of available financial resources.

Grid infrastructure (Grid services)PL-Grid

Ap

plic

atio

n

Ap

plic

atio

n

Ap

plic

atio

n

Ap

plic

atio

n

Clusters High Performance Computers Data repositories

National Computer NetworkPIONIER

DomainGrid

Advanced Service Platforms

DomainGrid

DomainGrid

DomainGrid


Polis

h

Gri

dPL-Grid Structure

PL-Grid infrastructure will be a base for specialized, domain Grid systems - including services and tools focused on the specific types of applications

Users

Nationalcomputernetwork

Grid Application

Programming Interface

Virtual organizations andsecurity systems

Basic Grid services

Gridservices

LCG/gLite(EGEE)

UNICORE(DEISA)

OtherGrids

systems

Gridresources

Distributedcomputational

resources

Grid portals, development tools

Distributed data

repositories


Polis

h

Gri

dPL-Grid Structure

PL-Grid software will comprise: user tools (portals, systems for applications

management and monitoring, result visualization and other purposes, compatible with the lower-layer software used in PL-Grid);

software libraries; virtual organization systems: certificates,

accounting, security; data management systems: metadata catalogues,

replica management, file transfer; resource management systems: job management,

applications, grid services and infrastructure monitoring, license management, local resource management.


Polis

h

Gri

d

PLANNING AND DEVELOPMENT

OF INFRASTRUCTURE

P2

CoordinationStructure

Operation RulesDissemination

PROJECT MANAGEMENTP1

SECURITY CENTER

P6

Training

SUPPORT FOR VARIOUSDOMAIN GRIDS

P5P4 GRID SOFTWAREAND USERS

TOOLS DEVELOPMENTEGEE DEISA … .

OPERATIONS CENTERP3

The PL-Grid Project is split into several workpackages

Planned realization of aims: PL-Grid Project


Polis

h

Gri

dPL-Grid Workpackages

Project management (including structure and dissemination) – coordinated by ACK CYFRONET AGH (Kraków),

Planning and development of infrastructure – TASK (Gdańsk),

Operations Center – ACK CYFRONET AGH Grid Software and Users Tools

development – PCSS (Poznań),Support for domain Grids – ICM (Warsaw),Security Center – WCSS (Wrocław)


Polis

h

Gri

dWP3: PL-Grid Operations Center’s

tasks


Polis

h

Gri

dWP4: Grid Software and Users Tools

WP4: development Software repository Framework for application development High-level virtual organizations using

knowledge Resource virtualization for VO Semantic information on experiments Integration of software components VO and resource management Legacy codes adaptation Knowledge supported data access


Polis

h

Gri

dExamples for potential use

HEP – WLCGComputational chemistry –

Gaussian, Turbomole .....(Charmm, Amber, DL_POLY..)

Biology/Pharmacy – proteins ...MeteorologyComplex systems (multiagent

games...)


Polis

h

Gri

dNetworking and computational

infrastructure of Polish Tier2 for WLHG

[email protected]

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

• Gaussian VO created supported by 2 Partners (EGEE activity)

• Accepted by Vendor

• Registration: https://voms.cyf-kr.edu.pl:8443/vo/gaussian/vomrs

GAUSSIAN in Grid

• VO Manager: Mariusz Sterzel (CYFRONET), EGEE II Comput. Chemistry coordinator [email protected]

ACK: Tomasz Szepieniec

[email protected]

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Never Born Protein Folding

ComputingElement

Euchina Virtual Organization (EGEE)

StorageElement

2. Transfer

application

User InterfacePortal

AABTDDSAD

1.Submit

sequence

3. Store protein

4. Visualize

PDB1.32 3.23 3.442.77 4.33 5.661.32 3.23 3.44

Prof. Irena Roterman interest (CM UJ)

also EUChinagrid

ACK: Tomasz Szepieniec


Polis

h

Gri

d

# Processors, Peak Performance (GFlops) and RAM (GB) CYFRONET ICM UW PCSS CI TASK WCSS

proc. Rpeak RAM proc. Rpeak RAM proc. Rpeak RAM proc. Rpeak RAM proc. Rpeak RAM

SMP 204 1080 368 60 664 192 224 845 328 128 768 512 136 780 264

Clusters 650 8399 1729 500 3400 1036 380 3188 1068 288 3226 2304 256 3600 768

Total 854 9479 2097 560 4064 1228 604 4033 1396 416 3994 2816 392 4380 1032

End 2007 152 5666 912 1344 50000 5376 272 13077 2792

Present Partners’ Resources


Polis

h

Gri

dCollaboration with EGI-DS

1. INFRASTRUCTURE-ORIENTED1.1. Release of New Grid Middleware1.2. Adding new NGI/EGI site1.3. Functionality Alert at some NGI site1.4. Resources negotiation for VO

2. APPLICATION-ORIENTED2.1. QoS bandwidth demand2.2. LHC on-line filtering2.3. Commercial application with license server2.4. Parallel application

3. END USER-ORIENTED3.1. Privately funded hardware3.2. Single user with no VO assignment needs to enter the Grid

Active participation in EGI Workshop in Budapest (2.10.07)

Use cases identification


Polis

h

Gri

dConclusions

Initial stage achieved Agreement signed Scientific Council established Management Board

Proposal prepared

polish grid: national grid initiative in poland

Documents