introduction to egee-ii

1

Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).

Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW). Introduction to EGEE-II

Antonio [email protected]

Tutorial Grid Madrid, May 2007RedIRIS/Red.es

(Slices of Bob Jone, Director of EGEE-II Project )

2



The project

• EGEE 1 April 2004 – 31 March 2006 71 partners in 27 countries, federated in regional Grids

• EGEE-II 1 April 2006 – 31 March 2008

91 partners in 32 countries

• Objectives Large-scale, production-quality

grid infrastructure for e-Science Attracting new resources and

users from industry as well asscience

Maintain and further improve“gLite” Grid middleware

3



Applications on EGEE

• Applications from many scientific domains Archaeology Astrophysics Computational Chemistry Digital libraries Earth Sciences Financial Simulation Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences …..

Book of abstracts:http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-005.pdf

4



Support for digital repositories

GÉANT .

INFRASTRUCTURE

GRID .

INFRASTRUCTURE

KNOWLEDGE .

INFRASTRUCTURE

3 layered model to support access to heterogeneousinformation and connect resources throughcommon shared services

Grids can offer:• Sharing of resources

• Secure Access Control

• Data management

• Execution of computationally demanding applications (e.g. multi-media content)

5



EGEE Operations Structure

• Operations Coord. Centre (OCC)

• Regional Operations Centres (ROC) Front-line support for

user and operations issues

Provide local knowledge and adaptations

One in each region – many distributed

Manage daily grid operations – oversight, troubleshooting

“Operator on Duty”

Run infrastructure services

ROCs serving

6



Grid monitoring tools• Tools used by the Grid Operator on Duty team to detect problems

• Distributed responsibility

• CIC portal

single entry point

Integrated view of monitoring tools

• Site Functional Tests (SFT) -> Service Availability Monitoring (SAM)

Need to expand usage in

• GIIS monitor (Gstat)

• GOC certificate lifetime

• GOC job monitor

7



EGEE Related Infrastructures

GIN

8



Grid Interoperability

• We currently see different flavors of Grids deployed worldwide Because of application needs, legacy constraints, funding, etc. Diversity is positive! – Competition to find the best solutions

• Many applications need to operate on more than one Grid infrastructure Pragmatic approach to interoperability is key Applications need interoperable Grid infrastructures now A production infrastructure cannot be an early adopter of quickly

changing standards • Interoperability and standardization pursued at multiple levels

Bilateral efforts (e.g. EGEE and EUChinaGrid, OSG and TeraGrid, EGEE and Naregi) Resulted in the “Grid Interoperability Now (GIN)” effort

combining major worldwide and regional Grid efforts at GGF Grid standardization and best practices at the Global Grid Forum

Now merging with comparable industry efforts – Open Grid Forum

Standardization of basic infrastructure like web services (OASIS)

9



Grid Middleware

• Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware

• Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory

• Foundation Grid Middleware will be deployed on the EGEE infrastructure Must be complete and

robust Should allow

interoperation with other major grid infrastructures

Should not assume the use of Higher-Level Grid Services

Foundation Grid Middleware

Security model and infrastructure

Computing (CE) and Storage Elements (SE)

Accounting

Information and Monitoring

Higher-Level Grid Services

Workload Management

Replica Management

Visualization

Workflow

Grid Economies

...

Applications

10



EGEE Middleware Distribution

gLiteExploit experience and existing components from VDT (Condor, Globus), EDG/LCG, and others

Develop a lightweight stack of generic middleware useful to EGEE applications (HEP and Biomedics are pilot applications).

Pluggable components – cater for different implementationsFollow SOA approach, WS-I compliant where possible

Focus is on re-engineering and hardening

Business friendly open source licensePlan to switch to Apache-2

11



Workload ManagementData Management

SecurityInformation & Monitoring

Access

gLite Grid Middleware Services

API

ComputingElement

WorkloadManagement

MetadataCatalog

StorageElement

DataMovement

File & ReplicaCatalog

Authorization

Authentication

Information &Monitoring

Application

MonitoringAuditing

JobProvenance

PackageManager

CLI

Accounting

Site Proxy

Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf

12



gLite Grid Middleware Services

Overview paper

http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf

13



EGEE and Sustainability

BUT …

• How does EGEE compare to other computing infrastructures? Number of infrastructure users? Number of application domains? Number of computing nodes? Number of years in service?

• What would happen, if EGEE is turned off?

• What happens after April 2008 (End of EGEE-II)?

14



Sustainability: Beyond EGEE-II

• Need to prepare for permanent Grid infrastructure Maintain Europe’s leading position in global science

Grids Ensure a reliable and adaptive support for all sciences Independent of short project cycles Modelled on success of GÉANT

Infrastructure managed in collaboration with national grid initiatives

15



Structure

• Federated model bringing together National Grid Initiatives (NGIs) to build a European organisation (EGI)

• EGEE-II federations wouldevolve into NGIs

• Each NGI is a national body Recognised at the national level Mobilises national funding and resources Contributes and adheres to international standards and

policies Operates the national e-Infrastructure Is application independent, open to new user communities

and resource providers

16



EGEE’06 Conference

• EGEE’06 – Capitalising on e-infrastructures Keynotes on state-of-the-art and real-

world use Dedicated business track exploring Grids’

business potential Demos and business/industry exhibition Involvement of international community

• 25-29 September 2006• Geneva, Switzerland• http://www.eu-egee.org/egee06

17



Summary

• Grids are all about sharing – they are an excellent means of working with groups around the world

• EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research In constant and significant production use EUMedGrid & EUChinaGrid as part of this production infrastructure

• We have gained significant experience in what it takes to deploy, operate and manage a large distributed infrastructure Next steps: Service Availability Monitoring, Service Level

Agreements

• This work has shown the importance of interoperability/interoperations with related projects

• Need to prepare the long-term EGEE, related EU projects, national grid initiatives and user

communities are working to define a model for a sustainable grid infrastructure

introduction to egee-ii

Documents

grid operator

grid madrid

grid interoperabilitywe

grid middlewareapplications

regional grid efforts

grid monitoring toolstools

global grid forumnow

pdfeumed conference