grid is a bazaar of resource providers and virtual organizations

10
EGEE-II INFSO-RI- 031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and Virtual Organizations Tomasz Szepieniec, Anna Pagacz ACC CYFRONET AGH Cracow Grid Workshop, Cracow, 16th October 2007

Upload: neil-solomon

Post on 30-Dec-2015

28 views

Category:

Documents


1 download

DESCRIPTION

Tomasz Szepieniec, Anna Pagacz ACC CYFRONET AGH Cracow Grid Workshop, Cracow , 16th October 2007. Grid is a Bazaar of Resource Providers and Virtual Organizations. Grid is a Bazaar. - PowerPoint PPT Presentation

TRANSCRIPT

EGEE-II INFSO-RI-031688

Enabling Grids for E-sciencE

www.eu-egee.org

EGEE and gLite are registered trademarks

Grid is a Bazaarof Resource Providers and Virtual Organizations

Tomasz Szepieniec, Anna Pagacz ACC CYFRONET AGH

Cracow Grid Workshop,

Cracow, 16th October 2007

[email protected] - Grid is a Bazaar.. - CGW07 2

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Grid is a Bazaar• Grid Checklist by Ian Foster: A Grid is a system that: coordinates

resources that are not subject to centralized control [..]• Definition of grid by Vaidy Sunderam: A paradigm/infrastructure

that enables the sharing, selection, & aggregation of geographically distributed resources (multiple administrative domains) [..]

• Policy to provide support require links between PEOPLE!– We cannot avoid this!

• Consider existing numbers in EGEE:– ~200 Sites– ~100 active VOs

• The process of finding suitable resources, negotiating support on sites, configuring support VO on sites, validating the configuration,…… require even more complicated interaction than bazaar

[email protected] - Grid is a Bazaar.. - CGW07 3

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Motivation – mechanism that make RP

interested to provide resources

Communication – well defined robust procedures

User / VO

ManagerResource

Provider

[email protected] - Grid is a Bazaar.. - CGW07 4

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

How this works in EGEE?

From EGEEII periodic report (SA1 part):

„VO must get access to resources […]. Until now this allocation of resources to

new VO is not working very well. For the smaller VOs, it is very difficult to

negotiate with the resource centres separately”

Once a VO registration has been approved by the

OAG, the ROC managers as representatives of

the RCs in their federation, will find a RC willing

to host the VO's VOMS server and authorise

the VO on a very restricted set of resources. [..].

The OAG will work with you in parallel to arrange

more permanent resources [..]

To obtain more

resources, the VO

manager will have to

interact with the OAG

and the ROCs.

From EGEEII Review Presentation

Erwin Laure - Major Issues:

- Allocation of resources, in

particular to new VOs.

[email protected] - Grid is a Bazaar.. - CGW07 5

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Typical Scenarios

• Consider the following scenarios:

1. VO already supported by sites needs more computing power for 1

month starting from next week

2. VO needs increase storage/CPU ratio, so they want to negotiate this

with 20 sites and track the process of enabling this

3. RC needs resources for new VO and wants to cut (re-negotiate)

resources for already supported VOs.

• In each case we have negotiations, agreement, re-configuration

and approval

• We need efficient procedure in each case!

[email protected] - Grid is a Bazaar.. - CGW07 6

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Process Definition Based on Direct Communication

• VO opens a call (project) for

resources and publish

it to RCs

• RC Manager can answer to call

by proposing a contract

• Contract is a negotiated

aggrement between single RC

and VO

• Changing contract state requires

both VO and RC acceptance

[email protected] - Grid is a Bazaar.. - CGW07 7

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Need of a Collaboration Tool

• Many contracts per each VO and RC that would change

over time

-> we need some tool to manage complexity

• Requirements for Bazaar tool:

– Support for communication including negotiations

– Clear view on VO and RC policy

– Tracking of executing a contracts and projects

– Possibility to provide feedback about sites and VO

– Possibility of integration with grid accounting tool

– Easy to use

[email protected] - Grid is a Bazaar.. - CGW07 8

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Negotiations in Bazaar Portal

• Both parties could

propose changes to

the 'contract'

• In this case other

party is notified and

can accept/reject or

continue negotiation

of each contract item

• Number of rounds is

not limited

[email protected] - Grid is a Bazaar.. - CGW07 9

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Status of Bazaar implementation

• Bazaar v.1.0 is expected to be released until end of 2007,

including:

– Project and contract management

– Tracking of negotiation process

– E-mail Notification for VO and RC managers

– View on policies

– Feedback about contract configuration execution

• Deployment:

– Bazaar is being integrated with EGEE CIC Portal and EGEE GOC DB for proper

role assignment (according certificates)

– It is agreed to use Bazaar in Central European region

– There are plans to introduce Bazaar to PL-Grid

[email protected] - Grid is a Bazaar.. - CGW07 10

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Summary

• Real grids require

efficient collaboration

between VO and RC

• We defined the process

of resources allocation

• We developed the Bazaar

Portal that implement the

process

http://grid.cyfronet.pl/bazaar