INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.orgwww.glite.org

Information and MonitoringStatus and Plans

Plzeň, 10 July 2006

Steve Fisher/RAL on behalf of JRA1-UK

Steve Fisher/RAL 2

Enabling Grids for E-sciencE

INFSO-RI-508833

R-GMAR-GMA

• R-GMA is now working well – with experienced users

• Released a bad RPM recently– It had passed certification and time on PPS

Shows that JRA1-UK testing is still inadequate Should have failed in certification on one of the tests we gave to

SA3 Should have shown memory leak in fairly short time on PPS

– Had to produce new RPMs with old code– Proper fix now in certification

Has shown up problem with tagging/building

• Used in various applications

Steve Fisher/RAL 3

Enabling Grids for E-sciencE

INFSO-RI-508833

SD Status

• In production

• Developed by Data Management and JRA1-UK within EGEE-I

• Only BDII plug-in currently configured

• Many services not correctly advertising

• Not enough services using the API

Steve Fisher/RAL 4

Enabling Grids for E-sciencE

INFSO-RI-508833

Work-plan

• Two requirements directly related to the JRA1-UK work. – Security:

#101 - make use of VOMS groups and roles

– Information System: #111 - to provide fast and reliable access to service end points.

• Work-plan approved a few weeks ago– Subject to a small change

Steve Fisher/RAL 5

Enabling Grids for E-sciencE

INFSO-RI-508833

R-GMA Plans

• Design has some limitations which are hard to work around.

• Currently working on a new design which includes– Authz– Multiple VDB (name spaces) – Registry and schema replication – Support for Oracle and other RDBMS.– Easy to wrap as web service

Steve Fisher/RAL 6

Enabling Grids for E-sciencE

INFSO-RI-508833

First release of new design

• No new functionality in first release

• Significant changes include:– The registry no longer sends out notifications.

Should increase reliability Registry replication much simpler

– Only one socket for streaming from one machine to another– Regular handling of remote invocation (time-outs etc)– Database independence– Managed tuple stores - essential to support authz– Multiple VDB support but no cross VDB queries

• Compatibility with previous releases– APIs must be able to work with old and new services– Services must be able to interoperate

Steve Fisher/RAL 7

Enabling Grids for E-sciencE

INFSO-RI-508833

Subsequent releases

• Will provide in this sequence:

1. Queries over multiple VDBs– Almost standard SQL

– Extension for Unions

2. Authz by VDB – This will make use of certificate attributes (VOMS groups/roles)– Database engine is used to implement parameterised views

3. Registry replication– Much easier now that registry is passive

4. Schema replication– Still to be designed – may not be easy

5. Oracle support– DB independence part of new design

Steve Fisher/RAL 8

Enabling Grids for E-sciencE

INFSO-RI-508833

Service Discovery (SD) Plans

• We will work on more responsive SD by invoking the plug-ins in parallel.– The fastest plug-in wins

• We are asked to support use of scripts calling utilities which use SD– Should utility do caching or the SD API?

SD solution has to be general so heavier How many utilities to consider?

• “Configuration-free” SD being developed– Useful as a bootstrap mechanism

it can locate the R-GMA server on the local subnet.

Steve Fisher/RAL 9

Enabling Grids for E-sciencE

INFSO-RI-508833

Time scales

• Hard to estimate:– Considerable effort can be "lost" in support. – JRA1-UK has a temporary but critical shortage of manpower.

4 resignations from the team in 3 months Interviewing this week

• We had hoped to achieve by the end of this year:– queries over multiple VDBs and authz (using VOMS attributes)

by VDB– R-GMA clients with the option of automatic configuration– SD caching or persuade utility providers to do it– Parallel invocation of SD plugins

Steve Fisher/RAL 10

Enabling Grids for E-sciencE

INFSO-RI-508833

Mailing lists

• 3 lists:– R-GMA-ANNOUNCE

Low volume for R-GMA announcements to users Moderated Replies go to JRA1-UK list

– JRA1-UK “Public” JRA1-UK list

– R-GMA-SA1 Similar to JRA1-UK but includes SA1 people Created for discussing SA1 applications – e.g. GridView

• To subscribe to any of these lists:– http://www.physics.gla.ac.uk/mailman/listinfo/<list name>

Steve Fisher/RAL 11

Enabling Grids for E-sciencE

INFSO-RI-508833

QAG and Quality

• We have partner metrics to worry about in future– They were missed off the template this Q

• I have produced the JRA1 Q And Measurement Plan– Strongly based on the EGEE-I doc from Alberto di M.

Removed SA3 material Tried to make it realistic

– Contents: Standards

• Programming guidelines• Test guidelines

Processes• Adherence to the EGEE developers guide• Software Quality Reviews• Code reviews and walk-throughs• Documentation reviews• Metric Monitoring

Metrics Tools

Steve Fisher/RAL 12

Enabling Grids for E-sciencE

INFSO-RI-508833

INFOD-WG of OGF (was GGF)

• Base specification – With the GGF editor

Should go to public comment in about a week

– Packaged as an extension to WSN

• Use Case document still needs work to make it match– No intention to publish it however

• 2 Sessions at next GGF– Base spec comments– Next steps

Hope to link it properly to R-GMA

Steve Fisher/RAL 13

Enabling Grids for E-sciencE

INFSO-RI-508833

For more information…

• EGEE Web pages: http://hepunx.rl.ac.uk/egee/jra1-uk/

• E-mail: jra1-uk@physics.gla.ac.uk