k. harrison cern, 15th may 2003 ganga: gaudi/athena and grid alliance - development strategy - ganga...
TRANSCRIPT
K. HarrisonCERN, 15th May 2003
GANGA: GAUDI/ATHENA AND GRID ALLIANCE
- Development strategy- Ganga prototype- Release plans- Conclusions
15th May 2003 2
Feedback from March Software Workshop
- Concern expressed at March Software Workshop about number of projects relating to job configuration, submission and/or management: ASK, AtCom, Chimera, DIAL, Ganga, Grappa
- Consensus was that exploring a variety of approaches through the different projects had been a good thing, given uncertainties in how the Grid will develop, but a closer collaboration between projects is needed
- Development of software based on components was encouraged Allow possibility of combining components from different projects to obtain optimal solution
15th May 2003 3
Design and development strategy- Ganga design is based on a set of components that communicate via a software bus Implementation in Python
- Mini-workshop at CERN, 9-12 May, has helped define better how things should work in practice Reviewed status of prototype Discussed functionality required of Python bus Looked at breakdown into components Defined release schedule for rest of the year
- This week, have been talking with people from related projects All agreed in principle to tighter coordination and collaboration, details to be worked out
15th May 2003 4
Ganga prototype
- Code authors: K. Harrison, A. Soroko, C.L. Tan- Guidance and suggestions: N. Brook, R.W.L. Jones, W. Lavrijsen, P. Mato, C.E. Tull- Prototype is mainly for developers, but demonstrates Python as glue: need simplifications to improve usability- Has limitations, but Ganga prototype is already able to submit Atlfast jobs to the LSF batch system on lxplus Submission to EDG resource broker also possible, but need ATLAS software at worker node- Recipe for submitting Atlfast job available: http://ganga.web.cern.ch/ganga/user/recipes/AtlfastRecipe.html- First release for users planned for week of 16-20 June
15th May 2003 8
Atlfast job-options editor (by C.L. Tan)
-Integral part of Ganga, but will function as standalone tool Command-line program with a GUI wrapper- GUI-assisted customisation of job-options files prevents certain errors (mis-spelt options/values, incorrect syntax)- User can define/manipulate sequences and lists- Editor is option-type aware Drop-down menus for discrete choices Arbitrary value entry for simple options Value append for list-type options- Favourite settings can be saved to file for subsequent reloading- User-guide available: http://ganga.web.cern.ch/ganga/user/JOE/JOE-UserGuide.html
15th May 2003 15
Release plans (1)
5-9 May: Ganga release 0.1– Prototype release, mainly for developers– Includes basic GUI, some job-configuration possibilities, job submission to local host or batch system (LSF, PBS, EDG)
12-16 May: ATLAS Software Workshop, CERN- Status and plans
15th May 2003 16
Release plans (2)
16 June 2003: Ganga release 1.0- CLI and Usability improvements
18-20 June 2003: LHCb Software Week- Announce Ganga 1.0 available for use
12-16 July 2003: 7th GridPP collaboration meeting, Oxford, UK- Preliminary user feedback on release 1.0
28 July 2003: Ganga release 1.1- Pure-client submit
15th May 2003 17
Release plans (3)
2-4 September 2003: UK All-Hands Meeting, Nottingham, UK
22-26 September 2003: ATLAS Software Workshop- User feedback on 1.1 29 September: Ganga release 2.0- CLI capture of GUI actions- PyBus and ASK modules- Pre-execute release installation
15th May 2003 18
Pre-execution of release installation
User runningGanga client
Gatekeeper
Worker nodes
Software server
Send script
Send job output
Requestsoftware
Receivesoftware
Submit job
Request software
Receive software
Send job output
15th May 2003 19
Release plans (4)
10 November: Ganga release 3.0- Enhanced monitoring
12-14 November 2003: LHCb Software Week
15-21 November 2003: SuperComputing/Grid 2003, Phoenix, USA- End-to-end troubleshooting demonstration
1-5 December: ATLAS Software Workshop
April-March 2004- ATLAS DC2
15th May 2003 20
Conclusions
- Ganga prototype has been developed
- Prototype includes basic GUI functionality and job-options editor, and allows submission of Atlfast jobs
- Mini-workshop at CERN, 9-12 May, has helped define Ganga roadmap for the rest of the year
- First Ganga release for users planned for week of 16-20 June
- Looking to coordinate and collaborate with ASK, AtCom, Chimera, DIAL and Grappa: aim for full integration of tools