k. harrison cern, 22nd september 2004 ganga: ada user interface - ganga release status - job-options...

16
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python client for AMI web service - Conclusions

Upload: bernadette-holmes

Post on 18-Jan-2018

220 views

Category:

Documents


0 download

DESCRIPTION

22nd September Ganga release status (2) - Ganga 2.x is a working system  Used successfully on lxplus to run Artemis jobs (C. Collins-Tooth) - Installation instructions and user guides available from Ganga web site: - Work in progress on ATLAS-specific functionality  Job builder that uses Analysis Job Definition Language (AJDL)  Job submission via AJDL interface  Access to AMI - Aim to have ATLAS features included in Ganga 3.0  Release tentatively pencilled in for mid October, but probably November is more realistic  Release should also include user-friendly Command-Line Interface (J.T.Moscicki)

TRANSCRIPT

Page 1: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

K. HarrisonCERN, 22nd September 2004

GANGA: ADA USER INTERFACE

- Ganga release status- Job-Options Editor- Python support for AJDL- Job Builder- Python client for AMI web service- Conclusions

Page 2: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 2

Ganga release status (1)- Ganga 2.0 released May 2004, and followed by several minor releases Ganga 2.3 released 13th September 2004 Bulk of code written by A.Soroko Ganga releases coordinated by J.T.Moscicki- Have built on basic job-management capabilities of Ganga 1.0 (July 2003) Improved Graphical User Interface (GUI) Command echoing Fully functional Job-Options Editor (JOE) Submission to local batch systems (LSF, PBS) Job catalogue and automatic monitoring Simple installation procedure (for RH7.3)- Some LHCb-specific functionality included for testing Job submission through DIRAC Access to metadata catalogue

Page 3: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 3

Ganga release status (2)- Ganga 2.x is a working system Used successfully on lxplus to run Artemis jobs (C. Collins-Tooth)- Installation instructions and user guides available from Ganga web site: http://ganga.web.cern.ch/ganga/user/v2/QuickStart.html- Work in progress on ATLAS-specific functionality Job builder that uses Analysis Job Definition Language (AJDL) Job submission via AJDL interface Access to AMI- Aim to have ATLAS features included in Ganga 3.0 Release tentatively pencilled in for mid October, but probably November is more realistic Release should also include user-friendly Command-Line Interface (J.T.Moscicki)

Page 4: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 4

Job creation

Page 5: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 5

Job definition

Page 6: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 6

Examination of job output

Page 7: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 7

Job-options editor: main features

- Job-Options Editor (JOE) developed by C.L.Tan- Standalone Qt-based graphical editor, available from Ganga- Presents hierarchical view of available options, and helps user with value entry- Multiple job-options files may be edited simultaneously- Have support for both text and Python job-options files- Included files expanded when changes are saved, so that result is portable

Page 8: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 8

JOE: main window

Page 9: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 9

JOE: option entry

Page 10: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 10

Python support for AJDL - Package dial-python developed to allow use of AJDL from Python Provides bindings for DIAL C++ classes Provides Python modules to simplify use of these classes- First version of dial-python released with DIAL 0.90 (June 2004) Uses PyLCGDict to import DIAL classes Workarounds needed for methods causing problems Issues with printing object information Able to submit job to remote DIAL server and query status- Improved version of dial-python released with DIAL 0.92 (August 2004) Uses PyLCGDict2 to import DIAL classes No methods causing problems Object printing enabled by mapping insertion operator associated with C++ class to __str__ function of Python class (solution suggested by J.Generowicz)

Page 11: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 11

dial-python documentation- Code documentation for dial-python Python modules available at: http://www.usatlas.bnl.gov/~karl/dial-python/

Page 12: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 12

Job builder - Work by C.L.Tan- Prototype GUI has separate panels for defining Application, Task, Dataset, Preferences-Task builder will integrate JOE for configuring Athena applications- Need to understand interaction with task repository- Dataset selection will rely on access to AMI- Need appropriate handlers for connection to Ganga

Page 13: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 13

Prototype GUI for AJDL job builder

Page 14: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 14

Python client for AMI web service- Python client for AMI web service developed by C.L.Tan- Allows use of main AMI methods for querying and updating catalogue- Checks made for mandatory parameters before a command is sent to AMI- XML results returned by AMI are automatically converted to appropriate Python object

Page 15: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 15

Ganga interface to AMI

- Work by C.Collins-Tooth- Simple prototype implementedUse Python client for AMI web serviceSelect project / processing stepBuild querySelect LFNs, which Ganga adds automatically to job script

Page 16: K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python

22nd September 2004 16

Conclusions - Ganga 2.3 has been released and is a working system Installation instructions and user guide available from Ganga web site- Good progress made with Python tools for job definition and submission in ADA dial-python package developed to allow access from Python to functionality of DIAL C++ classes Work started on AJDL job builder Python client for AMI web services has been implemented- Aim to include job submission via AJDL interface in Ganga 3.0 Release tentatively scheduled for mid October