Download - AJDL job and dataset persistency
David Adams
ATLAS
AJDL job and dataset persistency
David AdamsBNL
April 21, 2004
GANGA workshop
AJDL persistency GANGA workshop April 20, 2004 2
David Adams
ATLAS
Contents
AJDL persistency
Job XML
Dataset XML
AJDL persistency GANGA workshop April 20, 2004 3
David Adams
ATLAS
AJDL persistencyAJDL objects are stored in repositories
• XML description indexed by ID
• Unique ID is 2 32-bit ints
May also have metadata in selection catalog• ID plus metadata values
High level service interface for all the above• Usual class (C++, python, …) interface
• May have other implementations– Files, MySQL table, …
Following slides show XML for job and dataset
AJDL persistency GANGA workshop April 20, 2004 4
David Adams
ATLAS
Job XML (existing)Job xml_version = 0.90 fulltype = XyzJob id = 123-456 status = INVALID | FAILED | INITIALIZING | RUNNING | DONE | KILLED create_time = 1000223455 start_time = 1000223456 update_time = 1000223457 stop_time = 1000223457 submit_host = subnode.org run_host = runnode.org job_directory = /home/junk/jobs/123-456 processed_event_count = 10000 processed_result_event_count = 10000 error = 0 Application … Task … XyzInDataset … XyzOutDataset … (optional)
AJDL persistency GANGA workshop April 20, 2004 5
David Adams
ATLAS
Dataset XML (proposed)EventDataset xml_version = 1.10 fulltype = XyzEventDataset id = 123-456 parent = 123-455 is_virtual = false event_count = 2049 EventIdList (optional) EventIdRange run = 123 first = 2401 last = 2468 EventId run = 123 event = 2470 ...
ContentIdList
label = ESD ContentId name = Myclass:mykey ... DatasetIdList (optional) DatasetId id = 123-456 ... LogicalFileList (optional) LogicalFile state = READONLY name = myfile.dat FileCatalog … FileId …