all hands meeting, edinburgh, 8-11 sep 2008 laurent lerusse, esc victoria marshall, cict
DESCRIPTION
From Grenouille to Polar Bears Managing metadata and data capture for the Astra-Gemini 0.5 PW laser. All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT Edwin Divall, CLF. What is STFC? Our Vision of Data Management The Central Laser Facility - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/1.jpg)
From Grenouille toPolar Bears
Managing metadata and data capture for the Astra-Gemini 0.5 PW laser
All Hands Meeting, Edinburgh, 8-11 Sep 2008
Laurent Lerusse, ESC Victoria Marshall, CICT
Edwin Divall, CLF
![Page 2: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/2.jpg)
2
•What is STFC?•Our Vision of Data Management•The Central Laser Facility•CLF Architecture Overview
•Polar Bear System•Elk: the Electronic Log booK
•What’s next?
![Page 3: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/3.jpg)
3
What is STFC?
Science and Technology Facilities Council
•Funds researchers in universities.•Provides scientific and technical expertise.•Provides access to world-class facilities overseas: CERN, ESA,ESO, ESRF, ILL, telescopes in Chile, Hawaii, La Palma and Australia. •Manages world-class facilities in UK: ISIS, the Central Laser Facility, HPCx and the Diamond Light Source.
![Page 4: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/4.jpg)
Proposal
Metadata Catalogue
Information
Experiment
Secure Storage
Data Analysis
Publication
E-PubsProposal System
Data Acquisition
System
Data and Metadata Capture is automated.
Integrated e-Infrastructure
![Page 5: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/5.jpg)
5
Integration via Metadata
Data Store
DataData
Data Store
DataData
Experiment
Experiment
Data
Analysis
Simulation
DataData
![Page 6: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/6.jpg)
6
Central Laser Facility from dual beam Petawatt to commercial size lasers
•Multiple lasers: VULCAN, ASTRA, Laser For Science•New laser: Astra-Gemini - October 2007•Targets area are ‘rebuilt’ with new diagnostics for each experiment.
http://www.clf.rl.ac.uk/
![Page 7: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/7.jpg)
7
Astra-Gemini•Dual beam high intensity pulsed laser •0.5 PW or 15 J in 30 fs•Repetition rate of 3 shots per minute•Adaptive optics for high beam quality
This upgrade represents an improvement of a factor * 10 in intensity* 100 in repetition rate
![Page 8: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/8.jpg)
8
CLF Data Flow
•15 types of data•All interconnected
•At the moment, we are concentrating our effort on the proposals and laser data.
![Page 9: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/9.jpg)
9
Top Level Architecture
DAQ
AutomaticNeXusWriter
PolarBear
Metadata
ELk
Manual
eCAT
VisualisationAnalysis
eCATDB
Latest
CLF SRB
Archive
Laser representation
![Page 10: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/10.jpg)
10
Polar Bear System
Initial aim:
Gather information on the laser components and the data they produce in an XML format which could be integrated with the data.
![Page 11: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/11.jpg)
11
Polar Bear SystemInstruments: •33 different types in 2 categories:
•Catalogueable (identifiable)•Generic
•Need manual input to fill the details• Serial no, focal length, model, etc
•Examples: –Grenouille (From Swamp Optics)–Polarizer (aka Polar Bear)–Telescope
![Page 12: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/12.jpg)
12
Polar Bear SystemXML description of the laser.•Laser defined using:
- Assemblages
- Channels
- DataStreams•Meta-information within the structure:
• Instruments• Shot type• Data collection type• Next component
![Page 13: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/13.jpg)
13
Polar Bear SystemOrthogonal classification/view of the laser: •Three-level hierarchy to locate each Channel:
- By room, - By table,- By the type of data.
•Simpler view for ‘everyday’ use and the user interface. •Includes the Channel and DataStream names.
•The data will contain both structure and description with all the metadata.
![Page 14: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/14.jpg)
14
Electronic Lab booK (ELk)Initial aim: •Ruggedised WiFi PDA.•Allows the operator to log non-automatic information from the laser “shop floor”.•Safety goggles and reduced lighting made the interface challenging! •Uses the PolarBear metadata to present a customised interface for manual readings and incidents.• Integrates seamlessly with the rest of the DAQ system.
![Page 15: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/15.jpg)
15
Electronic Lab booK (ELk)
• Parallel PDA + desktop version, used to:
• Present “Daily instructions” on how to switch the laser on.• Record instrument configuration changes. (eg. Diode blows up.)• Record environmental factors.• Upload pictures, screen dumps and comments from dedicated h/ware.
• Stores the data in a database and uploads XML/NeXus files.
![Page 16: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/16.jpg)
16
What did we learn?•Defining a complex system such as Astra-Gemini in a machine readable format (XML) is not easy. •Filling metadata is hard to set up, but pays dividends later. • “Culture shock” between the laser scientists/operators and the computer scientists. (“You want me to hand-edit XML??”)
•Evolution, not revolution, for a new approach to data management/analysis.
![Page 17: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/17.jpg)
Technical details
• DAQ: LabView and Visual Basic• neXusWriter: C++ and some Python• PolarBear: ASP and JavaScript• ELk: Java, Ajax and JavaScript• eCAT: Java• Data storage: Oracle and SRB
![Page 18: All Hands Meeting, Edinburgh, 8-11 Sep 2008 Laurent Lerusse, ESC Victoria Marshall, CICT](https://reader035.vdocument.in/reader035/viewer/2022062422/56813590550346895d9d0083/html5/thumbnails/18.jpg)
18
What’s next?
• VULCAN the other powerful laser• Target areas
• Need much more flexibility (new experiment every 6 weeks),• User friendliness (users change with each experiment),• Robustness and (lots of new users ),• Direct rewards (benefits for the user must be obvious and direct),• Data Rights.