caa inventory plots and graphical products overview
DESCRIPTION
CAA inventory plots and graphical products overview. Delphine Herment (ESTEC) ESAC - 17/03/2011. Pre-generated inventory plots. One plot per instrument Available in 3 resolutions (1 day, 1 month, 1 year) Only displays a sub-set of the experiment datasets (flagged with inventory=1 in the DB) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/1.jpg)
CAA inventory plots and graphical products overview
Delphine Herment (ESTEC)ESAC - 17/03/2011
![Page 2: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/2.jpg)
Pre-generated inventory plots• One plot per instrument• Available in 3 resolutions (1 day, 1 month, 1 year)• Only displays a sub-set of the experiment datasets (flagged with
inventory=1 in the DB)• One line on the plot can be valid for several datasets (for example for
datasets delivered in multiple units)
• A perl script checks the “Inventory table” of the DB to get the list of data/gap interval for the required datasets/time
• It also requests the telemetry mode and event files (CEF datasets) from the DB – they are displayed on the first 2 panels
• It calls IDL to generate the inventory plot• The intervals with data are marked by a vertical blue line, gap by an
horizontal purple line and white means no files delivered for this interval• The CEF products are shown first and then the non-CEF ones
![Page 3: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/3.jpg)
Pre-generated inventory plots
C1_CP_CIS-HIA_HS_MAG_IONS_CS C1_CP_CIS-HIA_HS_MAG_IONS_PEFC1_CP_CIS-HIA_HS_MAG_IONS_PFC1_CP_CIS-HIA_HS_MAG_IONS_PSDC1_CP_CIS-HIA_HS_MAG_IONS_RC
![Page 4: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/4.jpg)
Inventory files
• The inventory files are generated after new files are ingested in the DB and the information they contain is then imported to the DB.
• They are monthly files generated per dataset.• Each records contains 3 fields:
– Time interval– Number of records in this interval (CEF) or number of files in this interval (non-CEF)– Higher file version (-1 = no file ingested)
• For non-CEF files we don’t have any information on the gaps it may contain, just if there is a file covering this interval.
• Example of an inventory file (CEF file):– C1_CP_WHI_NATURAL_2002-11-01.gap
…2002-11-04T11:07:43.152000Z/2002-11-06T18:49:57.560000Z, 88078, 3 => DATA2002-11-06T18:49:57.560000Z/2002-11-06T19:03:32.408000Z, 0, 3 => GAP2002-11-06T19:03:32.408000Z/2002-11-08T23:59:59.999999Z, 83896, 3 => DATA2002-11-08T23:59:59.999999Z/2002-11-09T03:53:57.224000Z, 23036, 2 => DATA2002-11-09T03:53:57.224000Z/2002-11-09T04:07:32.072000Z, 0, -1 => NO FILE DELIVERED…
![Page 5: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/5.jpg)
Panels
![Page 6: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/6.jpg)
Line plot
Spectrogram
On-demand only panel
Panels
![Page 7: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/7.jpg)
Pre-generated panels• A sub-set of the available graphical products is available as pre-generated
panels.• They are generated in 3 resolutions (1 day, 6 hours, 1 hour) and 2 formats
(PS, PNG).• They are not downloadable from the GUI or command line as they don’t
include any time information.• When a list of pre-generated panels is requested the individual PNG
panels and the time axis panel are located from the DB and displayed on the screen.
• If the user requests to download the file then the PS panels are merged together with the adequate time axis panel (pre-generated too) into one PS file.
![Page 8: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/8.jpg)
Pre-generated panels
PNG
PS
![Page 9: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/9.jpg)
On-demand panels
• GUI calls a perl script with a list of panels to plot + time interval.• From this list the perl script determines the list of CEF datasets needed
(note that one panel may require several input CEF datasets … eventually from different experiments).
• The perl script queries the DB to get the CEF files corresponding to these dataset(s) and time interval.
• It calls idl to process the CEF data and create the plot(s) as well as the time axis panel.
• It merges the individual PS panels and the axis panel into one PS file (if more than 7 panels are requested then the PS file has multiple pages) and converts the PS file to PNG(s).
• Then the PS file, PNG files and input CEF files are returned to the GUI -> PNG files for display and CEF and PS files for download.
![Page 10: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/10.jpg)
One dataset
Panel
2+ datasets
PS panel PS panel PS panel
PS plot
PNG plot
CAA GUI
Panel Panel
CEF file CEF file CEF file
Time interval
CAA GUI
IDL
perl
axis panel
DB
![Page 11: CAA inventory plots and graphical products overview](https://reader035.vdocument.in/reader035/viewer/2022062721/5681361b550346895d9d9034/html5/thumbnails/11.jpg)
On-demand panels
PEACE + EFW input datasets
Multiple sub-panels
Processed component
One component of a variable
Multiple-lines plot
Multiple STAFF input datasets
2 parameters displayed