odv for data products

17
ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany

Upload: shika

Post on 24-Feb-2016

48 views

Category:

Documents


0 download

DESCRIPTION

ODV for Data Products. Reiner Schlitzer , Alfred Wegener Institute, Bremerhaven , Germany. Providing data QC as well as outlier flagging and filtering . Providing data file aggregation and production of large integrated datasets . - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: ODV  for  Data Products

ODV for Data ProductsReiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany

Page 2: ODV  for  Data Products

1. Providing data QC as well as outlier flagging and filtering.

2. Providing data file aggregation and production of large integrated datasets.

3. Providing production of time-series plots, maps, sections and animated 3D plots.

Page 3: ODV  for  Data Products

Visual Quality Control

• easy spotting and identification of outliers or offsets• painless editing of data value and quality flag• logging of all value or flag modifications

Page 4: ODV  for  Data Products

Automatic Range Checks

• full sample set •sample sub-set

Page 5: ODV  for  Data Products

QF Mass Assignments

•all samples of many or all stations (initialization)•all samples in a window•all or some selected samples of current station•current sample only

Page 6: ODV  for  Data Products

Using Quality Flag Filters

Before filtering After filtering

Page 7: ODV  for  Data Products

File Aggregation

Multi-file import (analysis and aggregation phases).

Page 8: ODV  for  Data Products

•Use //SDN_parameter_mapping section

•Determine type of data (profile, time-series, trajectory).

//SDN_parameter_mapping//<subject>SDN:LOCAL:PRESSURE</subject><object>SDN:P011::PRESPS01</object><units>SDN:P061::UPDB</units>//<subject>SDN:LOCAL:T90</subject><object>SDN:P011::TEMPS901</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:Salinity</subject><object>SDN:P011::PSALPR02</object><units>SDN:P061::UUUU</units>//<subject>SDN:LOCAL:fluorescence</subject><object>SDN:P011::CPHLPM01</object><units>SDN:P061::UGPL</units>//<subject>SDN:LOCAL:Trans_red_25cm</subject><object>SDN:P011::POPTDR01</object><units>SDN:P061::UPCT</units>//<subject>SDN:LOCAL:POTM</subject><object>SDN:P011::POTMCV01</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:Density</subject><object>SDN:P011::SIGTPR01</object><units>SDN:P061::UKMC</units>

File Analysis

Page 9: ODV  for  Data Products

• ODV collections are created for every data type found.

• Data of a given file are imported into the corresponding ODV collection.

• Process is fully automatic.

• Results in one or more ODV collections containing all data of a given type.

Aggregation

Page 10: ODV  for  Data Products

////SDN_parameter_mapping//<subject>SDN:LOCAL:DEPTH</subject><object>SDN:P011::ADEPZZ01</object><units>SDN:P061::ULAA</units>//<subject>SDN:LOCAL:Temperature</subject><object>SDN:P011::TEMPS901</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:Salinity</subject><object>SDN:P011::ODSDM021</object><units>SDN:P061::UUUU</units>//<subject>SDN:LOCAL:Oxygen</subject><object>SDN:P011::DOXYCZ01</object><units>SDN:P061::KGUM</units>//

////SDN_parameter_mapping//<subject>SDN:LOCAL:DEPH</subject><object>SDN:P011::ADEPZZ01</object><units>SDN:P061::ULAA</units>//<subject>SDN:LOCAL:PRES</subject><object>SDN:P011::PRESPR01</object><units>SDN:P061::UPDB</units>//<subject>SDN:LOCAL:TEMP</subject><object>SDN:P011::TEMPPR01</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:PSAL</subject><object>SDN:P011::PSLTZZ01</object><units>SDN:P061::UUUU</units>//<subject>SDN:LOCAL:DOX1</subject><object>SDN:P011::DOXYZZXX</object><units>SDN:P061::UMLL</units>//<subject>SDN:LOCAL:DOXY</subject><object>SDN:P011::DOXYZZXX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:TUR4</subject><object>SDN:P011::TURBXXXX</object><units>SDN:P061::USTU</units>//<subject>SDN:LOCAL:NTRA</subject><object>SDN:P011::NTRAZZXX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:SLCA</subject><object>SDN:P011::SLCAZZXX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:PHPH</subject><object>SDN:P011::PHXXZZXX</object><units>SDN:P061::UUPH</units>//<subject>SDN:LOCAL:CORG</subject><object>SDN:P011::CORGZZZX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:POCP</subject><object>SDN:P011::MDMAP010</object><units>SDN:P061::UMMC</units>//<subject>SDN:LOCAL:TSMP</subject><object>SDN:P011::TSEDZZZZ</object><units>SDN:P061::UMGL</units>//

Aggregated Variables

Page 11: ODV  for  Data Products

When aggregating SDN files different BODC parameter/unit codes are maintained as separate variables (e.g., 3 oxygen variables).

User may combine separate variables by means of aggregated derived variables (e.g., 1 oxygen variable for scientific usage).

Page 12: ODV  for  Data Products

Aggregated derived variable

Oxygen [ml/l] =1 * (DOX1 DISSOLVED OXYGEN ml/l) + 0

0.02297 * (DOX2 DISSOLVED OXYGEN micromole/kg) + 0 0.02241 * (DOXY DISSOLVED OXYGEN millimole/m3) + 0

Merging Principles:• Merging Type (exclusive use of first available value, average over

all available values)• Order of input variables matters (in case of eclusive merge)• Standard or user-specified conversion formulas • Quality flag inheritence

Page 13: ODV  for  Data Products

CDI catalogue as of July 2012

Page 14: ODV  for  Data Products

Time-series Plots

Page 15: ODV  for  Data Products

Time-series Plots

Page 16: ODV  for  Data Products

Distribution Maps

Sections

Page 17: ODV  for  Data Products

3D Animations