iquod an international quality control effort tim boyer edm workshop september 10, 2014
TRANSCRIPT
2
Anuual mean global energy flow calculated from Mar. 2000 to May 2004. From Trenberth, Fasullo, and Kiehl (2009)
3
Changes in Earth’s Heat Balance Components (1022 J) During 1955-2003 (from Levitus, Antonov and Boyer, 2005, GRL)
83% or 0.75 W/m2
2009 Ocean Heat Content 0-700m Levitus (2012) method
Using ENACT-3 Quality Control
Using WOD Quality Control
Red=heat gain (relative to long-term mean)Blue=heat loss (relative to long-term mean)
7
Argo/GODAEGTSPP
Delayed ModeData
NODCPermanent
Archive[non-uniform
Format]
Near Real-Time Availability
World Ocean DatabaseAdditional QC
Uniform format
BuoysPMEL/JAM
Data quality inform
ation
Not AlwaysPublicly Accessible
NODC Information Stream
Data added to World Ocean Database since WOD13Grey – Argo (184,348 cycles)Green – XBT (25,979 casts)Red – bottle/CTD (106,327casts)Blue - Pinniped (14,421 dives)Turquoise – Glider (42,142 half cycles)Orange – tropical buoys (41,832 daily means)
9
Examples of Delayed-mode data Updates to WOD
World Ocean Database Quarterly
Updates
NOAA
Northeast Fisheries
CCHDO
SECARGO
ICES
CalCOFI
Japan Ocean Data Center
CSIROOil Industry
INIDEP (Argentina)
IMOS gliders
Blue – QuarterlyOrange- YearlyGreen - Irregular
10
Example of already aggregated data passed to WOD
CLIVAR and Carbon Hydrographic Data Office
(CCHDO) GO-SHIP
WOCE
BATS
HOT
CDIAC
CARINA
PACIFICAOceanSITES
Other
CLIVAR
11
NODC Quality Control : Automatic Checks
- reveal systematic errors in incoming data and metadata
- eliminate most non-representative data from consideration
Eliminates ~6% of
temperature data from
Consideration
(>800,000 profiles)
Checks include:
Range check
Spike check
Density inversion
Speed check
Standard deviation
Red – Unflagged Black – Flagged
Inversion and Large Gradient Checks
For Temperature: Inversion ≤ -0.3°C/meter Gradient ≥ 0.7°C/meter
MBT with large inversion
°Celsius
Dep
th (m
eter
s)
Inversions presentIn 276,000 temperatureProfiles (2% of profiles)
Large positive gradientsPresent in 534,000Temperature profiles (4% of profiles)
International Quality Controlled Oceanographic Profile Database (IQuOD)
1. Standardize Automatic Quality Control Internationally
2. Expert manual quality control all profiles which fail automatic checks
3. For temperature (1), salinity (2), oxygen, nutrients
4. Disseminate results to oceanographic/climate community
15
NODCPermanent
Archive
World Ocean DatabaseIQuOD Automatic QC
Uniform format
IQuOD Manual QC Expert Center
IQuOD Information Stream
IQuOD Manual QCOriginal DataIQuOD QC
Other QC project
16
World Ocean DatabaseInternal Storage
INSIDE THE DATA
Original Profile Data
Altered Profile Data
(if necessary)
QC Flags (orig)
QC Flags (WOD)
QC Flags (IQuOD)
QC Flags (2nd)
Generated on the fly
Data Dissemination:Yearly by instrumentGeographically by instrumentWODselectAll updated quarterly
Format:Native WOD format(compact ASCII) with conversionroutines
netCDF -> feeds intoNODC Geoportal/THREDDS server
Working now on subset dissemination through Geoportal
18
World Ocean DatabaseAdditional QC
Uniform format
NODC to Public Information Stream (Profile Data)
NODCPermanent
Archive
Public Access G
eoportal/THRED
DS
WODselect
19
Ideal NODC to Public Information Stream (Profile Data)
NODCPermanent
ArchivePublic Access
Geoportal/TH
REDD
S
WOD
GTSPP
Argo
PMEL buoys
20
Ideal NODC to Public Information Stream (in situ Data)
NODCPermanent
ArchivePublic Access
Geoportal/TH
REDD
S
Coastal Buoy
Profile
Current
Thermosalinograph
Consolidated Granule Level GeoPortal
Best Copy
World Ocean Database
GTSPP
Argo
Individual Accessions
Get Data Information
Get Data
Get Data
Get Data
Information
Information
Information
See all Information
Summary• Uniformity in quality control of temperature data will benefit the
oceanographic/climate community
• IQuOD will establish internationally agreed set of automatic qc checks
• IQuOD will establish groups of experts for manual qc
• The World Ocean Database (WOD) will be the initial data source, aggregator and data disseminator for IQuOD
• The IODE two tiered flagging system will be used by WOD
• The NODC Geoportal will be the preferred means of dissemination for WOD/Aggregation with other data sources through the granule level tools.