observing system monitoring center (osmc)

Observing System Monitoring Observing System Monitoring Center (OSMC)Center (OSMC)

Work in progress in briefWork in progress in brief

June 2005June 2005

Steve Hankin, Kevin O’Brien – Steve Hankin, Kevin O’Brien – PMELPMEL

… … a system view of global ocean a system view of global ocean climate observationsclimate observations

““Big fleas have little fleasBig fleas have little fleas upon their backs to bite upon their backs to bite ‘em.‘em.And those fleas have lesser And those fleas have lesser fleasfleas and so ad infinitum.” and so ad infinitum.”

Leo Brody, Leo Brody, Starting FORTHStarting FORTH(I think)(I think)

The analogy The analogy (lame)(lame)::

When the metadata is the data,When the metadata is the data,even metadata has metadata.even metadata has metadata.

A partnership …A partnership …

• PMELPMELUser interface logic & toolsUser interface logic & tools

• NDBCNDBCMetadata assembly & operationsMetadata assembly & operations

• NGDC NGDC (new partner)(new partner)GIS and DB technical servicesGIS and DB technical services

with assistance fromwith assistance from• JCOMM-OBS (platform metadata)JCOMM-OBS (platform metadata)• US GODAE Server (GTS metadata US GODAE Server (GTS metadata

feed) feed)

Getting a handle on the Getting a handle on the “climate data record”“climate data record”

•Current (meta)data Current (meta)data (“realtime”)(“realtime”)

– GTS -- primary sourceGTS -- primary source

•Historical (meta)dataHistorical (meta)data– poorly integratedpoorly integrated– need “DMAC” style of integrationneed “DMAC” style of integration– (for now … use a GTS archive(for now … use a GTS archive

& acknowledge missing data e.g. research & acknowledge missing data e.g. research

cruisescruises))

OSMC (meta)database at NDBCOSMC (meta)database at NDBC

• Met and Ocean data from GODAE Met and Ocean data from GODAE Server ~350 MB of data per dayServer ~350 MB of data per dayURL=URL=http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Zhttp://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z

• Mooring updates from NDBC-hosted Mooring updates from NDBC-hosted metadatametadata

• Ship call sign info from the WMO Pub Ship call sign info from the WMO Pub 4747

• Float updates from JCOMMOPSFloat updates from JCOMMOPSURL = URL = ftp://ftp://ftp.jcommops.org/Argo/Status/status.txtftp.jcommops.org/Argo/Status/status.txt

• Country information is assigned based Country information is assigned based on WMO allocation tableon WMO allocation tableURL = URL = http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htmhttp://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm

http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z

ftp://ftp.jcommops.org/Argo/Status/status.txt

ftp://ftp.jcommops.org/Argo/Status/status.txt

http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm

OSMC (meta)database at NDBCOSMC (meta)database at NDBC

• Database back to 2004 (for now)Database back to 2004 (for now)• Metadata tracking not easy - about 10% Metadata tracking not easy - about 10% undefinedundefined

Platform TypePlatform Type # # ObservationsObservations

ARGO FLOAT 5,4326

CMAN 794,262

DRIFTING BUOY

4,447,127

MOORED BUOY

2,066,686

SHIP 682,757

NOT DEFINED 934,451

Platform_ID Last_Report Type Description Organization URL Country XML

OSMC_Platform

ID Name Abbrev

OCMC_Country

ID Name Country URL Contact_Name Contact_Email

OSMC_Organization

Platform_ID Ob_Date Latitude Longitude SLP SST ATMP DEWPOINT WINDSPD WINDDIR CLOUDS XML

OSMC_Observation

OS

MC

Data

base –

En

tity

D

iag

ram

Country is based on ISO 3166, which defines unique 2-character identifiers for each country

Organization identifies an agency, institute, university, or private company that owns or operates a reporting platform

Platform identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data

Observation records the instance of a marine observation for a reporting date and time.

OSMC (meta)databaseOSMC (meta)database

• Derived gridded filesDerived gridded files

Observation metadata are Observation metadata are summarized into 1X1 degree daily summarized into 1X1 degree daily gridded files (netCDF) to support gridded files (netCDF) to support interactive observing evaluation interactive observing evaluation operationsoperations

FunctionalityFunctionalitythat OSMC must that OSMC must provide:provide:

•Overview (where are the obs?)Overview (where are the obs?)

•Drill-down (what are the obs?)Drill-down (what are the obs?)

•Evaluation (are the obs adequate?)Evaluation (are the obs adequate?)

Reports in Time frame

Reports in Time frame

Average of obs

Average of obs

Percentage of Adequate Sampling

Percentage of Adequate Sampling

countrycountry

platformplatform

Parametervalue

Parametervalue

Time sinceLast report

Time sinceLast report

STD deviationfrom

Climatology (future)

STD deviationfrom

Climatology (future)

Observing System Monitoring Center

DOMAIN

Selectglobal, oneocean, orpoint and

drag aregion.

PLATFORMS

Select oneor a set

ALL

SHIPS OFOPPORTUNITY

TROPICALMOORINGS

DRIFTERS

TIDE GAUGES

ARGO

REFERENCESTATIONS

COASTALMOORINGS

GLOBAL

ATLANTICOCEAN

PARAMETERS

Select oneor a set

SST

SEA SURFACEPRESSURE

SEA SURFACEWIND

UPPER OCEANTEMPERATURE

SURFACECURRENTS

SUBSURFACECURRENTS

SEA LEVEL

PRECIPITATION

RADIATION

AIRTEMPERATURE

PCO2

OCEAN CARBON

TOTAL DEPTHTEMPERATURE

SEA SURFACESALINITY

SALINITY ATDEPTH

SAVE

PRINT

BASE MAPMenu bar across top.

Color/symbol key acrossbottom.

UTC clock at upper right.

Any screen orwindow.

PACIFIC OCEAN

INDIAN OCEAN

SELECT AREGION

High-to-low(hot-to-cool)color scale.

CLOCK

UTC

DATA POINTSIf IPRC, filled circle. Ifnot, open circle from

Monterey. If not, crossfrom telemetry.

RESEARCHVESSELS

TRANSPORTARRAYS

UTILITIES

LOCAL TIME INSELECT CITIES

BASE MAPAPPEARANCE

DATA POINTAPPEARANCE

TEXT

DRAW

Zoom

Web toMonterey,

IPRC

Hard Wire toTelemetry

Time FrameTime Frame

Select OneSelect One

ArbitraryRange

ArbitraryRangeConvenience

choices

Convenience choices

TodayToday

yesterdayyesterday

2 days ago2 days ago

This weekThis week

Last weekLast week

This quarterThis quarter

Last quarterLast quarter

othersothers

Data SourceData Source

Select one orboth

Select one orboth

IndividualObs

IndividualObs

Gridded Field

Gridded Field

Color byColor by

otherother

Select OneSelect One Select OneSelect One

1x1 degree1x1 degree




Levitusvariability

(via NVODS)

Levitusvariability

(via NVODS)

Levitus meanValue

(via NVODS)

Levitus meanValue

(via NVODS)

1Major ocean Basins

(N. Atlantic, Trop.

Atlantic,etc.)

1Major ocean Basins

(N. Atlantic, Trop.

Atlantic,etc.)

1Whole globe

1Whole globe

Drill DownDrill Down

Grid cell

Grid cell

Single Observation

Single Observation

Select oneSelect one


Metadata report

Metadata report

Instrument history

Trace map

Instrument history

Trace map

InstrumentMeasurementTime series

InstrumentMeasurementTime series

Plot of profileValues (future)

Plot of profileValues (future)


StatisticsSummary of Obs in grid

Cell

StatisticsSummary of Obs in grid

Cell

Clickable listOf

Individual Reports

Clickable listOf

Individual Reports

1.Gridded fields shown with graticuleoverlay. Click on grid cells for drill down

KEY: Blue = Completed Red = FY05 Work Green = System Navigation Note: Data accumulation will occur over time. Currently the database has data

from 1 June 2004, however, it will be back filled to 1 January 2004

User interface & User interface & tools for tools for

evaluationevaluation

Web-accessible to the Web-accessible to the communitycommunity

Visualization & evaluationVisualization & evaluationOverview (tour)Overview (tour)

all platforms reporting today

Visualization & evaluationVisualization & evaluationOverviewOverview

all platforms reporting air temp. today

all platforms reporting SST today


all platforms reporting SST today colored by age


Drifters reporting SST today


U.S. drifters reporting SST today


U.S. drifters reporting SST this week


U.S. Pacific drifters reporting SST this week


U.S. Pacific drifters reporting SST this month

User interface & tools for User interface & tools for evaluationevaluation


Drill-downDrill-down (what are the obs?) (what are the obs?)

•Evaluation (are the obs adequate?)Evaluation (are the obs adequate?)

mouse click for metadata summary

Visualization & evaluationVisualization & evaluationDrill DownDrill Down

mouse click to view data


mouse click to view plot


User interface & tools for User interface & tools for evaluationevaluation


•Drill-down (what are the obs?)Drill-down (what are the obs?)

EvaluationEvaluation (are the obs adequate?) (are the obs adequate?)

Number of platforms per 1x1 degree box reporting SST today

Visualization & evaluationVisualization & evaluation

Number of platforms per 1x1 degree box reporting SST this week


Number of platforms per 1x1 degree box reporting SST this month


Number of platforms per 5x5 degree box reporting SST this month


5x5 degree boxes this month that had one or more SST obs every day


Percentage of days when a 5x5 degree box had at least 5 SST obs


Click for time series record of SST obs in a single 5x5 grid cell


Click for time series record of SST obs in of an ocean basin


Click for global time series of SST obs


OSMC LAS

The OSMC doesn’t look like a Live Access Server …

(Shown is the more traditional LAS user interface)

Ready for integration into NVODS, DMAC, IOOS and GOOS

Next stepsNext steps

• Wire it together robustlyWire it together robustly(It is not as mature as it appears)(It is not as mature as it appears)

• Tune for performanceTune for performance(caching schemes)(caching schemes)

• Bring NGDC GIS and RDBMS Bring NGDC GIS and RDBMS expertise into the partnershipexpertise into the partnership

Suggestions? Questions?Suggestions? Questions?

observing system monitoring center (osmc)

Documents