ed armstrong – pi luca cinquini chris mattmann nasa jet propulsion laboratory frank o’brien zach...
TRANSCRIPT
Ed Armstrong – PI
Luca Cinquini
Chris Mattmann
NASA Jet Propulsion Laboratory
Frank O’Brien
Zach Siegrist
System Science Applications, Inc.
18 July 2012
ESIP Summer 2012
Madison, WI
Overview and demo of the Coastal Marine Discovery Service (NASA
ACCESS 2009)
Overview . . . • AKA “Coastal Marine Discovery Service” (CMDS)– 1: a discovery portal for remote coastal datasets
including satellite, in situ, ocean model, GIS layers.• No data stored in CMDS; only harvested metadata and
URLs• http://cmds.jpl.nasa.gov
– 2: a visualization and data interrogation system for datasets in the CMDS repository• “on the fly” visualization and georeferencing• Dataset overlay and download• Client web interface. No software necessary to download.
Overview • CMDS blends proven software technologies of
open source Solr/Lucene database and search interface with OODT and EASy GIS Netviewer from System Science Applications (SSA, see http://runeasy.com)– Discovery through a faceted and free text search
interface– OODT is used extensively (profile servers, profile
handlers) to parse and ingest the remote datasets– OODT harvests Catalog.xml from THREDDS servers
– Visualization and interrogation via EASy Netviewer• Web client• Interacts directly with search results from CMDS (URLs) to
access and download data
CMDS accessible data
• Satellite: Level 2,3 and 4 products for SST, Chl A, Turbidity, Wind, SSH, Salinity•Ocean Models: 3D Salinity, Depth, Temperature and Currents•Currents: Coastal HF Radar•In situ data: Ship, buoy, and glider observations of SST, Wind and Currents•Historical: CalCOFI reports, fish surveys, scientific cruises•GIS coverages and other point data: Bathymetry, marine sanctuary boundaries, socio-economic
Architecture (from proposal)
Metadata harvesting/ingestion pipeline
CMDS web site (public)
CMDS search interfaceFacet/free text driven to over 160 data sets
• To date focused on coastal datasets from CoastWatch, NOAA ERDDAP, NASA PO.DAAC, NOAA NODC, NVODS, US NAVY on THREDDS (OPeNDAP) servers
Interface built on the earth system grid federation software
Visualization and data interrogation – the EASy NetViewer client
• Reads and displays any OPeNDAP URL from CMDS catalog• Data interrogation of pixel values• ROI statistics• GIS like queries (filtering, stats) between multiple layers
• Hardwired shapefile layers• Data export to netCDF3
IntegrationFuture deployment at PO.DAAC “labs” site
Aug 2012:Site for exposure of new tools and servicesBased on user feedback will be elevated to a
standard PO.DAAC service
Acknowledgements
The work described was performed at the Jet Propulsion Laboratory, California Institute of Technology, under contract to the National Aeronautics and Space Administration for ROSES ACCESS 2009.
Current architecture
IssuesLatency to periodically recrawl previously
indexed data repositoriesMany THREDDS repositories have extremely
limited granule metadataFree text search interface suffers
Example of a NVODS dataset with limited metadata