tools for accessing distributed in-situ data collections donald w. denbo, noaa/pmel-jisao jason e....
TRANSCRIPT
ToolsToolsfor accessing distributed in-situ data collectionsfor accessing distributed in-situ data collections
Donald W. Denbo, NOAA/PMEL-JISAOJason E. Fabritz, NOAA/PMEL-JISAO
Bernard J. Kilonsky, Sea Level Center/ADCP Center, University of Hawaii
John R. Osborne, OceanAtlas SoftwareL. Charles Sun, NOAA/NODC
Willa H. Zhu, NOAA/JISAONancy Soreide, NOAA/PMEL
AMS IIPSAMS IIPSFeb 9-13 2003, Long Beach, CAFeb 9-13 2003, Long Beach, CA
ChallengeChallenge
Locating and selecting individual Locating and selecting individual observations from large, distributed observations from large, distributed collections of collections of in situin situ data data observationsobservations Examples: Individual oceanic or
atmospheric profiles, time series, buoy tracks, etc.
Some solutionsSome solutions
Tools and ApplicationsTools and Applications LDAP Directory Services NdEdit for subsetting large in-situ collections Interactive Java graphics Intensive exploration of multiple data types OPeNDAP (DODS) clients and servers for in-situ data Access from Desktop and Web
Assembled from OpenSource componentsAssembled from OpenSource components http://www.epic.noaa.gov/epic/software/ep_java.htm
LDAP Directory ServiceLDAP Directory ServiceFinding distributed data collectionsFinding distributed data collections
Search on geographic region, observed quantities or Search on geographic region, observed quantities or keywordkeyword Automatically populated from data serversAutomatically populated from data servers Metadata instantly known to LDAP directoriesMetadata instantly known to LDAP directories Access control for experimental data productsAccess control for experimental data products
Open SourceOpen Source Standards-basedStandards-based Platform independent, Platform independent, Scalable, extensible, Scalable, extensible, Supports desktop or web clientSupports desktop or web client
X-Y map view
Y-TY-T time range
NdEdiNdEditt
Investigate space-time distribution
Select data in any View
Explore Data Locations and Subset Data Collections
Interactive, linked windows
View any 2D sliice xy, xt, xz, yt, yz, yt Select
time rangeSee data in range
X-Y map view
Y-TY-T time range
Section Tool - select stations along a depth contour
NdEdiNdEditt
Selected stations are in a narrow time band
NdEdiNdEditt
Polygon tool – select an oblique section line
See time range of stations
NdEdiNdEditt
NdEdiNdEditt
NdEdit is an interactive Java toolNdEdit is an interactive Java tool NdEdit is being re-engineered for the WebNdEdit is being re-engineered for the Web
SGT: SGT: A Scientific Graphics ToolkitA Scientific Graphics Toolkit Java toolkit for scientific graphicsJava toolkit for scientific graphics
On-line documentation, examples, tutorials, streaming On-line documentation, examples, tutorials, streaming videovideo
JavaBeans in next releaseJavaBeans in next release FeaturesFeatures
Contour, line and vector plots, Contour, line and vector plots, Axes user settable or automatically scaledAxes user settable or automatically scaled multiple Time Axis formats multiple Time Axis formats mouse-movable, customizable Labels, line keys, iconsmouse-movable, customizable Labels, line keys, icons Legend generation automaticLegend generation automatic
Widely used, freely availableWidely used, freely available scientific and commercial applications use SGTscientific and commercial applications use SGT 12836 downloads by 4508 unique sites from 66 12836 downloads by 4508 unique sites from 66
countriescountries http://www.epic.noaa.gov/java/sgt/http://www.epic.noaa.gov/java/sgt/
ApplicationsApplications
Java Desktop and Web clientsJava Desktop and Web clients
ncBrowsencBrowseJava tool for data/metadata browseJava tool for data/metadata browse
NetCDF and full OPeNDAP supportNetCDF and full OPeNDAP support Desktop Java application Axis mapping, parametric plots, flexible mapping of
independent variables to axes Line, vector and contour plots Animations, 3D graphics via VisAD
Popular, freely availablePopular, freely available 6471 downloads by 2896 unique sites in 57 countries OPeNDAP (DODS) client, Unidata netCDF client, WOCE
data CD, etc. http://www.epic.noaa.gov/java/ncBrowse/
See: AMS Paper 15.2 – Thursday 4:45pm - Donald DenboSee: AMS Paper 15.2 – Thursday 4:45pm - Donald Denbo
Java OceanAtlasJava OceanAtlasfor browsing ocean datafor browsing ocean data
Intensive Java desktop browsing of ocean dataIntensive Java desktop browsing of ocean data Property-property plots with up to 7 x axes, waterfall diagrams, Property-property plots with up to 7 x axes, waterfall diagrams,
Contour plots/residual contour plots, Map plots with optional Contour plots/residual contour plots, Map plots with optional "bubble" isosurface plots, Linked browsing of all plot types, Built-in "bubble" isosurface plots, Linked browsing of all plot types, Built-in and custom calculations, NdEdit for data location/selectionand custom calculations, NdEdit for data location/selection
Reads WOCE, EPIC, OPeNDAP netCDF data, some ARGO formatsReads WOCE, EPIC, OPeNDAP netCDF data, some ARGO formats Extended for wide range of data typesExtended for wide range of data types
Profile, time series, drifting buoy, gridded analyses, model outputsProfile, time series, drifting buoy, gridded analyses, model outputs Widely used, freely availableWidely used, freely available
http://www.epic.noaa.gov/epic/software/JavaJOA.htmhttp://www.epic.noaa.gov/epic/software/JavaJOA.htm http://odf.ucsd.edu/joa/jsindex.htmlhttp://odf.ucsd.edu/joa/jsindex.html
Climate Data PortalClimate Data PortalDistributed ocean observationsDistributed ocean observations
Major Major in situin situ data data collections:collections: TAO El Nino buoy data
(realtime/PMEL), Global sea level data (realtime/U of Hi), GTSPP (NODC), PMEL hydrographic data and time series collection, WOCE ADCP (U of Hi), IPRC/APDRC in situ data, US Coastal Ocean Time Series database (NODC)
OPeNDAP: in-situ data server and clientOPeNDAP: in-situ data server and client LDAP directory services NdEdit for data selection/subsetting Data Servers, Clients (Java and Web) – focus on in
situ data http://www.epic.noaa.gov/cdp/cdpjava.htm
OceanShareOceanShareNetwork collaboration toolNetwork collaboration tool
Collaboration featuresCollaboration features Local, remote data file access and Java graphicsLocal, remote data file access and Java graphics Standard collaboration tool features (annotation, Standard collaboration tool features (annotation,
whiteboard, etc) whiteboard, etc) Secure LDAP Document RepositorySecure LDAP Document Repository
Proposals, papers in progress, data, imagesProposals, papers in progress, data, images Access control by document or by folderAccess control by document or by folder Accessible from web and desktop Accessible from web and desktop
OPeNDAP compatible soonOPeNDAP compatible soon http://www.epic.noaa.gov/collab/http://www.epic.noaa.gov/collab/
EPIC tools for the Web EPIC tools for the Web for building customized web access to datafor building customized web access to data
EPIC Web ToolkitEPIC Web Toolkit Interface design Backend graphics Map data selector
Example applicationsExample applications EPIC Web Browser (general) TAO (El Nino buoys) Unaami (Arctic time series) OSCAR (Satellite ocean
currents) Multibeam data
(hydrography) http://www.epic.noaa.gov
Tools and Applications Tools and Applications Java desktop and WebJava desktop and Web
Modular Web and Open Source Modular Web and Open Source componentscomponents
Java interactivityJava interactivity Low cost development/maintenance Low cost development/maintenance OpenSource, standards-basedOpenSource, standards-based Scalable, extensibleScalable, extensible OPeNDAP supported or plannedOPeNDAP supported or planned
http://www.epic.noaa.govhttp://www.epic.noaa.gov http://www.epic.noaa.gov/epic/software/http://www.epic.noaa.gov/epic/software/
ep_java.htmep_java.htm