A Super-Regional Modeling Testbed for Improving Forecasts of

Environmental Processes for the U.S. Atlantic and Gulf of Mexico

Coasts

Cyberinfrastructure

The ocean community needs a common cyberinfrastructure to access, analyze and display data from the different models: each model currently has their own standards and toolsets

A Common Cyberinfrastructure for Model Data

Structured Grids Unstructured Grid

5x5

6x3Variety of StretchedVertical Coordinates

• Build a common infrastructure to enable access, analysis and visualization of all coastal ocean model data produced by Federal Backbone & RAs

• Develop skill metrics and assess models in three different regions and dynamical regimes, to ensure a robust and powerful infrastructure

• Identify factors for transition to operations• Build stronger relationships between academia and

operational centers through collaboration

A Testbed Framework for Coastal Ocean Models

Data Interoperability Model

NetCDF Grids

NetCDF Obs

THREDDSTHREDDS

RAMADDA Catalog

Client*

If Point Data, use ERDDAP base URL and allow users to see where points are, download data from all points for a time period, or select from a specific point to get data

Response with Catalog list, including for each dataset•Opendap URL•WMS URL•ERDDAP URL•F-TDS URL•Feature Type (Grid, Points)•Other…..

ERDDAP

OPeNDAP

If GRID Data, use Opendap URL or WMS to get images or time series data, or F-TDS to get regridded data or analysis.

JSON, CSV, XML, or other

PNG, or XML, or NetCDF

REST Request for catalog, can filter by time, geowindow, or parameter

*Web Client, Drupal, Matlab, ArcGIS, other…

Comparing Models with Data in Matlab

Model 1: UMASS-Model 1: UMASS-ECOMECOM

Model 2: UMAINE-Model 2: UMAINE-POMPOM

Data: SST 2008-Sep-08 Data: SST 2008-Sep-08 07:3207:32

Cyberinfrastructure (CI)All Regions – All Teams Extending CI from OGC, Unidata and others (NOAA DMIT, USGS CDI) to support unstructured grids, and add functionality Web Access via OpenDAP w/CF Unidata Common Data Model/NetCDF Java Library APIDistributed search capabilityBrowser based map viewer (WMS)Toolbox for scientific desktop analysisAll components standards-based!

Search services

Mapping services and browse application

Analyze in scientific desktop application

Inundation Extra-tropical – Gulf of MaineTropical – Gulf of Mexico

- 4 models: 3 unstructured grid +1 structured grid- Coupled wave-storm surge-inundation (TWL)- Consistent forcing, validation and skill assessment using existing IMEDS tool -Extensive observational data sets for historical storms Ike, Rita and Gustav in standard formats-SURA has provided supercomputer resources

Inundation Extra-tropical – Gulf of MaineTropical – Gulf of Mexico

- 4 models: 3 unstructured grid +1 structured grid- Coupled wave-storm surge-inundation (TWL)- Consistent forcing, validation and skill assessment using existing IMEDS tool -Extensive observational data sets for historical storms Ike, Rita and Gustav in standard formats-SURA has provided supercomputer resources

Extratropical Grid

Tropical Grids for Galveston Bay

Estuarine Hypoxia Chesapeake Bay

1. Estuary:– 5 Hydrodynamic models– 3 Biological (DO) models– 2004 data from 28 CBP stations– Comparing T, S, max (dS/dz), DO via target diagrams2. Shelf: OBCs 5 hydrodynamic models

Estuarine Hypoxia Chesapeake Bay

1. Estuary:– 5 Hydrodynamic models– 3 Biological (DO) models– 2004 data from 28 CBP stations– Comparing T, S, max (dS/dz), DO via target diagrams2. Shelf: OBCs 5 hydrodynamic models

Models doing better on oxygen than stratification!

Stratification (dS/Dz) Dissolved Oxygen

Shelf Hypoxia Gulf of MexicoHydrodynamic & biogeochemical hindcast comparisons of hypoxia model (stand alone) coupled to 3 different Gulf of Mexico hydrodynamics modelsEvaluation of two shelf hypoxia formulations (NOAA & EPA)

Shelf Hypoxia Gulf of MexicoHydrodynamic & biogeochemical hindcast comparisons of hypoxia model (stand alone) coupled to 3 different Gulf of Mexico hydrodynamics modelsEvaluation of two shelf hypoxia formulations (NOAA & EPA)

IOOS Model Testbed - CI Status

Interactive Web Site Web site where users can browse model results, view model grid data, side by side comparisons, extract time series, browse model and obs catalog, compare model and obs as time series

Unstructured Grid SupportAdding support for unstructured grids in the Java NetCDF libraries

Matlab toolboxMatlab-based toolbox to access the model data via njtoolbox and observation data

IMEDSMatlab-based IMEDS toolbox to do “station” data comparisons for the inundation team.

Observation DataImplement observation data as NetCDF on server connected to TDS and Catalog 

IOOS Model Testbed - CI Status

ERDDAPImplementation of ERDDAP on server for different data delivery options . RamaddaInstall and configure Ramadda for TDS harvesting

F-TDS/LASImplementation of F-TDS and LAS as services on the server for server-side model data regridding, analysis, and visualization.

ncWMSImprovements to ncWMS for time-rounding, vectors. 

Server-side Analysis Server-side analysis is a computation made by an

OPeNDAP server at the request of a client. The specification of the computation is transmitted to the

server via the OPeNDAP URL. The data returned are the results (and only the results)

of the computation The Ferret-THREDDS Data Server (F-TDS) is an

implementation of a general purpose server-side analysis engine which plugs into new or existing TDS installations.

13

F-TDS Capabilities

F-TDS takes advantage of several characteristics of Ferret. New "virtual" data variables can be defined Can build the metadata (netCDF header described by

dimensions, coordinate variables and the structure of data variables) without performing any heavy calculations for both data read from files and “virtual” data variables

Only performs calculations when the data are requested Only calculates the minimal set needed to fulfil the current

request

14

ChesROMS: a practical example We are serving data from Chesapeake Bay

ROMS Community model We’d like images of the water velocity model output. Water velocity is produced in the model as separate

eastward and northward velocities on the U and V elements of a single Arakawa computational grid.

Need to combine the eastward and northward components to produce velocity. But to do this, the values need to be on the same grid.

We do this with an F-TDS script. This produces an OpenDAP accessible URL, which can be operated on in standard tools such as Matlab. The eastward and northward values are translated to a common “rho” grid. 15

ChesROMS Eastward and Northward ComputationalGrids

16Full view and detail of grid: eastward grid in red, northward grid in green. These are the original computation points on which the model outputs data.

The ChesROMS grids including the “RHO” grid

Black diamonds are “Rho” grid points. Eastward points in red, northward points in green. Eastward and northward velocity model output have been translated to the RHO grid by the F/TDS script.

Matlab code to plot the velocity# Get the data from the F/TDS URLurl='http://testbedapps.sura.org/thredds/dodsC/estuarine_hypoxia/

chesroms/vectors.nc';nc=mDataset(url);getVars(nc)# grab the rotated u,v and grid points. The grid# is the same for both UBARROT and VBARROTu=nc{'UBARROT'}(1,:,:);v=nc{'VBARROT'}(1,:,:);g=nc{'VBARROT'}(1,:,:).grid# Convert u and v to a complex for graphingU=complex(u,v);# plot the datafigurepcolorjw(g.lon,g.lat,double(abs(U)));arrows(g.lon,g.lat,U,.05,'black');axeqcolorbar 18

The ChesROMS Water Velocity

19ChessROMS Absolute Water Velocity in Meters/second

ChessROMS Absolute Water Velocity in Meters/second detail with directional vectors

Glider/Model Comparison Script

Glider/Model Comparison Script

Demo

•Interactive Web Site•Matlab•EDC•Managed System using Services

Shelf Hypoxia

• What does SH team need?

Web-site(s), Catalogs, Matlab, Desktop App, Skill Assessment tools, Data Conversion utils?

• Biggest Challenges