The CUAHSI Hydrologic Information System

SupportEAR 0622374

CUAHSI

HISSharing hydrologic data

http://his.cuahsi.org/

Consortium of Universities for the Advancement of Hydrologic Science, Inc.

An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S.

http://www.cuahsi.org/

• 110 US University members

• 6 affiliate members• 12 International

affiliate members (as of March 2009)

HIS Team and Collaborators• University of Texas at Austin – David Maidment (PI), Tim Whiteaker,

Ernest To, Bryan Enslein, Kate Marney• San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine,

Tom Whitenack• Utah State University – David Tarboton, Jeff Horsburgh, Kim

Schreuders, Justin Berger• Drexel University – Michael Piasecki• University of South Carolina – Jon Goodall, Tony Castronova• Idaho State University – Dan Ames, Ted Dunsford, Teva Veluppillai• CUAHSI Program Office – Rick Hooper, David Kirschtel, Conrad

Matiuk, Yoori Choi• WATERS Network – Testbed Data Managers• HIS Standing Committee • USGS – Bob Hirsch, David Briar, Scott McFarlane• NCDC – Rich Baldwin

What is HIS• The CUAHSI Hydrologic Information System

(HIS) provides web services, tools, standards and procedures that enhance access to more and better data for hydrologic analysis.

http://his.cuahsi.org

PrecipitationWater quantity MeteorologyWater quality

Data Searching – What we used to have to do

NWIS

NARR

NAWQANAM-12

request

request

request

request

request

requestrequest

request

request

return

return

return

return

return

returnreturn

return

return

Searching each data source separately

Michael PiaseckiDrexel University

What HIS enablesSearching all data sources

collectively

NWIS

NAWQA

NARR

generic

request

GetValues

GetValues

GetValues

GetValues

GetValues

GetValuesGetValues

GetValues

GetValues ODM

Michael PiaseckiDrexel University

Base StationComputer(s)

Telemetry Network

Sensors

Query, Visualize, and Edit data using ODM Tools

Excel, text

ODMDatabase

ODM Data

Loader

Streaming Data

Loader GetSitesGetSiteInfoGetVariableInfoGetValues

WaterOneFlowWeb Service

WaterML

DiscoveryHydroseek

AccessAnalysis

GISMatlabSplus

RIDL

JavaC++VB

HIS Desktop

HydroExcel

Water Metadata Catalog

Harvester

Service Registry Hydrotagger

HIS Central

CUAHSI Water Data Services System

USGS NWIS

EPA STORET

NCDC Others

Hydroseekhttp://www.hydroseek.org

Supports search by location and type of data across multiple observation networks including NWIS and Storet

Bora Beran, Drexel

Desktop Hydrologic Information System Harvesting and analyzing data from web services

Observations

Models

Climate

GIS

Remote Sensing

Goal for 2009

Direct analysis from your favorite analysis environment. e.g. Excel

Direct analysis from your favorite analysis environment. e.g. Matlab

% create NWIS Class and an instance of the classcreateClassFromWsdl('http://river.sdsc.edu/wateroneflow/NWIS/DailyValues.asmx?WSDL');WS = NWISDailyValues;% GetValues to get the datasiteid='NWIS:02087500';bdate='2002-09-30T00:00:00';edate='2006-10-16T00:00:00';variable='NWIS:00060';valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');

1920 1930 1940 1950 1960 1970 1980 1990 2000 20100

0.5

1

1.5

2

2.5x 10

4

cfs

Daily Discharge NEUSE RIVER NEAR CLAYTON, NC

• Set of query functions • Returns data in WaterML

Slide from David Valentine

WaterML and WaterOneFlowWaterML is an XML language for communicating water dataWaterOneFlow is a set of web services based on WaterML

What are the basic attributes to be associated with each single data value and how can these best be organized?

Streamflow

Flux towerdata

Precipitation& Climate

Groundwaterlevels

Water Quality

Soil moisture

data

Observations Data Model (ODM)• A relational database at the single observation level (atomic model)• Stores observation data made at points• Metadata for unambiguous interpretation• Traceable heritage from raw measurements to usable information• Standard format for data sharing• Cross dimension retrieval and analysis

Space, S

Time, T

Variables, V

s

t

Vi

vi (s,t)“Where”

“What”

“When”

A data value

Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), A Relational Model for Environmental and Water Resources Data, Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392.

CUAHSI Observations Data Model http://his.cuahsi.org/odmdatabases.html

Site Attributes

SiteCode, e.g. NWIS:10109000SiteName, e.g. Logan River Near Logan, UTLatitude, Longitude Geographic coordinates of siteLatLongDatum Spatial reference system of latitude and longitudeElevation_m Elevation of the siteVerticalDatum Datum of the site elevationLocal X, Local Y Local coordinates of siteLocalProjection Spatial reference system of local coordinatesPosAccuracy_m Positional AccuracyState, e.g. UtahCounty, e.g. Cache

Feature

Waterbody

HydroIDHydroCodeFTypeNameAreaSqKmJunctionID

HydroPoint

HydroIDHydroCodeFTypeNameJunctionID

Watershed

HydroIDHydroCodeDrainIDAreaSqKmJunctionIDNextDownID

ComplexEdgeFeature

EdgeType

Flowline

Shoreline

HydroEdge

HydroIDHydroCodeReachCodeNameLengthKmLengthDownFlowDirFTypeEdgeTypeEnabled

SimpleJunctionFeature

1HydroJunction

HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole

*

1

*

HydroNetwork

*

HydroJunction

HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole

HydroJunction

HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole

1

1

CouplingTable

SiteIDHydroID

Sites

SiteIDSiteCode

SiteNameLatitudeLongitude…

Observations Data Model

1

1

OR

Independent of, but can be coupled to Geographic Representation

ODM Arc Hydro or NHD+

Stage and Streamflow Example

Loading data into ODM

• Interactive ODM Data Loader– Loads data from spreadsheets and

comma separated tables in simple format

• Streaming Data Loader (SDL)– Loads data from datalogger files on

a prescribed schedule– Interactive configuration

• SQL Server Integration Services (SSIS)– Microsoft application accompanying

SQL Server useful for programming complex loading or data management functions

ODM Data Loader

SDL

SSIS

Dynamic controlled vocabulary moderation system

Local ODMDatabase

Master ODM Controlled Vocabulary

ODM Website

ODM ControlledVocabulary Moderator

ODM Data Manager

ODMControlled Vocabulary

Web Services

ODM Tools

Local Server

XMLXML

http://his.cuahsi.org/mastercvreg.html From Jeff Horsburgh

• Publishers– Register a data service

• Users– Find a data service

• Supported by– Metadata Catalog

HIS Central

http://hiscentral.cuahsi.org

HydroTaggerOntology: A hierarchy of concepts

Each Variable in your data is connected to a corresponding Concept

National Web Services implemented to date

• NWIS daily value data (e.g., daily average streamflow) • NWIS groundwater data • NWIS real time data • NWIS instantaneous irregular data (field measurements,

water quality) • ORNL Daymet Meteorological model • NCEP North American Mesoscale (NAM) Weather

Research and Forecasting (WRF) model • EPA STORET water quality data• NASA MODIS Atmospheric data derived from remote

sensing

• 11 WATERS Network test bed projects• 16 ODM instances (some test beds have more than one ODM

instance)• Data from 1246 sites, of these, 167 sites are operated by WATERS

investigators

National Hydrologic Information ServerSan Diego Supercomputer Center

HIS Implementation in WATERS Network Information System

Prototype Texas HIS• TWDB is supporting a small project at

University of Texas to start building a prototype Texas Hydrologic Information System

Texas Hydrologic Information Server (at TNRIS)Texas Observations Catalogs and some state water datasets

HIS servers atdata sources

(State agencies,River authorities,

Water Districts, Cities,Counties….)

Web Services

Intermountain Constellation of Experimental WATERsheds (ICEWATER)

The Inland Northwest Research Alliance (INRA) Water Research Consortium is establishing a HIS Network to share experimental

watershed data to address regional water resources

challenges

How CUAHSI works with agencies1. Establish an agreement with the agency2. Identify the scope of the service3. Translate the semantics of the service to WaterML4. Include agency personnel in OGC/WMO Hydrology Domain

Working Group5. Develop a first draft of the web service6. Perform unit testing, over a series of validation cases7. Harvest an observations metadata catalog for agency data8. Develop a procedure for catalog updates9. Document and register the water data service at HISCentral10. Review and test the service together with the agency, for

possible approval as “operational”

Demonstrations

• Hydroseek: http://www.hydroseek.net• Little Bear River: http://littlebearriver.usu.edu/

• HydroExcel

Ideas for SWSI application

• HIS Server display of SWSI– ODM of SWSI

• Input data used to calculate SWSI• Calculated SWSI values

– WaterML based Web Services – Web Map/Feature/Raster geospatial data services– Map based display of SWSI

Ideas for SWSI application

• SWSI viewer as HIS Desktop/Mapwindow plugin– Access SWSI calculation inputs– Access published SWSI values– Access published SWSI maps– Compute and display custom SWSI products

Conclusions• Data Storage in an Observations Data Model

(ODM)• Data Access through internet-based Water Data

Services using a consistent data language, called WaterML

• Data Indexing through a National Water Metadata Catalog

• Data Discovery through federated map and thematic keyword search system

The combination of these capabilities creates a common window on water observations data for the United States unlike any that has existed before.