ocean sciences cuahsi-hydrologic information systems cuahsi – consortium of universities for the...

Ocean Sciences

CUAHSI-Hydrologic Information Systems

• CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc

• Formed in 2001 as a legal entity

• 100 member universities (May 2005)

• Program office in Washington (5 staff)

• Rick Hooper is Executive Director

Earth Sciences

AtmosphericSciences

NSF Geosciences Directorate

UCAR

CUAHSI

Unidata

HIS

DataHypotheses

Needs

Tools

Data

Models

Exogenous DataTechnologicalAdvances

CommunitySupport

Multi-DisciplinaryTeams

HydrologicSynthesis

HydrologicObservatories

MeasurementTechnology

HydrologicInformation

Systems

CommunitySupport

AdditionalHypotheses

CUAHSI Hydrologic Information Systems

Project co-PI

Collaborator

CUAHSI Hydrologic Information System

Environmental Cyberinfrastructure

• Part of NSF Cyberinfrastructure program

• CUAHSI Hydrologic Information Systems is one of several pilot projects – CUAHSI, CLEANER, ORION, NEON, GEON, …..

Cyberinfrastructure Components

Workflow Sequencing using ModelBuilder

HIS Goals

• Data Services for Hydrologists – get me the data I want quickly and painlessly

• Support for Observatories – data structure for Digital Watersheds

• Advancement of Hydrologic Science – flux coupler, HydroObjects

• Hydrologic Education – how to get data into the classroom

Digital Watershed

Hydrologic Observation

Data

GeospatialData

Remote SensingData

Weather and ClimateData

(NetCDF)

(GIS)(Relational database

or delimited ascii)

(EOS-HDF)

Digital Watershed

CUAHSI HIS Overview

• HIS User Assessment

• Hydrology Data Portal

• Digital Watershed• Hydrologic Analysis

HIS User Assessment

• First survey done for HIS White Paper (2003)

• HIS Symposium in March – 4 institutional surveys and a survey of participants

• CUAHSI Web Surveyor – developed by David Tarboton and Christina Bandaragoda (75 responses from 38 institutions)

• Summary paper circulated by email yesterday

Please rank these four HIS service categories for helping you.

Conclusion: Data services are the highest priority

Val

ue S

core

(cou

ntin

g 4

for f

irst,

4 fo

r se

cond

, 2 f

or th

ird a

nd 1

for f

ourth

).

% of time spent preparing data

Which operating systems do you use for your research? If you use more than one operating system, select all that apply.

Please indicate one dataset that you believe would most benefit from increased ease of access through a Hydrologic Information System (HIS).

0% 2% 4% 6% 8% 10% 12% 14% 16% 18%

SNOTEL

National Elevation Dataset and derivatives (EDNA)

National Hydrography Dataset

USGS National Geology data

NCDC Pan Evaporation

PRISM Precipitation data

Climate Model Reanalysis data (e.g. NARR)

NCDC Precipitation

Soils Data (STATSGO/SSURGO)

USGS Groundwater levels

National Land Cover dataset (NLCD)

National Water Quality Assessment (NAWQA)

not applicable to my research

NEXRAD Radar Precipitation

Remote Sensing data (e.g. LANDSAT, GOES, AVHRR)

USGS Streamflow

EPA STORET Water Quality

Conclusion: EPA STORET Water Quality, Streamflow and Remote Sensing Data are perceived to be able to benefit from improved access.

I am surprised USGS streamflow is up there. Is this an indication of importance over difficulty?

How we use software (Austin Symposium)

4.0

3.9

3.3

3.2

2.7

2.6

2.5

2.4

2.4

2.3

Excel

ArcGIS/ArcView

FORTRAN

C/C++

J ava

MS Access

Visual Basic

Matlab

SQL/Server

Modflow

1 =Never use 2=do not rely on 5= find indispensable4=Use often3=Use occasionally

Which of the following data analysis difficulties are most important for HIS to address?

Conclusion: High priorities are:- Data formats- Metadata- Irregular time steps

Val

ue S

core

(cou

ntin

g 3

for f

irst,

2 fo

r sec

ond

and

1 fo

r thi

rd).

How we use software (Web Surveyor)

• Programming (85% of respondents): Fortran, C/C++, Visual Basic

• Data Management (93%): Excel, MS Access• GIS (93%): ArcGIS• Mathematics/Statistics (98%): Excel, Matlab,

SAS, variety of other systems• Hydrologic models (80%): Modflow, HEC models• A general, simple, standard, and open interface

that could connect with many systems is the only way to accommodate all these

CUAHSI HIS Overview

• HIS User Assessment

• Hydrology Data Portal

• Digital Watershed• Hydrologic Analysis

Hydrologic Observations Database

• A relational database stored in Access, PostgreSQL, SQL/Server, ….

• Stores observation data made at points

• Access data through web interfaces

• Fill using automated data harvesting

Streamflow

Flux towerdata

Precipitation& Climate

Groundwaterlevels

Water Quality

Soil moisture

data

Hydrologic Observations Data Model

Review conducted by David Tarboton with 22 responses – redesign of this model is now being done

Relationships

ProposedCUAHSI Observations Database Schema(for details see chap 6 at http://www.cuahsi.org/docs/HISStatusSept15.pdf)

Example: Lake Water ChemistryWater Chemistry from a profile in a lake

Data Access and Viewing System in ArcMap

CUAHSI Data Portal

CUAHSI Data Portal

Plot from the Hydrology Data PortalProduced using a CUAHSI Hydrology Web Service: getDailyStreamflowChart

CUAHSI Hydrology Web Services for NWIShttp://water.sdsc.edu/HydrologicTimeSeries/NWIS.asmx

Documentation: getDailyStreamflowCharthttps://webspace.utexas.edu/jgoodall/HydrologicTimeSeriesWebServices.htm

Applications and Services

Web ServicesLibrary

Web application: Data PortalYour application• Excel, ArcGIS, Matlab• Fortran, C/C++, Visual Basic• Hydrologic model• …………….

Your operating system• Windows, Unix, Linux, Mac

Internet

Utah State University Streamflow Analyst

CUAHSI HIS Overview

• HIS User Assessment

• Hydrology Data Portal

• Digital Watershed• Hydrologic Analysis

Digital WatershedHow can hydrologists integrate observed and

modeled data from various sources into a single description of the environment?

Digital WatershedHydrologic Observation

Data

GeospatialData

Remote SensingData

Weather and ClimateData

(NetCDF)

(GIS)(Relational database

or delimited ascii)

(EOS-HDF)

Digital Watershed

A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather

and climate data into a connected database for a hydrologic region

Created first for the Neuse basin

Digital Watershed:An implementation of the CUAHSI Hydrologic Data

Model for a particular region

Neuse Atmospheric Water• Daily precipitation

data from NCDC gages

• Nexrad daily rainfall rasters

• Land surface – atmosphere fluxes from North American Regional Reanalysis of climate

Neuse Surface Water• Streamflow, water quality

hydrologic observational data

• GIS: River network, water bodies, watersheds, monitoring points

• Land cover, soils, • MODIS remote sensing

(Praveen Kumar)

MODIS

Terrain and Land Cover

ArcIMS Web Server displaying data compiled in Neuse HO Planning Study

http://neuse.crwr.utexas.edu/

Neuse Basin: Coastal aquifer system

* From USGS, Water Resources Data Report of North Carolina for WY 2002

Section line

Beaufort Aquifer

Neuse Groundwater

Geovolumes of hydrogeologic unitsfrom US Geological survey (GMS)

Create a 3 dimensional representation

Geovolume

Each cell in the 2D representation is transformed

into a 3D object

Geovolume with model cells

Page 3

Drexel University, College of Engineering

Data Centers

NCDC

USGSNWIS

NCEP

NWS NGDC

Sensor Arrays

Numerical ModelsPrediction

HSPF

Air-Q

MM5

IndividualSamples

METADATA

The Demands

ISO 19103 Units/Conversion

Page 21

Drexel University, College of Engineering

Ontology Examples

Hydrologic Metadata

We currently have

ISO 19108 Temporal Objects

USGS Hydrologic Unit CodeISO 19115 Geospatial

Hydrologic ProcessesSedimentation

ARCHydro

What we need is

Many More

Many More

Many More

Many More

Upper Hydrologic Ontology

Michael Piasecki is ourexpert in this subject!

CUAHSI HIS Overview

• HIS User Assessment

• Hydrology Data Portal

• Digital Watershed• Hydrologic analysis

Hydrologic Analysis

HydrologicProcess Modeling

Statistics andHypothesis Testing

Visualization Data Miningand Knowledge Discovery

Digital Watershed

Data Driven

DiscoveryTools

Praveen Kumar is ourexpert on this subject!

Data Files

FebJan

4-D Data Model

Space, L

Time, T

Variables, V

D

Geostatistics

Time Series Analysis

Multivariate analysis

D

Image to Knowledge

Data to Knowledge

Hydrologic Flux Coupler

Hydrologic Fluxes and Flows

Digital Watershed(Atmospheric, surface and subsurface water)

We want to do water,mass, energy and water balances

Neuse Observatory Prototype Study

HydroVolumes

Take a watershed and extrude it vertically into the atmosphereand subsurface

A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”

Watershed Hydrovolumes

Geovolume is theportion of a hydrovolumethat contains solidearth materials

USGS Gaging stations

Hydrovolume

Stream channel Hydrovolumes

Atmospheric science – hydrology

• Weather and climate fields are the drivers – continuous in space and time across the nation

• Local watersheds are the reactors – each behaving according to its location and characteristics

GeoTemporal Reference Frame

• A defined geospatial coordinate system for (x,y,z)

• A defined time coordinate system (UTC, Eastern Standard Time, ….)

• A set of variables, V• Data values v(x,y,z,t)

Space (x,y,z)

Time, t

Variables, V

v – data values

Data Cube

Continuous Space-Time Model -- NetCDF

Space, L

Time, T

Variables, V

D

Coordinate dimensions

{X}

Variable dimensions{Y}

Space, FeatureID

Time, TSDateTime

Variables, TSTypeID

TSValue

Discrete Space-Time Data Model

Geospatial Time Series

Value

Time

Shape

Time SeriesProperties

(Type)A Value-Time array

A time series that knows what geographic feature it describes and what type of time series it is

Neuse Water Balance

Precipitation

Evaporation

Streamflow

Define the fluxes and flows associated with each hydrovolume

Groundwater recharge

Coupling Table – Connects fluxes and flows with hydrovolumes

A geospatial time series object

A geospatial time series object vector

Hydrovolume object

Coupling FeatureID

SourceSinkIDTSTypeIDDirection

FeatureID SourceSinkID TSTypeID Direction

1 02092500 1 -1

1 1 2 1

1 1 3 -1

1 1 4 1

TSTypeID Variable

1 Daily Streamflow

2 Daily Precipitation

3 Daily Evaporation

4 Daily Subsurface Recharge

Monthly Fluxes and Flows

P, E, RQ

Net Inflow and Cumulative Storage

Net Inflow

Storage

This water balance does not close very well – we need better data!

Monthly water balance for one watershed hydrovolume for 2001

HydroObjects Class Library

HydroObjectsAPI

Remote and local Data sources

ArcGIS

Excel

Matlab

Custom ModelsWeb Services

Backbone of a Hydrologic Information System

• Hydrology Data Portal is a common data window on point observation data sources

• CUAHSI web services library supports the data portal and local applications on your computer

• Digital watershed is a data fusion of point observations, GIS, remote sensing and weather and climate grids

• Hydrologic Flux Coupler key to integrating atmospheric, surface and subsurface water

Conclusions

In production

In development

In research