cuahsi hydrologic information systems by david r. maidment with support from many collaborators:...

CUAHSI Hydrologic Information Systems

By David R. Maidment

With support from many collaborators: Ilya Zaslavsky, Reza Wahadj, Chaitan Baru, Praveen Kumar, Michael Piasecki, Rick Hooper, Jon Duncan, David Tarboton, Jeff Horsburgh, Venkat Lakshmi, Chunmaio Zheng, Xu Liang, Yao Liang, Ken Reckhow, Upmanu Lall, LeRoy Poff, Dennis Lettenmaier, Barbara Minsker, ……

And many graduate students and post-docs: Venkatesh Merwade, Tim Whiteaker, Jon Goodall, Gil Strassberg, Ben Ruddell, Luis Bermudez, Bora Boran, ……

Thanks to everyone for all their help!

DataHypotheses

Needs

Tools

Data

Models

Exogenous DataTechnological

Advances

CommunitySupport

Multi-DisciplinaryTeams

HydrologicSynthesis

HydrologicObservatories

MeasurementTechnology

HydrologicInformation

Systems

CommunitySupport

AdditionalHypotheses

CUAHSI Hydrologic Information Systems

Environmental Cyberinfrastructure

• Part of NSF Cyberinfrastructure program

• CUAHSI Hydrologic Information Systems is one of several pilot projects – CUAHSI, CLEANER, ORION, NEON, …..

Project co-PI

Collaborator

CUAHSI Hydrologic Information System

HIS Status Report Available

• See http://www.cuahsi.org/docs/HISStatusSept15.pdf

• Summary of knowledge to date in the CUAHSI HIS project

• Your comments and feedback are welcome: maidment@mail.utexas.edu

HIS Goals

• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data

• Support for Observatories – synthesizing hydrologic data for a region

• Advancement of Hydrologic Science – data modeling and advanced analysis

• Hydrologic Education – better data in the classroom, basin-focused teaching

HIS Goals

• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data

• Support for Observatories – synthesizing hydrologic data for a region

• Advancement of Hydrologic Science – data modeling and advanced analysis

• Hydrologic Education – better data in the classroom, basin-focused teaching

HIS User Assessment (Chapter 4 in Status Report)

Data Access

Science Observatorysupport

Education

Which of the four HIS goals is most important to you?

CUAHSI Hydrologic Data Access System(HDAS)

A common data window for accessing, viewing and downloading hydrologic information

USGS

NASANCDCEPA NWS

Observatory Data

National Water Information System

• USGS NWIS website provides manual query and download capabilities for data at ~ 1.4 million locations in the US

• CUASHI web services for NWIS provide automated query and download capabilities

http://waterdata.usgs.gov/nwis

“Get the web pages out of the way”

NWIS Station Information in HDAS

http://river.sdsc.edu/HDAS

Charting Data in HDAS

Data Downloads Executed Here

Web Services

Web ServicesLibrary

Web application: Data PortalYour application• Excel, ArcGIS, Matlab• Fortran, C/C++, Visual Basic• Hydrologic model• …………….

Your operating system• Windows, Unix, Linux, Mac

Internet Simple Open Access Protocol

CUAHSI Web Services Library for NWIShttp://river.sdsc.edu/NWISTS/nwis.asmx

These web services are available now for you to use in your programming

Utah State Time Series Analyst(developed by Jeff Horsburgh)

http://water.usu.edu/nwisanalyst/  http://water.usu.edu/analyzer/

-- operates on CUAHSI web services-- operates on local data for Neuse basin

http://public.ornl.gov/ameriflux/

Building each web servicerequires a site map anda web services library

Ameriflux site map

Web services library

Ameriflux towers measure vertical fluxes of water, heat, CO2

Accessing Ameriflux data directly from Excel using CUAHSI web services

Page 3

Drexel University, College of Engineering

Data Centers

NCDC

USGSNWIS

NCEP

NWSNGDC

Sensor Arrays

Numerical ModelsPrediction

HSPF

Air-Q

MM5

IndividualSamples

METADATA

Description of Data

(see Chapter 5 of Status Report for details)

Michael Piaseckiis our expert on thiscomplex subject

CLEANER-CUAHSI Cybercollaboratory

• A common portal for web applications resident at many locations

• User support and feedback forums

• Do collaborative research using shared tools and dialog with a group of scientists

• CLEANER—CUAHSI joint projects

http://cleaner.ncsa.uiuc.edu/cybercollab/

Thanks to Barbara Minsker and NCSA for hosting this service for usThis service is still under development

HIS Goals

• Hydrologic Data Access System – get me the data I want quickly and painlessly

• Support for Observatories – synthesizing hydrologic data for a region

• Advancement of Hydrologic Science – data modeling and advanced analysis

• Hydrologic Education – better data in the classroom, basin-focused teaching

Digital WatershedHow can hydrologists integrate observed and

modeled data from various sources into a single description of the environment?

Digital WatershedHydrologic Observation

Data

GeospatialData

Remote SensingData

Weather and ClimateData

(NetCDF)

(GIS)(Relational database)

(EOS-HDF)

Digital Watershed

A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather

and climate data into a connected database for a hydrologic region

Hydrologic Observations Database

• A relational database stored in Access, PostgreSQL, SQL/Server, ….

• Stores observation data made at points

• Repository for summary data from sensor networks

• Access data through web interfaces

Streamflow

Flux towerdata

Precipitation& Climate

Groundwaterlevels

Water Quality

Soil moisture

data

Hydrologic Observations Data Model (Draft version)

• CUAHSI review conducted by David Tarboton with 22 responses • Redesign done by David and Jeff Horsburgh

Relationships

ProposedCUAHSI Observations Data Model(for details see chap 6 of status report)

Digital Watershed:Prototype for the Neuse basin

(See Chapter 8 in the Status Report for details)

Neuse Atmospheric Water

• Daily precipitation data from NCDC gages

• Nexrad daily rainfall rasters

• Land surface – atmosphere fluxes from North American Regional Reanalysis of climate

Neuse Surface Water

• Streamflow, water quality hydrologic observational data

• GIS: River network, water bodies, watersheds, monitoring points

• Land cover, soils, • MODIS remote sensing

(Praveen Kumar and Venkat Lakshmi)

MODIS

Terrain and Land Cover

Neuse Basin: Coastal aquifer system

* From USGS, Water Resources Data Report of North Carolina for WY 2002

Section line

Beaufort Aquifer

Neuse Groundwater

Geovolumes of hydrogeologic unitsfrom US Geological survey (GMS)

GeoVolume – 3D representation of the surface and subsurface

Geovolume Geovolume with groundwater model cells

Geovolume of layered soil texture for the Neuse basin

HIS Goals

• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data

• Support for Observatories – synthesizing hydrologic data for a region

• Advancement of Hydrologic Science – data modeling and advanced analysis

• Hydrologic Education – better data in the classroom, basin-focused teaching

Hydrologic Science

• It is as important to represent hydrologic environments precisely with data as it is to represent hydrologic processes with equations

• Hydrologic Process Science– Equations, simulation models, prediction,

• Hydrologic Information Science– Digital watershed, data models, integration

with data of neighboring disciplinesHydrologic information science supports

hydrologic process science

HydroVolumes

Take a watershed and extrude it vertically into the atmosphereand subsurface

A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”

Watershed Hydrovolumes

Geovolume is theportion of a hydrovolumethat contains solidearth materials

USGS Gaging stations

Hydrovolume

Stream channel Hydrovolumes

Hydrologic Flux Coupler

Hydrologic Fluxes and Flows

Digital Watershed(Atmospheric, surface and subsurface water)

We want to do water,mass, energy and water balances

Hydrologic Flux Coupler

Precipitation

Evaporation

Streamflow

Define the fluxes and flows associated with each hydrovolume

Groundwater recharge

See Chapter 9 of Status Report for Details

Data Files

FebJan

4-D Data Model

Space, L

Time, T

Variables, V

D

Geostatistics

Time Series Analysis

Multivariate analysis

D

Image to Knowledge

Data to Knowledge

(See Chapter 10 ofthe status report fordetails)

Praveen KumarIs our expert on thissubject

HIS Goals

• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data

• Support for Observatories – synthesizing hydrologic data for a region

• Advancement of Hydrologic Science – data modeling and advanced analysis

• Hydrologic Education – better data in the classroom, basin-focused teaching

Basin-oriented teaching

http://www.ce.utexas.edu/prof/maidment/gradhydro2005/gradhydro2005.htm

• Focus class on interpretation of a single river basin

• Interdisciplinary teaching• Water balances for each

phase of hydrologic cycle• Use Unidata Integrated

Data Viewer to access weather info

Where to from here?

• “Test bed” informatics project– Determine best way to get tools that are

ready to go into users’ hands– Deliver Hydrologic Data Access System– Support Hydrologic Information Toolkit (e.g.,

Time Series Analyst from USU)– Further development where required (e.g.,

digital watershed, flux coupler, shared data models with neighboring science communities)

Funding Opportunities

• Earth Sciences Instrumentation and Facilities competition– Open competition with proposals due 8 Feb, 2006– NSF is encouraging proposals for “test bed” project for 5-year

period with funding in order of $4million– Developmental projects can also be submitted to this competition

• Role of CUAHSI– Prioritization, Liaison w/ Federal Agencies, Testing, Community

Education, Coordination among Informatics projects– CUAHSI will support any successful project in this competition that

requests CUAHSI engagement– Standard language will be available from web site– Discuss budget requirements with Rick Hooper– Jon Duncan will chair a Users Committee for reviewing HIS

products

• Statement will be posted on CUAHSI web site shortly