cuahsi hydrologic information system status review, july 14, 2004

CUAHSI Hydrologic Information SystemStatus Review, July 14, 2004

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan)– San Diego Supercomputer Center (John Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)

• Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng

• HIS review meetings – SDSC (August 12-13) – technical detail– Logan (August 23) – user needs assessment

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse

HO report status– San Diego Supercomputer Center (John

Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar,...)– Drexel University (Michael Piasecki,…)

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse

HO report status– San Diego Supercomputer Center (John

Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)

Hydrologic Information System

Overview and Status

John HellySan Diego Supercomputer CenterSan Diego Supercomputer Center

hellyj@ucsd.eduhellyj@ucsd.edu

Outline

• SDSC HIS Team• HISArchitecture

– HydroViewer GUI– Metadata Content Standard & Controlled

Vocabulary– Harvesting Metadata and Data– External Interfaces

• Proposal Tasks• Community Coordination

SDSC HIS Team

• John Helly / Co-PI, HIS Developer

• Don Sutton / HIS Developer

• Tiffany Houghton / HIS Developer

• Ilya Zaslavsky / GIS / GEON

• Arcot Rajasekar / SRB

• Josh Polterock / Web-service Support

• Dave Archbell / Oracle DBMS Support

New Concept of Publication

Empirical-to-Conceptual

Federated Digital Library

Reference Models Data Models Reference Models Conceptual Reference Models Data ModelsData Models

Distributed Data SourcesDistributed Data SourcesDistributed Data SourcesDistributed Data Sources

Data Transformation

Harvesting

e.g., Hydrologic Cyclee.g., ArcHydro

Empirical-to-Conceptual

Center for Hydrologic Information

Reference Models Data Models Reference Models Data ModelsData Models

Distributed Data SourcesDistributed Data SourcesDistributed Data SourcesDistributed Data Sources

Data Transformation

Harvesting

e.g., Hydrologic Cyclee.g., ArcHydro

HOiHOiHOiHOiHOiHOiHOiHOiHOiHOiHOiHOi

HydrologicObservatories

Distributed Data SourcesDistributed Data SourcesDistributed Data SourcesDistributed Data Sources

Harvesting

FederatedDigital Library

System Architecture: Interfaces

System Architecture: Hardware

GeonGrid Node cuahsi001.sdsc.eduSDSC Web-service

cuahsi.sdsc.edu

SRB/HPSS

SRB/SAMFS

File System

Oracle Metadata Catalogue

High-speed

Communications

Network ArchitectureNeuse

SMR

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

FederatedMCAT

HydroViewer GUI

NeuseRiverWatershedCollection

HydroViewer GUI

SantaMargariaRiverWatershedCollection

Wide Range of Data PresentationExample from SIOExplorer Collections

UserDesktop

Metadata Template File (*.mtf) Defines *.mif Content

"Title",mif_dbc_title,"character","required","0","germ"

"Creator",mif_dbc_creator,"character","required","0","germ"

"Subject",mif_dbc_subject,"character","required","0","germ"

"Description",mif_dbc_description,"character","required","0","germ"

"Publisher",mif_dbc_publisher,"character","required","0","germ"

"Contributor",mif_dbc_contributor,"character","required","0","germ"

"Date",mif_dbc_date,"character","required","0","germ"

"Type",mif_dbc_type,"character","required","0","germ"

"Format",mif_dbc_format,"character","required","0","germ"

"Identifier",mif_dbc_identifier,"character","required","0","germ"

"Publisher",mif_dbc_publisher,"character","required","0","germ"<" label“>,<attribute_name>,<“value“>,<“data type“>,<“associates“>,<“authority”>

Canonical Object Browser and Editor

Metadata Object Browser and Editor

Arbitrary Digital Objects

Interoperability Coordination

• GEON Weekly Meetings

• Interoperability Workshop

• Sediment Chemistry Workshop

HIS Services

• Digital Library– Search and retrieval– Metadata tools

• Data Format Transformation• Remote Computation

– Gridded computing resources

Latest Progress• Telecon (John) with Drexel(Luis) and UT(David)

– Discussed utilization of XML for unit conversion• Telecon (John) with Berkeley and Virginia Tech

– Focus on VT implementation and interface definition– Need similar conversation with UT/Austin

• MTF standardization (Don, John)– http://cuahsi.sdsc.edu/html_source/metadata_resources.html

• MOBE and COBE hardening (Tiffany)• Needed for network testing (John)

– Collection-building standardization (Don, John)– REST/SOAP interface (Ilya, Reza, Don)– SRB 3.2 installation testing and regularization (John, Raja)

• MultiViewer based on REST/SOAP interface being investigated (Ilya, Don, Reza)• GEON-registration of HIS collections being investigated (Ilya, Don, Reza)• OWL file expressed as interactive graph (*.svg) coming up (Ilya)

– Web-interface for managing files– *.mtf-specified schema provides vocabulary– Need controlled-vocabulary– Bottom-up versus top-down interface– Coordination with Drexel needed

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse

HO report status– San Diego Supercomputer Center (John

Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)

University of Texas

• David Maidment is PI, assisted by Jon Goodall, Gil Strassberg, Venkatesh Merwade

• Hydrologic data model development– atmospheric water, surface water, subsurface

water– interoperable analysis environment

Hydrologic Analysis and Visualization Environments

Hydrologic Digital Library(Digital files of hydrologic information in any form,

indexed by a metadata catalog)

Hydrologic Representation Environment

(Sets of variables defined on space-time domains)

AnalysisSimulation

modelVisualizationStatistics

HIS Data Organization

Hydrologic Data Model

(a) Precipitable water in the atmosphere

(b) Vertical cross-section

(c) Wind speed (colors) and wind vectors

Continuous Space-Time

Use NetCDF for continuous space-tme

Discrete Space-Time

ETmm/d

Rainin/d

Flow Incfs

Flow OutcfsFlow Out

cfs

A South Florida Basin

We need to link time series to spatial objects to definethe transfer of water into and out of the object.

Use Arc Hydro for discrete space-time

Mass balance

Hydrologic Flux Time Objects

TS Operator

+, - , etc.

TS Object

TS ObjectTS Object

TS Object

TS Object Class isbased on the ArcHydro TimeSeriesComponent.

TS Operator Class performs time series transformations to allowaddition, subtraction, integration,etc of different TS Objects.

Unit Conversions

SI Units

From Unit

From Unit

From Unit

To Unit

To Unit

To Unit

2n

Must read two conversion factors from xml fileWhat about exact conversions like feet to mile?

XML for Unit Conversions

We will have to define our hydrologic data model in XML to make it applicationand vendor independent

http://neuse.crwr.utexas.edu/

FEMA Data for Neuse

5600 km of streams and rivers mappedand modeled for floods

Half square milecatchments3D streams and cross-sections

Neuse Basin: Coastal aquifer system

* From USGS, Water Resources Data Report of North Carolina for WY 2002

Section line

Beaufort Aquifer

Creating a 3D model of the subsurface

Stratigraphy from the North Carolina database (tabular), imported into ArcGIS

Importing borehole data to GMS

Data is imported from GIS into GMS (Groundwater Modeling System)

Solid model

Solids are generated in GMS using the Horizons methodContacts are assigned horizons (from bottom to top) and then solids

are created by interpolating a surface for each horizon extruding downward.

Cross section views

Can create cross sections from the solids or by connecting observation at boreholes.

Next we want to read back the cross sections and solids into GIS

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse

HO report status– San Diego Supercomputer Center (John

Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….) –

Praveen is overseas…– Drexel University (Michael Piasecki…)

University of Illinois

• Praveen Kumar is PI, assisted by Benjamin Ruddell

• Developing “Modelshed” which is an generalized hydrologic modeling and data analysis environment built on top of Arc Hydro

• Focused on applications integrating hydrology and climate modeling

Flow

Time

Time Series

Hydrography

Hydro Network

Channel System

Drainage System

Arc Hydro Components

What is a Modelshed?• A volumetric spatial

model unit, registered in three dimensions by a GIS, with which time-varying data, model fluxes, spatial relationships and descriptive metadata are associated

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse

HO report status– San Diego Supercomputer Center (John

Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….) –

Praveen is overseas…– Drexel University (Michael Piasecki…)

Drexel University

• Michael Piasecki is PI, assisted by Luis Bermudez

• Goal is to study metadata languages and standards to find what is most suitable for hydrology

• Concept hierarchies stored in “ontologies” described in OWL (Ontology Web Language)

Comparison of time schemes for geospatial data

by

Bora Beran - Saiful Islam

Motivations

ISO 19115 – Geographic Information metadata CSDGM (FGDC) - Content Standard for Digital Geospatial Metadata (CSDGM)DCMI –Dublin Core Metadata Standard

Metadata standards

EML – Ecological Metadata LanguageESML –Earth Science Markup LanguageGML – Geographic Markup LanguageXML – Extended Markup Language

Markup Languages

mif – Metadata Interchange FormatnetCDF – Network common Data FormatGRIB –GRIdded Binary HDF – EOS - Hierarchical Data Format - Earth Observing System geoTIFF - Georeferenced Tag(ged) Image File FormatDIF – Directory Interchange Format

Self describing documentation format

CSDGM (FGDC) - What do they offer?

FGDC Temporal Metadata Package:

The simplest of all

But is simplicity a drawback?

Depends on the purpose

We’ll see if these elements are enough for sufficiently expressing hydrologic data.

Ecological markup language temporal Coverage• Two main components similar to FGDC

– Single Date + Time– Range Date + Time

• Additionally supports alternate time scale, e.g. geological time scale

• Reference of temporal coverage

Similar to FGDC

Earth Science Markup Language wayLacks time scale information

This part is same as FGDC

Adds a separate option

for periodic occurrences.

ISO 19115 Temporal Extent

• EX_Temporal_Extent is a class in ISO 19115 that points to abstract class TM_Primitive (ISO 19108)

• ISO defines a separate specification for Geographic Information Temporal Schema (ISO 19108) to describe the temporal characteristics of geographic information

• ISO 19108 is the most extensive and complete specification as compared to metadata standards of similar initiatives

TM_OrdinalReferenceSystemIn a number of applications of geographic information – geology and

archaeology, for example – relative position in time is known more precisely

than duration. The order of events in time can be well established, but the

magnitude of the intervals between them can not be accurately determined. An

ordinal temporal reference system is appropriate in such cases.

TM_CoordinateSystemSpecifying temporal position in terms of calendar date and time of day

complicates the computation of distances between points and the functional

description of temporal operations. A temporal coordinate system may be used

to support applications of this kind. A temporal coordinate system shall be

based on a continuous interval scale defined in terms of a single time interval.

Example: Description of the Babylonian calendar

Concepts ISO FGDC ESML EML

Single date and range X X X X

Supports periodic events

X X

Time Scale Information

X X

Ordinal referencing

X X

Relative referencing X

Comparison of temporal schemas

Agenda

• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan)– San Diego Supercomputer Center (John Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)

• Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng

• HIS review meetings – SDSC (August 12-13) – technical detail– Logan (August 24) – user needs assessment

Agenda

Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng

• Updates from collaborators– David Tarboton to organize HIS Cyberseminars. How often do we

want to do this?

• Development of concept papers for particular areas of HIS– LeRoy Poff: an assessment of needs for an HIS to support aquatic

ecology……– Manu Lall: a survey of methodology for statistical space-time

interpretation of data……– Need to draft written scopes for these papers for review by the

group

Agenda

• HIS review meetings – SDSC (Thursday, Friday, August 12-13) – technical

detail on HIS development especially on metadata definition http://cuahsi.sdsc.edu/

– Logan (Monday, August 23) – Status report on HIS project and assessment of user needs for HIS in the hydrologic observatories http://www.usu.edu/water/cuahsi

• CUAHSI will provide travel funds for HIS project PI’s and collaborators to travel to one of these meetings