cuahsi hydrologic information system status review, july 14, 2004
DESCRIPTION
CUAHSI Hydrologic Information System Status Review, July 14, 2004. Agenda. Review the work of the five project partners CUAHSI (Rick Hooper, Jon Duncan) San Diego Supercomputer Center (John Helly, ….) University of Texas (David Maidment, …) University of Illinois (Praveen Kumar ….) - PowerPoint PPT PresentationTRANSCRIPT
CUAHSI Hydrologic Information SystemStatus Review, July 14, 2004
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan)– San Diego Supercomputer Center (John Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)
• Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng
• HIS review meetings – SDSC (August 12-13) – technical detail– Logan (August 23) – user needs assessment
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse
HO report status– San Diego Supercomputer Center (John
Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar,...)– Drexel University (Michael Piasecki,…)
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse
HO report status– San Diego Supercomputer Center (John
Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)
Hydrologic Information System
Overview and Status
John HellySan Diego Supercomputer CenterSan Diego Supercomputer Center
[email protected]@ucsd.edu
Outline
• SDSC HIS Team• HISArchitecture
– HydroViewer GUI– Metadata Content Standard & Controlled
Vocabulary– Harvesting Metadata and Data– External Interfaces
• Proposal Tasks• Community Coordination
SDSC HIS Team
• John Helly / Co-PI, HIS Developer
• Don Sutton / HIS Developer
• Tiffany Houghton / HIS Developer
• Ilya Zaslavsky / GIS / GEON
• Arcot Rajasekar / SRB
• Josh Polterock / Web-service Support
• Dave Archbell / Oracle DBMS Support
New Concept of Publication
Empirical-to-Conceptual
Federated Digital Library
Reference Models Data Models Reference Models Conceptual Reference Models Data ModelsData Models
Distributed Data SourcesDistributed Data SourcesDistributed Data SourcesDistributed Data Sources
Data Transformation
Harvesting
e.g., Hydrologic Cyclee.g., ArcHydro
Empirical-to-Conceptual
Center for Hydrologic Information
Reference Models Data Models Reference Models Data ModelsData Models
Distributed Data SourcesDistributed Data SourcesDistributed Data SourcesDistributed Data Sources
Data Transformation
Harvesting
e.g., Hydrologic Cyclee.g., ArcHydro
HOiHOiHOiHOiHOiHOiHOiHOiHOiHOiHOiHOi
HydrologicObservatories
Distributed Data SourcesDistributed Data SourcesDistributed Data SourcesDistributed Data Sources
Harvesting
FederatedDigital Library
System Architecture: Interfaces
System Architecture: Hardware
GeonGrid Node cuahsi001.sdsc.eduSDSC Web-service
cuahsi.sdsc.edu
SRB/HPSS
SRB/SAMFS
File System
Oracle Metadata Catalogue
High-speed
Communications
Network ArchitectureNeuse
SMR
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
FederatedMCAT
HydroViewer GUI
NeuseRiverWatershedCollection
HydroViewer GUI
SantaMargariaRiverWatershedCollection
Wide Range of Data PresentationExample from SIOExplorer Collections
UserDesktop
Metadata Template File (*.mtf) Defines *.mif Content
"Title",mif_dbc_title,"character","required","0","germ"
"Creator",mif_dbc_creator,"character","required","0","germ"
"Subject",mif_dbc_subject,"character","required","0","germ"
"Description",mif_dbc_description,"character","required","0","germ"
"Publisher",mif_dbc_publisher,"character","required","0","germ"
"Contributor",mif_dbc_contributor,"character","required","0","germ"
"Date",mif_dbc_date,"character","required","0","germ"
"Type",mif_dbc_type,"character","required","0","germ"
"Format",mif_dbc_format,"character","required","0","germ"
"Identifier",mif_dbc_identifier,"character","required","0","germ"
"Publisher",mif_dbc_publisher,"character","required","0","germ"<" label“>,<attribute_name>,<“value“>,<“data type“>,<“associates“>,<“authority”>
Canonical Object Browser and Editor
Metadata Object Browser and Editor
Arbitrary Digital Objects
Interoperability Coordination
• GEON Weekly Meetings
• Interoperability Workshop
• Sediment Chemistry Workshop
HIS Services
• Digital Library– Search and retrieval– Metadata tools
• Data Format Transformation• Remote Computation
– Gridded computing resources
Latest Progress• Telecon (John) with Drexel(Luis) and UT(David)
– Discussed utilization of XML for unit conversion• Telecon (John) with Berkeley and Virginia Tech
– Focus on VT implementation and interface definition– Need similar conversation with UT/Austin
• MTF standardization (Don, John)– http://cuahsi.sdsc.edu/html_source/metadata_resources.html
• MOBE and COBE hardening (Tiffany)• Needed for network testing (John)
– Collection-building standardization (Don, John)– REST/SOAP interface (Ilya, Reza, Don)– SRB 3.2 installation testing and regularization (John, Raja)
• MultiViewer based on REST/SOAP interface being investigated (Ilya, Don, Reza)• GEON-registration of HIS collections being investigated (Ilya, Don, Reza)• OWL file expressed as interactive graph (*.svg) coming up (Ilya)
– Web-interface for managing files– *.mtf-specified schema provides vocabulary– Need controlled-vocabulary– Bottom-up versus top-down interface– Coordination with Drexel needed
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse
HO report status– San Diego Supercomputer Center (John
Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)
University of Texas
• David Maidment is PI, assisted by Jon Goodall, Gil Strassberg, Venkatesh Merwade
• Hydrologic data model development– atmospheric water, surface water, subsurface
water– interoperable analysis environment
Hydrologic Analysis and Visualization Environments
Hydrologic Digital Library(Digital files of hydrologic information in any form,
indexed by a metadata catalog)
Hydrologic Representation Environment
(Sets of variables defined on space-time domains)
AnalysisSimulation
modelVisualizationStatistics
HIS Data Organization
Hydrologic Data Model
(a) Precipitable water in the atmosphere
(b) Vertical cross-section
(c) Wind speed (colors) and wind vectors
Continuous Space-Time
Use NetCDF for continuous space-tme
Discrete Space-Time
ETmm/d
Rainin/d
Flow Incfs
Flow OutcfsFlow Out
cfs
A South Florida Basin
We need to link time series to spatial objects to definethe transfer of water into and out of the object.
Use Arc Hydro for discrete space-time
Mass balance
Hydrologic Flux Time Objects
TS Operator
+, - , etc.
TS Object
TS ObjectTS Object
TS Object
TS Object Class isbased on the ArcHydro TimeSeriesComponent.
TS Operator Class performs time series transformations to allowaddition, subtraction, integration,etc of different TS Objects.
Unit Conversions
SI Units
From Unit
From Unit
From Unit
To Unit
To Unit
To Unit
2n
Must read two conversion factors from xml fileWhat about exact conversions like feet to mile?
XML for Unit Conversions
We will have to define our hydrologic data model in XML to make it applicationand vendor independent
http://neuse.crwr.utexas.edu/
FEMA Data for Neuse
5600 km of streams and rivers mappedand modeled for floods
Half square milecatchments3D streams and cross-sections
Neuse Basin: Coastal aquifer system
* From USGS, Water Resources Data Report of North Carolina for WY 2002
Section line
Beaufort Aquifer
Creating a 3D model of the subsurface
Stratigraphy from the North Carolina database (tabular), imported into ArcGIS
Importing borehole data to GMS
Data is imported from GIS into GMS (Groundwater Modeling System)
Solid model
Solids are generated in GMS using the Horizons methodContacts are assigned horizons (from bottom to top) and then solids
are created by interpolating a surface for each horizon extruding downward.
Cross section views
Can create cross sections from the solids or by connecting observation at boreholes.
Next we want to read back the cross sections and solids into GIS
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse
HO report status– San Diego Supercomputer Center (John
Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….) –
Praveen is overseas…– Drexel University (Michael Piasecki…)
University of Illinois
• Praveen Kumar is PI, assisted by Benjamin Ruddell
• Developing “Modelshed” which is an generalized hydrologic modeling and data analysis environment built on top of Arc Hydro
• Focused on applications integrating hydrology and climate modeling
Flow
Time
Time Series
Hydrography
Hydro Network
Channel System
Drainage System
Arc Hydro Components
What is a Modelshed?• A volumetric spatial
model unit, registered in three dimensions by a GIS, with which time-varying data, model fluxes, spatial relationships and descriptive metadata are associated
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan) – Neuse
HO report status– San Diego Supercomputer Center (John
Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….) –
Praveen is overseas…– Drexel University (Michael Piasecki…)
Drexel University
• Michael Piasecki is PI, assisted by Luis Bermudez
• Goal is to study metadata languages and standards to find what is most suitable for hydrology
• Concept hierarchies stored in “ontologies” described in OWL (Ontology Web Language)
Comparison of time schemes for geospatial data
by
Bora Beran - Saiful Islam
Motivations
ISO 19115 – Geographic Information metadata CSDGM (FGDC) - Content Standard for Digital Geospatial Metadata (CSDGM)DCMI –Dublin Core Metadata Standard
Metadata standards
EML – Ecological Metadata LanguageESML –Earth Science Markup LanguageGML – Geographic Markup LanguageXML – Extended Markup Language
Markup Languages
mif – Metadata Interchange FormatnetCDF – Network common Data FormatGRIB –GRIdded Binary HDF – EOS - Hierarchical Data Format - Earth Observing System geoTIFF - Georeferenced Tag(ged) Image File FormatDIF – Directory Interchange Format
Self describing documentation format
CSDGM (FGDC) - What do they offer?
FGDC Temporal Metadata Package:
The simplest of all
But is simplicity a drawback?
Depends on the purpose
We’ll see if these elements are enough for sufficiently expressing hydrologic data.
Ecological markup language temporal Coverage• Two main components similar to FGDC
– Single Date + Time– Range Date + Time
• Additionally supports alternate time scale, e.g. geological time scale
• Reference of temporal coverage
Similar to FGDC
Earth Science Markup Language wayLacks time scale information
This part is same as FGDC
Adds a separate option
for periodic occurrences.
ISO 19115 Temporal Extent
• EX_Temporal_Extent is a class in ISO 19115 that points to abstract class TM_Primitive (ISO 19108)
• ISO defines a separate specification for Geographic Information Temporal Schema (ISO 19108) to describe the temporal characteristics of geographic information
• ISO 19108 is the most extensive and complete specification as compared to metadata standards of similar initiatives
TM_OrdinalReferenceSystemIn a number of applications of geographic information – geology and
archaeology, for example – relative position in time is known more precisely
than duration. The order of events in time can be well established, but the
magnitude of the intervals between them can not be accurately determined. An
ordinal temporal reference system is appropriate in such cases.
TM_CoordinateSystemSpecifying temporal position in terms of calendar date and time of day
complicates the computation of distances between points and the functional
description of temporal operations. A temporal coordinate system may be used
to support applications of this kind. A temporal coordinate system shall be
based on a continuous interval scale defined in terms of a single time interval.
Example: Description of the Babylonian calendar
Concepts ISO FGDC ESML EML
Single date and range X X X X
Supports periodic events
X X
Time Scale Information
X X
Ordinal referencing
X X
Relative referencing X
Comparison of temporal schemas
Agenda
• Review the work of the five project partners– CUAHSI (Rick Hooper, Jon Duncan)– San Diego Supercomputer Center (John Helly, ….)– University of Texas (David Maidment, …)– University of Illinois (Praveen Kumar ….)– Drexel University (Michael Piasecki…)
• Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng
• HIS review meetings – SDSC (August 12-13) – technical detail– Logan (August 24) – user needs assessment
Agenda
Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng
• Updates from collaborators– David Tarboton to organize HIS Cyberseminars. How often do we
want to do this?
• Development of concept papers for particular areas of HIS– LeRoy Poff: an assessment of needs for an HIS to support aquatic
ecology……– Manu Lall: a survey of methodology for statistical space-time
interpretation of data……– Need to draft written scopes for these papers for review by the
group
Agenda
• HIS review meetings – SDSC (Thursday, Friday, August 12-13) – technical
detail on HIS development especially on metadata definition http://cuahsi.sdsc.edu/
– Logan (Monday, August 23) – Status report on HIS project and assessment of user needs for HIS in the hydrologic observatories http://www.usu.edu/water/cuahsi
• CUAHSI will provide travel funds for HIS project PI’s and collaborators to travel to one of these meetings