Arc Hydro in Florida:Arc Hydro in Florida:Core Principles and CollaborationCore Principles and Collaboration
Overview of Arc Hydro ConceptsOverview of Arc Hydro Concepts
Dean Djokic, ESRIDean Djokic, ESRINovember 4, 2005November 4, 2005
2
AgendaAgenda
• Overview of data model purpose Overview of data model purpose • Template model overviewTemplate model overview• Selected design topics and toolsSelected design topics and tools• Arc Hydro II special topicsArc Hydro II special topics• DiscussionDiscussion
3
• Adding shapefiles and coverages into an Adding shapefiles and coverages into an ArcMap session does not make a geodatabaseArcMap session does not make a geodatabase
• Loading shapefiles and coverages into a Loading shapefiles and coverages into a geodatabase does not make a (efficient) geodatabase does not make a (efficient) geodatabase.geodatabase.
• Ignoring geodatabase capabilities increases Ignoring geodatabase capabilities increases cost of development and ownershipcost of development and ownership
• When developing data, ignore spatial reference When developing data, ignore spatial reference issues at your own perilissues at your own peril
• SDE and versioning (including disconnected SDE and versioning (including disconnected editing) do not replace the need for careful editing) do not replace the need for careful workflow developmentworkflow development
Review of Review of geodatabasegeodatabase issues issues
4
How “Things” Build UpHow “Things” Build Up
• Database developmentDatabase development• Data preparationData preparation• Terrain preparationTerrain preparation• ““Watershed” delineationWatershed” delineation• ““Watershed” characterizationWatershed” characterization
• ParameterizationParameterization
• Model pre and post-processingModel pre and post-processing
Generic
Semi-Generic
Model Specific
5
Arc HydroArc HydroTemplate Data ModelTemplate Data Model
6
Parcel …Arc Hydro
Template Data Models
HEC …FEMA
Project Data Models
Feature TopologyObject
ArcGIS Core Data Model
OGC
FGDC
ISO
GIS/IT Standards
Industry
Templates Templates Provide an Provide an Important Important
Link Link Between Between Project Project Teams, Teams,
Standards, Standards, and ESRI and ESRI Software Software
DevelopmentDevelopment
Template Data ModelsTemplate Data Models
7
Arc HydroArc Hydro
• Extension of geodatabase model for support Extension of geodatabase model for support of water resources applications (template of water resources applications (template data model)data model)
• Culmination of a three year process led by Culmination of a three year process led by D.R. Maidment through GIS in Water D.R. Maidment through GIS in Water Resources Consortium (Arc Hydro book)Resources Consortium (Arc Hydro book)
• Collection of tools for support of Arc Hydro Collection of tools for support of Arc Hydro geodatabase design and basic water geodatabase design and basic water resources functionsresources functions
• Starting pointStarting point for water resources database for water resources database and application developmentand application development
8
Basic idea: Transition from …Basic idea: Transition from …
Streams
Drainage Areas
Hydrography
Channels
Terrain Surfaces
Rainfall Response
Digital Orthophotos
Data Model Based on Inventory
9
… … and …and …
Follow a drop of water from where it falls on the land, to the stream, and all the way to the ocean.
Data Model Based on Behavior
10
… … to Arc Hydro Data Modelto Arc Hydro Data Model
Relationships betweenobjects linked by tracing pathof water movement
Integrate Data Inventory using a Behavioral Model
11
Basic ConceptsBasic Concepts
• Define core feature classes for water resources Define core feature classes for water resources analysesanalyses
• Establish relationships between core feature Establish relationships between core feature classesclasses
• Use geometric network for tying pieces togetherUse geometric network for tying pieces together• Mobilization of standard ArcGIS functionalityMobilization of standard ArcGIS functionality• Custom tools for some of the attribute Custom tools for some of the attribute
managementmanagement• Custom tools for advanced “water resources” Custom tools for advanced “water resources”
functionalityfunctionality
12
Data Model PurposeData Model Purpose
• Target audience: Water resources (surface) Target audience: Water resources (surface) community interested in quick start in ArcGIS community interested in quick start in ArcGIS implementationimplementation
• Starting point for project model designStarting point for project model design• Not a “do all” designNot a “do all” design• Not implementation/application specific, but Not implementation/application specific, but
provides the key components to develop on provides the key components to develop on top oftop of
13
Arc Hydro
Template Data Model ApproachesTemplate Data Model Approaches
Floodplain WQ
Permitting
Water Resources
14
Thematic ContentThematic Content
15
Arc Hydro Database DefinitionArc Hydro Database Definition
• A geospatial and temporal data model for water A geospatial and temporal data model for water resources that operates within ArcGISresources that operates within ArcGIS
• Five key conceptual areasFive key conceptual areas– DrainageDrainage - - Drainage areas and stream lines Drainage areas and stream lines
defined from surface topographydefined from surface topography– Flow networkFlow network - - Connected sets of points and Connected sets of points and
lines showing pathways of water flowlines showing pathways of water flow– HydrographyHydrography - - The base data from topographic The base data from topographic
maps and tabular data inventoriesmaps and tabular data inventories– Channel descriptionChannel description - - A 3-D line representation A 3-D line representation
of the shape of river and stream channelsof the shape of river and stream channels– Time seriesTime series - - Tabular attribute data describing Tabular attribute data describing
time-varying water properties for any hydro time-varying water properties for any hydro featurefeature
16
Arc Hydro Data ModelArc Hydro Data Model
17
Arc Hydro Data Model DetailsArc Hydro Data Model Details
• Detailed representation at the end of Detailed representation at the end of corresponding chapters in the book (e.g. p 51)corresponding chapters in the book (e.g. p 51)
18
19
Arc Hydro Key FieldsArc Hydro Key Fields
• Few predefined fields/attributesFew predefined fields/attributes– Identification/relatesIdentification/relates
• HydroID, NextDownID, DrainID, JunctionID, FeatureID, HydroID, NextDownID, DrainID, JunctionID, FeatureID, ……
• HydroCode, ReachCode, CSCode, …HydroCode, ReachCode, CSCode, …
– MeasuresMeasures• LengthKm, AreaSqKmLengthKm, AreaSqKm• LengthDown, DrainAreaLengthDown, DrainArea
– AuxiliaryAuxiliary• FType, Name, Flowdir, …FType, Name, Flowdir, …
20
HydroID StoryHydroID Story
• HydroID – a unique integer identifier for HydroID – a unique integer identifier for every feature within a geodatabaseevery feature within a geodatabase
• An An internalinternal identifier whose value is used for identifier whose value is used for establishing the relationships within the Arc establishing the relationships within the Arc Hydro data model (HydroID, DrainID, Hydro data model (HydroID, DrainID, NextDownID, JunctionID, …)NextDownID, JunctionID, …)
• Focus on local (within a geodatabase) Focus on local (within a geodatabase) uniqueness, but can be made globaluniqueness, but can be made global
21
HydroCode StoryHydroCode Story
22
RelationshipsRelationships
• Establish a formal (geodatabase) Establish a formal (geodatabase) relationship between two feature (object) relationship between two feature (object) classes using predefined ID properties.classes using predefined ID properties.– HydroID-based (e.g. NextDownID, HydroID-based (e.g. NextDownID,
JunctionID, DrainID)JunctionID, DrainID)• ““HydroJunctionHasWaterbody”HydroJunctionHasWaterbody”• ““HydroJunctionHasWatershed”HydroJunctionHasWatershed”• ““HydroJunctionHasMonitoringPoint”HydroJunctionHasMonitoringPoint”• ““MonitoringPointHasTimeSeries”MonitoringPointHasTimeSeries”
23
RelationshipsRelationships (an example – “HydroJunctionHasWaterbody” - definition) (an example – “HydroJunctionHasWaterbody” - definition)
24
Connecting to Time SeriesConnecting to Time Series
HydroID
CrossSectionHydroPoint
DrainagePoint Junction
TimeSeries
Time
Flow
FeatureID
FeatureID of time seriesis HydroID of the feature the time series describes
25
Time Series Data StructureTime Series Data Structure
26
Time Series DilemmaTime Series Dilemma
• Simplicity in structureSimplicity in structure– Easy to import and export time series data from Easy to import and export time series data from
other sourcesother sources– Easy to use standard ArcGIS tabular functionality Easy to use standard ArcGIS tabular functionality
and SQL statementsand SQL statements– Needs “transposition” for efficient use for rendering Needs “transposition” for efficient use for rendering
data spatial datadata spatial data– Large table with potentially millions of recordsLarge table with potentially millions of records– Inefficient storage of specific types of temporal data Inefficient storage of specific types of temporal data
(many to many case)(many to many case)– ……
• Need more flexibility (but at a cost of Need more flexibility (but at a cost of complexity)complexity)
27
Hydro NetworkHydro Network
• Backbone of Arc Hydro - establishes Backbone of Arc Hydro - establishes connectivity between core feature classesconnectivity between core feature classes
• Hydro edges (lines through which water flows) Hydro edges (lines through which water flows) and junctions (confluences, other points of and junctions (confluences, other points of interest)interest)
• Other feature classes connected to junctions Other feature classes connected to junctions through relationships (e.g. through relationships (e.g. HydroJunctionHasWatershed)HydroJunctionHasWatershed)
• Allows upstream/downstream tracing (and Allows upstream/downstream tracing (and other out of box ArcGIS network functionality)other out of box ArcGIS network functionality)
28
Hydro NetworkHydro Network
29
Extending Arc Hydro Data ModelExtending Arc Hydro Data Model
• Arc Hydro is by design a starting point for Arc Hydro is by design a starting point for complex database design complex database design
• Arc Hydro data model can be extended Arc Hydro data model can be extended with additional feature classes and/or with additional feature classes and/or attributes (or some Arc Hydro feature attributes (or some Arc Hydro feature classes can be ignored)classes can be ignored)
• Use additional GIS data sources (GRID & Use additional GIS data sources (GRID & TIN)TIN)
• Use all existing IDs and tools to minimize Use all existing IDs and tools to minimize duplication of effortduplication of effort
30
Extending Arc Hydro Data ModelExtending Arc Hydro Data Model
More application specific “stuff”
31
• A set of tools that “exercises” the Arc Hydro A set of tools that “exercises” the Arc Hydro modelmodel– Integral with standard ArcGIS functionalityIntegral with standard ArcGIS functionality
• Key field (property) managementKey field (property) management– HydroID & related IDsHydroID & related IDs– Length/Area measuresLength/Area measures
• Core functionsCore functions– DEM-based watershed delineationDEM-based watershed delineation– Network generationNetwork generation– Attribute and network tracing and summary Attribute and network tracing and summary
operationsoperations
Arc Hydro Tools Overview Arc Hydro Tools Overview (1)(1)
32
Arc Hydro Tools Overview Arc Hydro Tools Overview (2)(2)
• Distribution (version 1.1)Distribution (version 1.1)– A toolbar with packaged menus and buttonsA toolbar with packaged menus and buttons– Supporting documentation/helpSupporting documentation/help– ArcGIS 8.3 and ArcGIS 9/9.1 versionsArcGIS 8.3 and ArcGIS 9/9.1 versions– Licensing depends on functions usedLicensing depends on functions used
• ApUtilitiesApUtilities– Set of utilities common to most ArcObject-Set of utilities common to most ArcObject-
based applications developed at ESRI based applications developed at ESRI Professional Services in water resources areaProfessional Services in water resources area
• Public domainPublic domain– Maintained by Professional Services @ ESRIMaintained by Professional Services @ ESRI
33
Key ConceptsKey Concepts
• Transitions between the raster and vector Transitions between the raster and vector worlds – integrated operationsworlds – integrated operations
• ““Relationships between objects linked by Relationships between objects linked by tracing path of water movement”tracing path of water movement”
Raster NetworkVector
Logical SchemaExtended Network
34
• Arc Hydro MenusArc Hydro Menus– Terrain PreprocessingTerrain Preprocessing– Terrain MorphologyTerrain Morphology– Watershed ProcessingWatershed Processing– Attribute ToolsAttribute Tools– Network ToolsNetwork Tools– ApUtilitiesApUtilities– ButtonsButtons
Arc Hydro ToolsArc Hydro Tools
• ButtonsButtons– Flowpath tracingFlowpath tracing– Point delineationPoint delineation– Batch point generationBatch point generation– Assign related identifierAssign related identifier– Global point delineationGlobal point delineation– Trace by NextDownIDTrace by NextDownID
35
Arc Hydro Tools FacesArc Hydro Tools Faces
36
DemonstrationDemonstration
• Functionality available through core ArcGIS – Functionality available through core ArcGIS – take advantage of out-of-the-box functionalitytake advantage of out-of-the-box functionality– DomainsDomains– RelationshipsRelationships– TracingTracing
• Arc Hydro toolsArc Hydro tools
37
Arc Hydro in ActionArc Hydro in Action
• Various entities/applicationsVarious entities/applications– StreamStats (USGS)StreamStats (USGS)– Debris flow predictions (USGS)Debris flow predictions (USGS)– Map2Map (SARA)Map2Map (SARA)– GeoHMS/GeoRAS (HEC)GeoHMS/GeoRAS (HEC)– Engineering database design (SWFWMD)Engineering database design (SWFWMD)– Environmental modeling (SJRWMD)Environmental modeling (SJRWMD)– Hydroperiod (SFWMD)Hydroperiod (SFWMD)– Statewide database (OMNR)Statewide database (OMNR)– ……
• MeetingsMeetings• TrainingTraining
38
Many Aspects of Arc HydroMany Aspects of Arc Hydro
Saxe, John Godfrey, 1963, “The Blind Man and the elephant”, New York: Whittlesley House
Database design
Application
“Standard”
Tools
Marketing
Development environment
Elephant illustration ©2002 Jason Hunt www.naturalchild.org/jason
39
Where’s Arc Hydro?Where’s Arc Hydro?
• Hydro model page at: Hydro model page at: support.esri.com/datamodelssupport.esri.com/datamodels
• Arc Hydro home page at GIS Water Arc Hydro home page at GIS Water Resources Consortium at: Resources Consortium at: www.crwr.utexas.edu/giswr/hydrowww.crwr.utexas.edu/giswr/hydro
• Dr.Maidment’s home page at: Dr.Maidment’s home page at: www.ce.utexas.edu/prof/maidmentwww.ce.utexas.edu/prof/maidment
40
Data Model User GroupData Model User Group
• Check out:Check out:
http:/support.esri.com/datamodelshttp:/support.esri.com/datamodels
• Can be added to a data models user group list, Can be added to a data models user group list, and sent notifications about webcasts, training, and sent notifications about webcasts, training, publicationspublications
41
Arc Hydro IIArc Hydro II
• Additional database design componentsAdditional database design components– GroundwaterGroundwater– Time seriesTime series
• Updated “blue” bookUpdated “blue” book• Advanced Arc Hydro trainingAdvanced Arc Hydro training
42
Describing the Hydrologic CycleDescribing the Hydrologic Cycle
Flow
Time
Time Series
Flow
Time
Time Series
Flow
Time
Time Series
HydrographyHydrography
Hydro NetworkHydro Network
Channel SystemChannel System
Drainage SystemDrainage System
Hydrogeologic unit Borehole
Layers Solid
Atmospheric – Land surface
Arc Hydro surface water
Arc Hydro groundwater
HydrographyHydrography
Hydro NetworkHydro Network
Channel SystemChannel System
Drainage SystemDrainage System
Hydrogeologic unit Borehole
Layers Solid
Atmospheric – Land surface
HydrographyHydrography
Hydro NetworkHydro Network
Channel SystemChannel System
Drainage SystemDrainage System
HydrographyHydrography
Hydro NetworkHydro Network
Channel SystemChannel System
Drainage SystemDrainage System
Hydrogeologic unit Borehole
Layers Solid
Hydrogeologic unit Borehole
Layers Solid
Atmospheric – Land surface
Arc Hydro surface water
Arc Hydro groundwater
43
Review and Q & AReview and Q & A
• Data model and toolsData model and tools• Public domainPublic domain• EstablishedEstablished• Community developmentCommunity development• Documentation and trainingDocumentation and training
• Get involved !!!Get involved !!!