arc hydro in florida: core principles and collaboration overview of arc hydro concepts dean djokic,...

Arc Hydro in Florida:Arc Hydro in Florida:Core Principles and CollaborationCore Principles and Collaboration

Overview of Arc Hydro ConceptsOverview of Arc Hydro Concepts

Dean Djokic, ESRIDean Djokic, ESRINovember 4, 2005November 4, 2005

2

AgendaAgenda

• Overview of data model purpose Overview of data model purpose • Template model overviewTemplate model overview• Selected design topics and toolsSelected design topics and tools• Arc Hydro II special topicsArc Hydro II special topics• DiscussionDiscussion

3

• Adding shapefiles and coverages into an Adding shapefiles and coverages into an ArcMap session does not make a geodatabaseArcMap session does not make a geodatabase

• Loading shapefiles and coverages into a Loading shapefiles and coverages into a geodatabase does not make a (efficient) geodatabase does not make a (efficient) geodatabase.geodatabase.

• Ignoring geodatabase capabilities increases Ignoring geodatabase capabilities increases cost of development and ownershipcost of development and ownership

• When developing data, ignore spatial reference When developing data, ignore spatial reference issues at your own perilissues at your own peril

• SDE and versioning (including disconnected SDE and versioning (including disconnected editing) do not replace the need for careful editing) do not replace the need for careful workflow developmentworkflow development

Review of Review of geodatabasegeodatabase issues issues

4

How “Things” Build UpHow “Things” Build Up

• Database developmentDatabase development• Data preparationData preparation• Terrain preparationTerrain preparation• ““Watershed” delineationWatershed” delineation• ““Watershed” characterizationWatershed” characterization

• ParameterizationParameterization

• Model pre and post-processingModel pre and post-processing

Generic

Semi-Generic

Model Specific

5

Arc HydroArc HydroTemplate Data ModelTemplate Data Model

6

Parcel …Arc Hydro

Template Data Models

HEC …FEMA

Project Data Models

Feature TopologyObject

ArcGIS Core Data Model

OGC

FGDC

ISO

GIS/IT Standards

Industry

Templates Templates Provide an Provide an Important Important

Link Link Between Between Project Project Teams, Teams,

Standards, Standards, and ESRI and ESRI Software Software

DevelopmentDevelopment

Template Data ModelsTemplate Data Models

7

Arc HydroArc Hydro

• Extension of geodatabase model for support Extension of geodatabase model for support of water resources applications (template of water resources applications (template data model)data model)

• Culmination of a three year process led by Culmination of a three year process led by D.R. Maidment through GIS in Water D.R. Maidment through GIS in Water Resources Consortium (Arc Hydro book)Resources Consortium (Arc Hydro book)

• Collection of tools for support of Arc Hydro Collection of tools for support of Arc Hydro geodatabase design and basic water geodatabase design and basic water resources functionsresources functions

• Starting pointStarting point for water resources database for water resources database and application developmentand application development

8

Basic idea: Transition from …Basic idea: Transition from …

Streams

Drainage Areas

Hydrography

Channels

Terrain Surfaces

Rainfall Response

Digital Orthophotos

Data Model Based on Inventory

9

… … and …and …

Follow a drop of water from where it falls on the land, to the stream, and all the way to the ocean.

Data Model Based on Behavior

10

… … to Arc Hydro Data Modelto Arc Hydro Data Model

Relationships betweenobjects linked by tracing pathof water movement

Integrate Data Inventory using a Behavioral Model

11

Basic ConceptsBasic Concepts

• Define core feature classes for water resources Define core feature classes for water resources analysesanalyses

• Establish relationships between core feature Establish relationships between core feature classesclasses

• Use geometric network for tying pieces togetherUse geometric network for tying pieces together• Mobilization of standard ArcGIS functionalityMobilization of standard ArcGIS functionality• Custom tools for some of the attribute Custom tools for some of the attribute

managementmanagement• Custom tools for advanced “water resources” Custom tools for advanced “water resources”

functionalityfunctionality

12

Data Model PurposeData Model Purpose

• Target audience: Water resources (surface) Target audience: Water resources (surface) community interested in quick start in ArcGIS community interested in quick start in ArcGIS implementationimplementation

• Starting point for project model designStarting point for project model design• Not a “do all” designNot a “do all” design• Not implementation/application specific, but Not implementation/application specific, but

provides the key components to develop on provides the key components to develop on top oftop of

13

Arc Hydro

Template Data Model ApproachesTemplate Data Model Approaches

Floodplain WQ

Permitting

Water Resources

14

Thematic ContentThematic Content

15

Arc Hydro Database DefinitionArc Hydro Database Definition

• A geospatial and temporal data model for water A geospatial and temporal data model for water resources that operates within ArcGISresources that operates within ArcGIS

• Five key conceptual areasFive key conceptual areas– DrainageDrainage - - Drainage areas and stream lines Drainage areas and stream lines

defined from surface topographydefined from surface topography– Flow networkFlow network - - Connected sets of points and Connected sets of points and

lines showing pathways of water flowlines showing pathways of water flow– HydrographyHydrography - - The base data from topographic The base data from topographic

maps and tabular data inventoriesmaps and tabular data inventories– Channel descriptionChannel description - - A 3-D line representation A 3-D line representation

of the shape of river and stream channelsof the shape of river and stream channels– Time seriesTime series - - Tabular attribute data describing Tabular attribute data describing

time-varying water properties for any hydro time-varying water properties for any hydro featurefeature

16

Arc Hydro Data ModelArc Hydro Data Model

17

Arc Hydro Data Model DetailsArc Hydro Data Model Details

• Detailed representation at the end of Detailed representation at the end of corresponding chapters in the book (e.g. p 51)corresponding chapters in the book (e.g. p 51)

18

19

Arc Hydro Key FieldsArc Hydro Key Fields

• Few predefined fields/attributesFew predefined fields/attributes– Identification/relatesIdentification/relates

• HydroID, NextDownID, DrainID, JunctionID, FeatureID, HydroID, NextDownID, DrainID, JunctionID, FeatureID, ……

• HydroCode, ReachCode, CSCode, …HydroCode, ReachCode, CSCode, …

– MeasuresMeasures• LengthKm, AreaSqKmLengthKm, AreaSqKm• LengthDown, DrainAreaLengthDown, DrainArea

– AuxiliaryAuxiliary• FType, Name, Flowdir, …FType, Name, Flowdir, …

20

HydroID StoryHydroID Story

• HydroID – a unique integer identifier for HydroID – a unique integer identifier for every feature within a geodatabaseevery feature within a geodatabase

• An An internalinternal identifier whose value is used for identifier whose value is used for establishing the relationships within the Arc establishing the relationships within the Arc Hydro data model (HydroID, DrainID, Hydro data model (HydroID, DrainID, NextDownID, JunctionID, …)NextDownID, JunctionID, …)

• Focus on local (within a geodatabase) Focus on local (within a geodatabase) uniqueness, but can be made globaluniqueness, but can be made global

21

HydroCode StoryHydroCode Story

22

RelationshipsRelationships

• Establish a formal (geodatabase) Establish a formal (geodatabase) relationship between two feature (object) relationship between two feature (object) classes using predefined ID properties.classes using predefined ID properties.– HydroID-based (e.g. NextDownID, HydroID-based (e.g. NextDownID,

JunctionID, DrainID)JunctionID, DrainID)• ““HydroJunctionHasWaterbody”HydroJunctionHasWaterbody”• ““HydroJunctionHasWatershed”HydroJunctionHasWatershed”• ““HydroJunctionHasMonitoringPoint”HydroJunctionHasMonitoringPoint”• ““MonitoringPointHasTimeSeries”MonitoringPointHasTimeSeries”

23

RelationshipsRelationships (an example – “HydroJunctionHasWaterbody” - definition) (an example – “HydroJunctionHasWaterbody” - definition)

24

Connecting to Time SeriesConnecting to Time Series

HydroID

CrossSectionHydroPoint

DrainagePoint Junction

TimeSeries

Time

Flow

FeatureID

FeatureID of time seriesis HydroID of the feature the time series describes

25

Time Series Data StructureTime Series Data Structure

26

Time Series DilemmaTime Series Dilemma

• Simplicity in structureSimplicity in structure– Easy to import and export time series data from Easy to import and export time series data from

other sourcesother sources– Easy to use standard ArcGIS tabular functionality Easy to use standard ArcGIS tabular functionality

and SQL statementsand SQL statements– Needs “transposition” for efficient use for rendering Needs “transposition” for efficient use for rendering

data spatial datadata spatial data– Large table with potentially millions of recordsLarge table with potentially millions of records– Inefficient storage of specific types of temporal data Inefficient storage of specific types of temporal data

(many to many case)(many to many case)– ……

• Need more flexibility (but at a cost of Need more flexibility (but at a cost of complexity)complexity)

27

Hydro NetworkHydro Network

• Backbone of Arc Hydro - establishes Backbone of Arc Hydro - establishes connectivity between core feature classesconnectivity between core feature classes

• Hydro edges (lines through which water flows) Hydro edges (lines through which water flows) and junctions (confluences, other points of and junctions (confluences, other points of interest)interest)

• Other feature classes connected to junctions Other feature classes connected to junctions through relationships (e.g. through relationships (e.g. HydroJunctionHasWatershed)HydroJunctionHasWatershed)

• Allows upstream/downstream tracing (and Allows upstream/downstream tracing (and other out of box ArcGIS network functionality)other out of box ArcGIS network functionality)

28

Hydro NetworkHydro Network

29

Extending Arc Hydro Data ModelExtending Arc Hydro Data Model

• Arc Hydro is by design a starting point for Arc Hydro is by design a starting point for complex database design complex database design

• Arc Hydro data model can be extended Arc Hydro data model can be extended with additional feature classes and/or with additional feature classes and/or attributes (or some Arc Hydro feature attributes (or some Arc Hydro feature classes can be ignored)classes can be ignored)

• Use additional GIS data sources (GRID & Use additional GIS data sources (GRID & TIN)TIN)

• Use all existing IDs and tools to minimize Use all existing IDs and tools to minimize duplication of effortduplication of effort

30

Extending Arc Hydro Data ModelExtending Arc Hydro Data Model

More application specific “stuff”

31

• A set of tools that “exercises” the Arc Hydro A set of tools that “exercises” the Arc Hydro modelmodel– Integral with standard ArcGIS functionalityIntegral with standard ArcGIS functionality

• Key field (property) managementKey field (property) management– HydroID & related IDsHydroID & related IDs– Length/Area measuresLength/Area measures

• Core functionsCore functions– DEM-based watershed delineationDEM-based watershed delineation– Network generationNetwork generation– Attribute and network tracing and summary Attribute and network tracing and summary

operationsoperations

Arc Hydro Tools Overview Arc Hydro Tools Overview (1)(1)

32

Arc Hydro Tools Overview Arc Hydro Tools Overview (2)(2)

• Distribution (version 1.1)Distribution (version 1.1)– A toolbar with packaged menus and buttonsA toolbar with packaged menus and buttons– Supporting documentation/helpSupporting documentation/help– ArcGIS 8.3 and ArcGIS 9/9.1 versionsArcGIS 8.3 and ArcGIS 9/9.1 versions– Licensing depends on functions usedLicensing depends on functions used

• ApUtilitiesApUtilities– Set of utilities common to most ArcObject-Set of utilities common to most ArcObject-

based applications developed at ESRI based applications developed at ESRI Professional Services in water resources areaProfessional Services in water resources area

• Public domainPublic domain– Maintained by Professional Services @ ESRIMaintained by Professional Services @ ESRI

33

Key ConceptsKey Concepts

• Transitions between the raster and vector Transitions between the raster and vector worlds – integrated operationsworlds – integrated operations

• ““Relationships between objects linked by Relationships between objects linked by tracing path of water movement”tracing path of water movement”

Raster NetworkVector

Logical SchemaExtended Network

34

• Arc Hydro MenusArc Hydro Menus– Terrain PreprocessingTerrain Preprocessing– Terrain MorphologyTerrain Morphology– Watershed ProcessingWatershed Processing– Attribute ToolsAttribute Tools– Network ToolsNetwork Tools– ApUtilitiesApUtilities– ButtonsButtons

Arc Hydro ToolsArc Hydro Tools

• ButtonsButtons– Flowpath tracingFlowpath tracing– Point delineationPoint delineation– Batch point generationBatch point generation– Assign related identifierAssign related identifier– Global point delineationGlobal point delineation– Trace by NextDownIDTrace by NextDownID

35

Arc Hydro Tools FacesArc Hydro Tools Faces

36

DemonstrationDemonstration

• Functionality available through core ArcGIS – Functionality available through core ArcGIS – take advantage of out-of-the-box functionalitytake advantage of out-of-the-box functionality– DomainsDomains– RelationshipsRelationships– TracingTracing

• Arc Hydro toolsArc Hydro tools

37

Arc Hydro in ActionArc Hydro in Action

• Various entities/applicationsVarious entities/applications– StreamStats (USGS)StreamStats (USGS)– Debris flow predictions (USGS)Debris flow predictions (USGS)– Map2Map (SARA)Map2Map (SARA)– GeoHMS/GeoRAS (HEC)GeoHMS/GeoRAS (HEC)– Engineering database design (SWFWMD)Engineering database design (SWFWMD)– Environmental modeling (SJRWMD)Environmental modeling (SJRWMD)– Hydroperiod (SFWMD)Hydroperiod (SFWMD)– Statewide database (OMNR)Statewide database (OMNR)– ……

• MeetingsMeetings• TrainingTraining

38

Many Aspects of Arc HydroMany Aspects of Arc Hydro

Saxe, John Godfrey, 1963, “The Blind Man and the elephant”, New York: Whittlesley House

Database design

Application

“Standard”

Tools

Marketing

Development environment

Elephant illustration ©2002 Jason Hunt www.naturalchild.org/jason

39

Where’s Arc Hydro?Where’s Arc Hydro?

• Hydro model page at: Hydro model page at: support.esri.com/datamodelssupport.esri.com/datamodels

• Arc Hydro home page at GIS Water Arc Hydro home page at GIS Water Resources Consortium at: Resources Consortium at: www.crwr.utexas.edu/giswr/hydrowww.crwr.utexas.edu/giswr/hydro

• Dr.Maidment’s home page at: Dr.Maidment’s home page at: www.ce.utexas.edu/prof/maidmentwww.ce.utexas.edu/prof/maidment

40

Data Model User GroupData Model User Group

• Check out:Check out:

http:/support.esri.com/datamodelshttp:/support.esri.com/datamodels

• Can be added to a data models user group list, Can be added to a data models user group list, and sent notifications about webcasts, training, and sent notifications about webcasts, training, publicationspublications

41

Arc Hydro IIArc Hydro II

• Additional database design componentsAdditional database design components– GroundwaterGroundwater– Time seriesTime series

• Updated “blue” bookUpdated “blue” book• Advanced Arc Hydro trainingAdvanced Arc Hydro training

42

Describing the Hydrologic CycleDescribing the Hydrologic Cycle

Flow

Time

Time Series

Flow

Time

Time Series

Flow

Time

Time Series

HydrographyHydrography

Hydro NetworkHydro Network

Channel SystemChannel System

Drainage SystemDrainage System

Hydrogeologic unit Borehole

Layers Solid

Atmospheric – Land surface

Arc Hydro surface water

Arc Hydro groundwater

HydrographyHydrography

Hydro NetworkHydro Network

Channel SystemChannel System

Drainage SystemDrainage System

Hydrogeologic unit Borehole

Layers Solid

Atmospheric – Land surface

HydrographyHydrography

Hydro NetworkHydro Network

Channel SystemChannel System

Drainage SystemDrainage System

HydrographyHydrography

Hydro NetworkHydro Network

Channel SystemChannel System

Drainage SystemDrainage System

Hydrogeologic unit Borehole

Layers Solid

Hydrogeologic unit Borehole

Layers Solid

Atmospheric – Land surface

Arc Hydro surface water

Arc Hydro groundwater

43

Review and Q & AReview and Q & A

• Data model and toolsData model and tools• Public domainPublic domain• EstablishedEstablished• Community developmentCommunity development• Documentation and trainingDocumentation and training

• Get involved !!!Get involved !!!