2011 feduc geodatabase essentials ii
TRANSCRIPT
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 1/55
Geodatabase Essentials Part II
An Introduction to ArcSDEGeodatabases
Tim Clark
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 2/55
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 3/55
What is the Geodatabase?
• A physical store of geographic data
- Scalable storage model supported on different platforms
• Core ArcGIS data model
- A comprehensive model for representing and managingGIS data
• A transactional model for managing GIS workflows
• Set of COM components for accessing data
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 4/55
Geodatabase Data Management Approach
• The geodatabase is built on an extended relational database.
- Base relational model
- Base short transaction model- Relational integrity
- Reliability, Flexibility, Scalability
• Simple features + logic
- All geographic data stored as tables in a DBMS
- Functionality is consistent across DBMS’
- Extend functionality and data integrity
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 5/55
GeodatabaseGeodatabase Data Management ApproachData Management Approach……
• Editing and data compilation
- Rich set of editing tools
- Maintain spatial and attribute integrity
- Undo and redo edits
- Multiple users editing the same data
•• VersioningVersioning work flows- Long transactions
- Distributed data management
- Archiving
• Robust, customizable framework
- Build and manage your own specific GIS solution
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 6/55
Personal GDB File GDB ArcSDE GDB(3 editions)
Storage format MicrosoftAccess
Folder ofbinary files
DBMS
Storage capacity 2 GB 1 TB
per table*
Depends on
edition
Supported O/Splatform
Windows Any platform Depends onedition
Number of users Single editorMultiple readers Single editorMultiple readers Multiple editors& readers
Distributed GDBfunctionality
Check out/check inOne way
replication
Check out/check inOne way replication
Replication(all types)
& versioning
Three Types of Geodatabases
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 7/55
ArcSDE for ArcGISDesktop
ArcSDE for ArcGIS ServerWorkgroup
ArcSDE for ArcGISServer Enterprise
ArcGISProduct ArcGIS and DesktopEngine* ArcGIS Server Workgroup ArcGIS ServerEnterprise
Number ofusers
Max 3 users, 1 editor atany one time
Max 10 clients at one time
No limit to the number of
connections
Unlimited
SupportedDBMS
SQL Server Express 2005 SQL Server Express 2005 Oracle,SQL Server,DB2, Informix,PostGreSQL
Database limits Max database size 4 Gig1 GB RAM on a single cpu
Max database size 4 Gig1 GB RAM on a single cpu
No limits
Administration ArcGIS Desktop
(ArcCatalog)
ArcGIS Desktop
(ArcCatalog)
ArcGIS Desktop(ArcCatalog),
ArcSDE Commands,
DBMS admin software,
Which ArcSDE Geodatabase edition?
Scale from small, personal systems up to workgroups and very large enterprises
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 8/55
How is ArcSDE technology included in ArcGIS?
ArcSDEArcSDEGeodatabaseGeodatabase
A
Operating system
DBMS
ArcSDE
Geodatabase
ArcGIS
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 9/55
ArcSDE and the Geodatabase: Connection types
GeodatabaseGeodatabase
AppServer
GIS
client
Application Server (Three Tier)
Directconnectdriver
GIS
client
Direct Connect (Two Tier)
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 10/55
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 11/55
Session Path
• Introduction to ArcSDE Geodatabases
• Versioning
- What is it?
- Why Use Versioning?
• Editing
• Archiving
• Distributed Geodatabase
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 12/55
Versioning: What is it?
• Technology that allows multiple users to edit andview data at the same time
- Appears to users as if they have their own copy of a
table- Does not apply locks or duplicate data
Analyst
Default
Editors
Readers
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 13/55
Parks
•• An alternative view of the geodatabase that has:An alternative view of the geodatabase that has:
– – an owneran owner
– – a descriptiona description
– – a permissiona permission
– – a parent versiona parent version
•• Versions are not affected by changes occurringVersions are not affected by changes occurringin other versions of the databasein other versions of the database
What is a Version?
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 14/55
What is a Version?
Parks
•• An alternative view of the geodatabase that has:An alternative view of the geodatabase that has:
– – an owneran owner
– – a descriptiona description
– – a permissiona permission
– – a parent versiona parent version
•• Versions are not affected by changes occurringVersions are not affected by changes occurringin other versions of the databasein other versions of the database
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 15/55
Why Use Versioning?
• Multiple Editors Accessing Data
• Need Different Views of the Data
• Editing Complex Data (e.g. GeometricNetworks)
• Replication and Archiving
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 16/55
Why Use Versioning?...
• Model what-if scenarios
- Simulate situations with versions
AnalystPublic
Farmland Residential
• Editing with long transactions
- Isolate work across multiple sessions
- Edits do not impact others
FloodPublic
• Workflow management
- Create versions for project stages
A
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 17/55
Session Path
• Introduction to ArcSDE Geodatabases
• Versioning
• Editing
- Versioned Editing
- Reconcile and Post
- Non-Versioned Editing
- Editing through SQL
• Archiving• Distributed Geodatabase
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 18/55
Editing Geodatabases
• Short Transactions
- Small number of operations completed quickly
- E.g., ATM transactions, Library records, Timecards
- Concurrent transactions are isolated
• Long Transactions
- Large number of operations over a long time period
- E.g., Parcel updates, General geographic editing
- Multiuser editing without locking or data duplication
- Editors work with unique isolated view of thegeodatabase
• GIS editors need both short and long transactions
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 19/55
Three different ways of editing Geodatabases
• Versioned Editing (Long Transactions)
- Editing in a version through ArcGIS
• Non-Versioned Editing (Short Transactions)
- Editing the data directly through ArcGIS
• Editing through SQL (Short Transactions)
- Editing the data directly through SQL
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 20/55
Versioned Editing
• Versioned Edit Sessions
- Editing done through a version
- Support concurrent editing with long transactions
(hours/days).- Undo/redo editing experience.
- No locking or data extraction required.
Editor 1
ReadersWork OrderDesign
Default
Editor 2
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 21/55
How Versioning Works
• Class must be registered as Versioned
- Creates Adds and Deletes tables for tracking edits
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 22/55
How Versioning Works
• Adding Features
- Record added to the Adds Table
- Version will be referenced (SDE_State_ID Field)
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 23/55
How Versioning Works
• Deleting Features
- Record added to Deletes Table
- Version will be referenced (Deleted_At field)
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 24/55
How Versioning Works
• Updating Features
- Record added to both Adds and Deletes table
- Version will be referenced (SDE_State_ID Field)
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 25/55
How Versioning Works
• Versioned representation of a feature class
- combination of records in:
- Base Tables, Adds Tables & Deletes Tables
A
ArcGIS
Deletes Tables
Base TablesAdds Tables
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 26/55
Version Changes Viewer
• Ability to see what has changed in a version- View changes without having to do a reconcile
- Displays all changes in version with respect to
ancestor version
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 27/55
Versioned Editing – Reconcile and Post
• How can versions be merged?
• Through a process called reconcile and post
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 28/55
Versioned Editing – Reconcile
• Reconcile pulls any changes from the target version into
the edit version
• Any conflicts will be detected
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 29/55
Reconcile and Conflicts
• Versioning does not lock data when it is edited
- Because of this we must make sure data is not overwritten
- We do this through conflict detection during a reconcile
• A feature will be in conflict any time it has changed onboth versions
• Conflict Resolution Dialog
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 30/55
Reconcile and Conflicts
• Merge Geometry option for conflict management
- Improves the conflict management experience for:
- large polygon and polyline features
Target VersionEdit Version
Merge
Edit Version
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 31/55
Versioned Editing – Post
• Posting versions merges any changes in the edit version
into the target version
- After a post versions are identical
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 32/55
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 33/55
Versioned Editing - Move to Base
• Why would I use the move to base option?
- Want version editing experience but…
- Need to integrate with 3rd party applications
- Use of database constraints when editing DEFAULT version
Analyst
Default
ArcGIS
Editing 3rd PartyApplication
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 34/55
Non-Versioned Editing
• Directly editing the database tables
- Not editing in a version
- Uses a database transaction (short transaction)
- Designed for IT integration
- Suggested for Non-ESRI client interaction
- Database integrity rules
- Simple data only (Points, Lines, Polygons)- No Topology, Geometric Networks…etc
Editors Readers
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 35/55
SQL Editing
•• SQL can be used to update data directlySQL can be used to update data directly
•• Geometry editing possible through spatial typesGeometry editing possible through spatial types
•• What is a spatial type?What is a spatial type?
-- A database data type that stores spatial dataA database data type that stores spatial data
•• Why are they useful?Why are they useful?
-- ESRI Client not necessary to edit dataESRI Client not necessary to edit data-- SQL access to geometriesSQL access to geometries
•• All supported databases have spatial typesAll supported databases have spatial types
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 36/55
Geodatabase Editing Summary
• Three ways to edit data
1. Versioned Editing (Long Transactions)
2. Non-Versioned Editing (Short Transactions)
3. Editing through SQL (Short Transactions)
• Which one do I use?
- Depends on behavior desired
- Short vs Long Transactions- Is data being accessed by non-ESRI applications?
- Are many editors editing the same data?
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 37/55
Versioned Editing Demo
• Versioned editing workflow
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 38/55
Session Path
• Introduction to ArcSDE Geodatabases
• Versioning- What is it?
- How is it used?
• Editing
• Archiving
- What is it?
- How is it used?
• Distributed Geodatabase
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 39/55
Geodatabase Archiving: What is it?
• Historical archiving of all edits made to theDefault version
- Maintain a record of a feature classesrepresentation over time
• Ability to query historical representationsof a feature
- Archives can be queried based on date
information
• Extends versioning
- Classes must be versioned before they can
be archive enabled
TimeTime
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 40/55
Geodatabase Archiving: How it works
• Class must be enabled for archiving
- This creates an archive table in the geodatabase
- Size of archive table depends on size of class being
archived
F T
Archive Table
EnableArchiving
Base Table
Delta Tables
AddsDeletes
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 41/55
Geodatabase Archiving: How it works
•• When edits are made on the Default versionWhen edits are made on the Default version
•• These changes are added to the archive tableThese changes are added to the archive table
A
F T
Archive TableBase Table
Delta Tables
Adds
Deletes
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 42/55
Geodatabase Archiving: How it works
• Archive table is used to satisfy historical queries
• Can navigate through history in two ways
- Through specific date query
- Through historical marker
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 43/55
Session Path
• Introduction to ArcSDE Geodatabases
• Versioning• Editing
• Archiving
• Distributed Geodatabase- Data Distribution and Geodatabase Replication
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 44/55
Geodatabase Replication
• Distribute data across 2 or more Geodatabases
• Geodatabases are edited independently and synchronizedwhen needed
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 45/55
Distributed Geodatabase Use Cases
Regional Offices
OfficeOffice
Office
OfficeOffice
Office
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 46/55
Distributed Geodatabase Use Cases
Mobile Users
CentralOffice
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 47/55
Distributed Geodatabase Use Cases
Multiple levels
CentralOffice
RegionalOffice
RegionalOffice
RegionalOffice
Local
Office
Local
Office
Local
Office
Local
Office
Local
Office
Local
Office
Local
Office
Local
Office
Local
Office
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 48/55
Distributed Geodatabase Use Cases
Production / Publication
PublicationGeodatabase
ArcGISServer
Readers
ProductionGeodatabase
Editors
ETL
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 49/55
Geodatabase Replication - Concepts
• You can replicate :- A specific version
- Specific datasets
- A subset of features in the chosen datasets
Source
Target
ParentParent Replica_AReplica_A
ChildChild Replica_AReplica_A
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 50/55
Types of Replicas
Two-way
Multiple times
editsChild
geodatabase
Parentgeodatabase
Check out/ Check in
Once only
editsChild
geodatabaseParent
geodatabase
One-way
Multiple times
edits
Childgeodatabase
Parentgeodatabase OROR
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 51/55
Types of Replicas
• Source must always be an ArcSDE geodatabase
• Target can be an ArcSDE geodatabase for all types
• Target can also be file or personal geodatabase
- 1 way replicas
- check-out / check in replicas
• 1 way replicas in ArcGIS 10
- 1 way child to parent replication
- Use archiving to track changes
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 52/55
Replication - Concepts
• Connected and Disconnected environment
• Desktop commands, GP Tools and SDK provided
• Synchronization is:
- Based on exchanging messages
- fault tolerant
• Can apply schema changes across replicas- Subset of schema changes are supported
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 53/55
Geodatabase Replication - LAN and WAN
• LAN - connects to local geodatabases
• WAN – connects to remote geodatabases (geodataservices on ArcGIS server)
• All replication workflows supported in bothenvironments
8/6/2019 2011 Feduc Geodatabase Essentials II
http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 54/55
Replication Demo