2011 feduc geodatabase essentials ii

55
Geodatabase Essentials Part II An Introduction to ArcSDE Geodatabases Tim Clark

Upload: letazz

Post on 07-Apr-2018

221 views

Category:

Documents


1 download

TRANSCRIPT

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 1/55

Geodatabase Essentials Part II

An Introduction to ArcSDEGeodatabases

Tim Clark

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 2/55

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 3/55

What is the Geodatabase?

• A physical store of geographic data

- Scalable storage model supported on different platforms

• Core ArcGIS data model

- A comprehensive model for representing and managingGIS data

• A transactional model for managing GIS workflows

• Set of COM components for accessing data

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 4/55

Geodatabase Data Management Approach

• The geodatabase is built on an extended relational database.

- Base relational model

- Base short transaction model- Relational integrity

- Reliability, Flexibility, Scalability

• Simple features + logic

- All geographic data stored as tables in a DBMS

- Functionality is consistent across DBMS’

- Extend functionality and data integrity

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 5/55

GeodatabaseGeodatabase Data Management ApproachData Management Approach……

• Editing and data compilation

- Rich set of editing tools

- Maintain spatial and attribute integrity

- Undo and redo edits

- Multiple users editing the same data

•• VersioningVersioning work flows- Long transactions

- Distributed data management

- Archiving

• Robust, customizable framework

- Build and manage your own specific GIS solution

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 6/55

Personal GDB File GDB ArcSDE GDB(3 editions)

Storage format MicrosoftAccess

Folder ofbinary files

DBMS

Storage capacity 2 GB 1 TB

per table*

Depends on

edition

Supported O/Splatform

Windows Any platform Depends onedition

Number of users Single editorMultiple readers Single editorMultiple readers Multiple editors& readers

Distributed GDBfunctionality

Check out/check inOne way

replication

Check out/check inOne way replication

Replication(all types)

& versioning

Three Types of Geodatabases

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 7/55

ArcSDE for ArcGISDesktop

ArcSDE for ArcGIS ServerWorkgroup

ArcSDE for ArcGISServer Enterprise

ArcGISProduct ArcGIS and DesktopEngine* ArcGIS Server Workgroup ArcGIS ServerEnterprise

Number ofusers

Max 3 users, 1 editor atany one time

Max 10 clients at one time

No limit to the number of

connections

Unlimited

SupportedDBMS

SQL Server Express 2005 SQL Server Express 2005 Oracle,SQL Server,DB2, Informix,PostGreSQL

Database limits Max database size 4 Gig1 GB RAM on a single cpu

Max database size 4 Gig1 GB RAM on a single cpu

No limits

Administration ArcGIS Desktop

(ArcCatalog)

ArcGIS Desktop

(ArcCatalog)

ArcGIS Desktop(ArcCatalog),

ArcSDE Commands,

DBMS admin software,

Which ArcSDE Geodatabase edition?

Scale from small, personal systems up to workgroups and very large enterprises

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 8/55

How is ArcSDE technology included in ArcGIS?

ArcSDEArcSDEGeodatabaseGeodatabase

A

Operating system

DBMS

ArcSDE

Geodatabase

ArcGIS

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 9/55

ArcSDE and the Geodatabase: Connection types

GeodatabaseGeodatabase

AppServer

GIS

client

Application Server (Three Tier)

Directconnectdriver

GIS

client

Direct Connect (Two Tier)

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 10/55

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 11/55

Session Path

• Introduction to ArcSDE Geodatabases

• Versioning

- What is it?

- Why Use Versioning?

• Editing

• Archiving

• Distributed Geodatabase

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 12/55

Versioning: What is it?

• Technology that allows multiple users to edit andview data at the same time

- Appears to users as if they have their own copy of a

table- Does not apply locks or duplicate data

Analyst

Default

Editors

Readers

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 13/55

Parks

•• An alternative view of the geodatabase that has:An alternative view of the geodatabase that has:

 –  – an owneran owner

 –  – a descriptiona description

 –  – a permissiona permission

 –  – a parent versiona parent version

•• Versions are not affected by changes occurringVersions are not affected by changes occurringin other versions of the databasein other versions of the database

What is a Version?

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 14/55

What is a Version?

Parks

•• An alternative view of the geodatabase that has:An alternative view of the geodatabase that has:

 –  – an owneran owner

 –  – a descriptiona description

 –  – a permissiona permission

 –  – a parent versiona parent version

•• Versions are not affected by changes occurringVersions are not affected by changes occurringin other versions of the databasein other versions of the database

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 15/55

Why Use Versioning?

• Multiple Editors Accessing Data

• Need Different Views of the Data

• Editing Complex Data (e.g. GeometricNetworks)

• Replication and Archiving

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 16/55

Why Use Versioning?...

• Model what-if scenarios

- Simulate situations with versions

AnalystPublic

Farmland Residential

• Editing with long transactions

- Isolate work across multiple sessions

- Edits do not impact others

FloodPublic

• Workflow management

- Create versions for project stages

A

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 17/55

Session Path

• Introduction to ArcSDE Geodatabases

• Versioning

• Editing

- Versioned Editing

- Reconcile and Post

- Non-Versioned Editing

- Editing through SQL

• Archiving• Distributed Geodatabase

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 18/55

Editing Geodatabases

• Short Transactions

- Small number of operations completed quickly

- E.g., ATM transactions, Library records, Timecards

- Concurrent transactions are isolated

• Long Transactions

- Large number of operations over a long time period

- E.g., Parcel updates, General geographic editing

- Multiuser editing without locking or data duplication

- Editors work with unique isolated view of thegeodatabase

• GIS editors need both short and long transactions

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 19/55

Three different ways of editing Geodatabases

• Versioned Editing (Long Transactions)

- Editing in a version through ArcGIS

• Non-Versioned Editing (Short Transactions)

- Editing the data directly through ArcGIS

• Editing through SQL (Short Transactions)

- Editing the data directly through SQL

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 20/55

Versioned Editing

• Versioned Edit Sessions

- Editing done through a version

- Support concurrent editing with long transactions

(hours/days).- Undo/redo editing experience.

- No locking or data extraction required.

Editor 1

ReadersWork OrderDesign

Default

Editor 2

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 21/55

How Versioning Works

• Class must be registered as Versioned

- Creates Adds and Deletes tables for tracking edits

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 22/55

How Versioning Works

• Adding Features

- Record added to the Adds Table

- Version will be referenced (SDE_State_ID Field)

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 23/55

How Versioning Works

• Deleting Features

- Record added to Deletes Table

- Version will be referenced (Deleted_At field)

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 24/55

How Versioning Works

• Updating Features

- Record added to both Adds and Deletes table

- Version will be referenced (SDE_State_ID Field)

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 25/55

How Versioning Works

• Versioned representation of a feature class

- combination of records in:

- Base Tables, Adds Tables & Deletes Tables

A

ArcGIS

Deletes Tables

Base TablesAdds Tables

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 26/55

Version Changes Viewer

• Ability to see what has changed in a version- View changes without having to do a reconcile

- Displays all changes in version with respect to

ancestor version

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 27/55

Versioned Editing – Reconcile and Post

• How can versions be merged?

• Through a process called reconcile and post

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 28/55

Versioned Editing – Reconcile

• Reconcile pulls any changes from the target version into

the edit version

• Any conflicts will be detected

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 29/55

Reconcile and Conflicts

• Versioning does not lock data when it is edited

- Because of this we must make sure data is not overwritten

- We do this through conflict detection during a reconcile

• A feature will be in conflict any time it has changed onboth versions

• Conflict Resolution Dialog

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 30/55

Reconcile and Conflicts

• Merge Geometry option for conflict management

- Improves the conflict management experience for:

- large polygon and polyline features

Target VersionEdit Version

Merge

Edit Version

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 31/55

Versioned Editing – Post

• Posting versions merges any changes in the edit version

into the target version

- After a post versions are identical

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 32/55

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 33/55

Versioned Editing - Move to Base

• Why would I use the move to base option?

- Want version editing experience but…

- Need to integrate with 3rd party applications

- Use of database constraints when editing DEFAULT version

Analyst

Default

ArcGIS

Editing 3rd PartyApplication

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 34/55

Non-Versioned Editing

• Directly editing the database tables

- Not editing in a version

- Uses a database transaction (short transaction)

- Designed for IT integration

- Suggested for Non-ESRI client interaction

- Database integrity rules

- Simple data only (Points, Lines, Polygons)- No Topology, Geometric Networks…etc

Editors Readers

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 35/55

SQL Editing

•• SQL can be used to update data directlySQL can be used to update data directly

•• Geometry editing possible through spatial typesGeometry editing possible through spatial types

•• What is a spatial type?What is a spatial type?

-- A database data type that stores spatial dataA database data type that stores spatial data

•• Why are they useful?Why are they useful?

-- ESRI Client not necessary to edit dataESRI Client not necessary to edit data-- SQL access to geometriesSQL access to geometries

•• All supported databases have spatial typesAll supported databases have spatial types

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 36/55

Geodatabase Editing Summary

• Three ways to edit data

1. Versioned Editing (Long Transactions)

2. Non-Versioned Editing (Short Transactions)

3. Editing through SQL (Short Transactions)

• Which one do I use?

- Depends on behavior desired

- Short vs Long Transactions- Is data being accessed by non-ESRI applications?

- Are many editors editing the same data?

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 37/55

Versioned Editing Demo

• Versioned editing workflow

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 38/55

Session Path

• Introduction to ArcSDE Geodatabases

• Versioning- What is it?

- How is it used?

• Editing

• Archiving

- What is it?

- How is it used?

• Distributed Geodatabase

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 39/55

Geodatabase Archiving: What is it?

• Historical archiving of all edits made to theDefault version

- Maintain a record of a feature classesrepresentation over time

• Ability to query historical representationsof a feature

- Archives can be queried based on date

information

• Extends versioning

- Classes must be versioned before they can

be archive enabled

TimeTime

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 40/55

Geodatabase Archiving: How it works

• Class must be enabled for archiving

- This creates an archive table in the geodatabase

- Size of archive table depends on size of class being

archived

F T

Archive Table

EnableArchiving

Base Table

Delta Tables

AddsDeletes

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 41/55

Geodatabase Archiving: How it works

•• When edits are made on the Default versionWhen edits are made on the Default version

•• These changes are added to the archive tableThese changes are added to the archive table

A

F T

Archive TableBase Table

Delta Tables

Adds

Deletes

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 42/55

Geodatabase Archiving: How it works

• Archive table is used to satisfy historical queries

• Can navigate through history in two ways

- Through specific date query

- Through historical marker

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 43/55

Session Path

• Introduction to ArcSDE Geodatabases

• Versioning• Editing

• Archiving

• Distributed Geodatabase- Data Distribution and Geodatabase Replication

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 44/55

Geodatabase Replication

• Distribute data across 2 or more Geodatabases

• Geodatabases are edited independently and synchronizedwhen needed

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 45/55

Distributed Geodatabase Use Cases

Regional Offices

OfficeOffice

Office

OfficeOffice

Office

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 46/55

Distributed Geodatabase Use Cases

Mobile Users

CentralOffice

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 47/55

Distributed Geodatabase Use Cases

Multiple levels

CentralOffice

RegionalOffice

RegionalOffice

RegionalOffice

Local

Office

Local

Office

Local

Office

Local

Office

Local

Office

Local

Office

Local

Office

Local

Office

Local

Office

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 48/55

Distributed Geodatabase Use Cases

Production / Publication

PublicationGeodatabase

ArcGISServer

Readers

ProductionGeodatabase

Editors

ETL

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 49/55

Geodatabase Replication - Concepts

• You can replicate :- A specific version

- Specific datasets

- A subset of features in the chosen datasets

Source

Target

ParentParent Replica_AReplica_A

ChildChild Replica_AReplica_A

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 50/55

Types of Replicas

Two-way

Multiple times

editsChild

geodatabase

Parentgeodatabase

Check out/ Check in

Once only

editsChild

geodatabaseParent

geodatabase

One-way

Multiple times

edits

Childgeodatabase

Parentgeodatabase OROR

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 51/55

Types of Replicas

• Source must always be an ArcSDE geodatabase

• Target can be an ArcSDE geodatabase for all types

• Target can also be file or personal geodatabase

- 1 way replicas

- check-out / check in replicas

• 1 way replicas in ArcGIS 10

- 1 way child to parent replication

- Use archiving to track changes

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 52/55

Replication - Concepts

• Connected and Disconnected environment

• Desktop commands, GP Tools and SDK provided

• Synchronization is:

- Based on exchanging messages

- fault tolerant

• Can apply schema changes across replicas- Subset of schema changes are supported

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 53/55

Geodatabase Replication - LAN and WAN

• LAN - connects to local geodatabases

• WAN – connects to remote geodatabases (geodataservices on ArcGIS server)

• All replication workflows supported in bothenvironments

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 54/55

Replication Demo

8/6/2019 2011 Feduc Geodatabase Essentials II

http://slidepdf.com/reader/full/2011-feduc-geodatabase-essentials-ii 55/55

Thanks for attendingQuestions?