road ahead: linear referencing and updm · data model network management pipeline data management...
TRANSCRIPT
Road Ahead:
Linear Referencing and UPDM
Esri European Petroleum GIS Conference
November 7, 2014 | Congress Centre, London
Your Work
Making a Difference
ArcGIS Is Evolving
Your GIS Is Becoming
Part of an Interconnected Platform
Bringing Together Data, Technology, and People . . .
. . . Creating a Framework for Solving Complex Problems
Apps
Desktop
Content,
Management &
HostingServer
The ArcGIS Platform for the Pipeline Industries
Platform Real-Time Location Referencing
Data Model Network Management
The ArcGIS Platform for the Pipeline Industries
Platform Real-Time Location Referencing
Data Model Network Management
Pipeline data
management
Linear referencing
Coordinate
referencing
The ArcGIS Platform for the Pipeline Industries
Platform Real-Time Location Referencing
Data Model Network Management
Wellhead to
customer meter or
delivery point
Each pipeline
component is a
single database
table object
The ArcGIS Platform for the Pipeline Industries
Platform Real-Time Location Referencing
Data Model Network Management
Performance
Improved
information model
New productivity
tools
Accessible across
the platform
ArcGIS Location Referencing
for Pipelines
ArcGIS Location Referencing for Pipelines
GIS-enabled LRS platform
Linear Referencing for the Pipeline Enterprise
LRS management
LRS editing & maintenance
LRS web services
Information model
Workflow
Quality control
GIS analysis
Mapping
Cloud collaboration
ArcGIS Location Referencing for Pipelines
GIS-enabled LRS platform
Web Event
Editing
Linear Referencing for the Pipeline Enterprise
ArcGIS Location Referencing for Pipelines
GIS-enabled LRS platform
Web Event
Editing
Measure and Location
Reporting
Linear Referencing for the Pipeline Enterprise
ArcGIS Location Referencing for Pipelines
GIS-enabled LRS platform
Partner
Solutions &
Services
HCA Analysis
Risk Assessment and Modeling
Transmission Distribution
Simulation and Optimization
ILI Analysis
Alignment Sheets Generators
Consulting & Data Migration
Engineering Pipeline Design
Maintenance Management and
Planning
…and more…
Web Event
Editing
Measure and Location
Reporting
Linear Referencing for the Pipeline Enterprise
• Desktop- ArcGIS Pro LRS network editing ribbon
- Route & event feature class support
- Geodatabase LRS dataset
- Geoprocessing tools
Comes with … Production Mapping
Data Reviewer
Workflow Manager
• Server- LRS web services
- Developer samples
- Pipeline Characteristics Editor
Product Overview
ArcGIS Pro Application Extension
• Next generation GIS desktop
• Higher LRS platform for migration
• 64 bit & multi-threaded
• Integrated 3D
• Multiple linked map views
• Context based experience
• Tasks for guided editing
Why ArcGIS Pro?
Highlighted Functionality
Current Future
1 Multi-LRM Support & Schema X
2 Editing X X
3 Rule-Based Location Management X
4 Stationing X
(required)
X
(opt.)
5 Expanded Pipeline-Specific Linear
Referencing
X
Centerline
LRS Network A
LRS Network B
Multi-LRM Support
• Route features are generated from centerline geometry and
calibration point measures
300
-545
• Two routes
• 3 Calibration
points
• 3 centerlines
The two routes above are derived
from three centerline lines
15
30
Route features are generated from two feature classes and two tables
Centerline
sequence
Key table for M-N relationship
between Centerline and Route.
Routes
Route definitions.
Calibration
points
Point feature class that stores
route measures.
Centerline
Line feature class that stores
route geometry.
1
M
N
1
M
1
Schema for route centerline management
Location Model
Highlighted Functionality
Current Future
1 Multi-LRM Support & Schema X
2 Editing X X
3 Rule-Based Location Management X
4 Stationing X
(required)
X
(opt.)
5 Expanded Pipeline-Specific Linear
Referencing
X
Route Editing Activities
• Create Route
• Extend Route
• Realign Route
• Reassign Route
• Retire Route
• Calibration
0 100
0 100
120
0100
retired
0 100
1-10retired
0 10052
20 80
20 80
20 80
I-110 I-10I-10
0 100
Can also serve to
split routes and
merge routes.
Network editing ribbon bar
ribbon tab only displays when location
referencing data in map
apply measure updates to events
impacted by route editschoose centerlines to
associate to routes
edit routes and route
measures
edit centerlines that
make up routes
identify measures and
search for routes
Customizable layout
• By default, location
referencing activity
dialogs will display
in the right hand
pane.
• Location of pane
can be customized
in ArcGIS Pro
Highlighted Functionality
Current Future
1 Multi-LRM Support & Schema X
2 Editing & Redlining X X
3 Rule-Based Location Management X
4 Stationing X
(required)
X
(opt.)
5 Expanded Pipeline-Specific Linear
Referencing
X
Event Measure Behaviors
Before Realignment
Stay Put
Move• When the LRS routes are
edited, measure behavior
rules can be applied to
events.
• Events can have a different
behavior for each type of
LRS edit
Retire
Highlighted Functionality
Current Future
1 Multi-LRM Support & Schema X
2 Editing & Redlining X X
3 Rule-Based Location Management X
4 Stationing X
(required)
X
(opt.)
5 Expanded Pipeline-Specific Linear
Referencing
X
Pipeline Stationing - Example
00+00 200+0050+00 100+00 150+00
Stationing is an “address” along the pipeline. Here is a pipeline
that is 20,000 ft. in length with stations shown each 5,000 ft.
Pipeline Stationing - Example
Here’s the same pipeline after a reroute that added a new section
of pipe 2,000 ft. longer than the original section of pipe that was
abandoned or reclaimed. “Station equations” are used to equate
stationing between two adjacent surveys. The upstream tie-in for
the reroute is at 50+00. The downstream tie-in for the reroute is
170+00 (back) and 150+00 (ahead).
00+00 200+0050+00 100+00 150+00
100+00 150+00
Station Equation
Back 170+00
Ahead 150+00
170+00
Credit: New Century Software / PODS 101 Workshop
Stationing
• Manage station equations as events
- Coordinate locations, with route and measure
- Edit from Pipeline Characteristic Editor
- Support stationing without a stationing network
• 3 ways to input station measures …
- Offsetting on stationing event layer
- Providing temporary starting station location
- Selecting starting station to offset from
… if station location ambiguous due to equations,
user prompted for which map location is desired.
Engineering Stationing
is Supported, but
is not Required.
Highlighted Functionality
Current Future
1 Multi-LRM Support & Schema X
2 Editing & Redlining X X
3 Rule-Based Location Management X
4 Stationing X
(required)
X
(opt.)
5 Expanded Pipeline-Specific Linear
Referencing
X
Linear events spanning routes
10507003500
Engineering
Station
Series
1000 2000 3000
300
Continuous
Station SeriesA
300
350
300 600
500
0 450
650 1000
Gas HCA Segment
Credit: Eagle Information Mapping
Base event location model
• Events columns
- Event ID
- From Route ID
- From Measure
- To Route ID (if event spans routes)
- To Measure (if linear event)
- From Date
- To Date
- Location Error
Highlighted Functionality
Current Future
6 Flexibility in Event Location Referencing X
7 Temporality X
8 Geoprocessing Tools X X
9 Measure-Based Reporting for Decision-
Makers
X
10 Linear Referencing Web Services X
11 Pipeline Characteristics Editor X
Flexibility in event location referencing
• Route and measure
• Stationing
• Referent and offset
- Intersections
- Events
- Features
• Coordinates and offset
• …with intersection creation
support
Event:
1.27 miles
Event:
456+25.00
Calibration Point:
1 mile
Station Event:
100+00.00
Event:
300 feet from US Highway 10Intersection Features
US Highway 10 crossing
Event:
45 feet from cell tower
Cell tower location:
34.0547,117.1825
Referent event location model
• Events columns
- Referent method
- Referent location
- Referent offset
• Linear events maintain From
and To reference columns
EventID RouteID Measure Type Ref_Method Ref_Location Ref_Offset
1 I94 0.789 Valve 04 - Intersection {ACE45-51112-54523} 1000
2 I94 0.4 Pump 06 - Milepoint I94 0.4
3 I94 1.4 Station 01 - XY -77.067290,39.946920 0
4 I94 1.211 Meter 03 - Stationing {44553-99883-55443} 110+00
Highlighted Functionality
Current Future
6 Flexibility in Event Location Referencing X
7 Temporality X
8 Geoprocessing Tools X X
9 Measure-Based Reporting for Decision-
Makers
X
10 Linear Referencing Web Services X
11 Pipeline Characteristics Editor X
Temporality
View After
View Before
• Date ranges can be applied to LRS edits
• Event measure updates reflect date
ranges of LRS edits
• Historical event measures that change
due to LRS edits are “retired”
• “Temporal View Date” enables data
visualization and query for any moment
in time
• Integrated with ArcGIS notion of time
Highlighted Functionality
Current Future
6 Flexibility in Event Location Referencing X
7 Temporality X
8 Geoprocessing Tools X X
9 Measure-Based Reporting for Decision-
Makers
X
10 Linear Referencing Web Services X
11 Pipeline Characteristics Editor X
Geoprocessing Tools
• Convert M-value Unit of Measure
• Detect Measures Out Of Range
• Detect Overlaps For Linear Events
• Detect Gaps For Linear Events
• Detect Measures Non-monotonic Routes
• Generate Routes
• Generate Calibration Points
• Translate Events From LRM to LRM
• Update Calibration Points
• Update Intersections
…and growing.
Highlighted Functionality
Current Future
6 Flexibility in Event Location Referencing X
7 Temporality X
8 Geoprocessing Tools X X
9 Measure-Based Reporting for Decision-
Makers
X
10 Linear Referencing Web Services X
11 Pipeline Characteristics Editor X
Measure based reporting for decision makers
• Web based for PC or tablet
- Opens data to decision makers
• Combine and filter multiple event
layers
• Produces
- Tabular reports, maps, data products
• Report types
- Length summary reports
- Route locations, segments, log
Highlighted Functionality
Current Future
6 Flexibility in Event Location Referencing X
7 Temporality X
8 Geoprocessing Tools X X
9 Measure-Based Reporting for Decision-
Makers
X
10 Linear Referencing Web Services X
11 Pipeline Characteristics Editor X
Linear Referencing capability for ArcGIS Server
• ArcGIS for Server
- Mapping, Query, Geoprocessing
• Location Referencing for Server
- Event editing
- Coordinate to measures (includes stationing)
- Measure to coordinate (includes stationing)
- Query attribute sets
- Check events (gaps, overlaps, invalid measures)
- Measure translation
- Measure updates for external systems
- Measure based reporting
Desktop
Web
Connected Mobile
LRS
Web
Services
Location Referencing Server
Highlighted Functionality
Current Future
6 Flexibility in Event Location Referencing X
7 Temporality X
8 Geoprocessing Tools X X
9 Measure-Based Reporting for Decision-
Makers
X
10 Linear Referencing Web Services X
11 Pipeline Characteristics Editor X
Pipeline Characteristics Editor
• Web based event editing
• Delivers with the Server
• Built entirely on web services
• JavaScript / HTML 5 app
Web based event editing and QC
• Editing
- Line event attribute sets
- Points events
- Selection results
- Attribute set results
• Selection
- Select by route, attribute, geometry, proximity
- Single layer results or attribute sets
• QC
- Gaps, overlaps, invalid measures
- Data Reviewer batch checks
Dynamic segmentation
Resultant
Segmentation
0
Operating Pressure800 1000
Pressure Test1000 1500 1200
Coating Type Coal Tar FBE Coal Tar FBE Coal Tar
10 16
5010 20 30 40
24 33 35 41
Credit: DNV GL Software
Data Model Support
• Adoption of a full “Data Model” not required
• Event model flexible
• Web services to get network changes
• Location model is required
Type Presentation Title Here
Toolset flexibility
Centerline
sequence
Routes
Calibration
points
Centerline
1
M
N
1
M
1
Data Models SupportedKeeping Pace with ArcGIS Platform and Location Referencing Advances
UPDM APDM PODS Esri
Spatial
PODS
Relational
Route editing X
Event editing X X X
LRS network sync (1 way) N/A X X X
Event measure updates N/A X X X
• Keep other data models events and networks in sync, for systems that can’t migrate
right away or never will
Scope and schedule
• BETA Q1 2015
- ArcGIS Pro LRS network editing tools
- Location Referencing Server
- Web Event Editing
- Web Reporting
• Release 1.0 TBD
- ArcGIS Pro LRS management & configuration
- Geoprocessing tools
10.3
2014
2015
ArcGIS Pro Releases
SDK in BETA
Location Referencing for Pipeline
BETA
UPDMUtility & Pipeline Data Model
Business Drivers for UPDM
Enable combination utilities that have both distribution and transmission to use
one data model
Simplify staff training
Single workflow for maintaining distribution and transmission asset data
Better manage HP Distribution pipe (> 20% SMYS)
Improve staff efficiency and productivity
Technical Drivers to Evolve UPDM
Represent “Best practice” for managing data in a
Geodatabase
Align with ArcGIS Pro and advances being developed
in the ArcGIS Pro environment
Align with ArcGIS Location Referencing for Pipelines
Improve scalability and performance for larger pipe
systems
About UPDM
Esri’s UPDM is a geodatabase data model template for
operators of pipe networks in the gas and hazardous
liquids industries. UPDM is a
moderately normalized data model
that explicitly represents each physical component
of a pipe network from the wellhead to the
customer meter, terminal or delivery point, in a
single database table object.
UPDM history
Traces its heritage to the first release of the Gas Data
Model in 2001, being renamed now to reflect broadened
scope
Partners and customers always have played a role in the
development of the Gas Data Model, and we look forward
to continuing that collaboration with UPDM
Esri has actively maintained and enhanced the Gas Data
Model through the years, and that will continue with
UPDM
Geodatabase Concepts & UPDM
All events stored as features
Connectivity model used to maintain physical assets
Linear referencing model used to maintain transmission
integrity data
Metadata managed as part of feature (Editor Tracking &
Archiving)
Documents managed with Attachments
Time Aware (be able to view system at different states in
time)
Improving Performance thru Better Data ManagementTransmission – Viewing Pipe Segments
Database Activity with Legacy Data Model• 1 – Geodatabase• 3 – Tables/Featureclasses queried
66% Reduction in SQL queries in the database
Database Activity with UPDM• 1 Geodatabase• 1 – Featureclass queried
Improving Performance thru Better Data ManagementTransmission & Distribution – Viewing Pipe Segments
Database Activity with Legacy Data Model• 2 – Geodatabases• 4 – Tables/Featureclasses queried
75% Reduction in SQL queries in the database
Database Activity with UPDM• 1 Geodatabase• 1 – Featureclass queried
Improving Scalability thru Data Storage EfficiencyTransmission
PipeSegment
PipeSegmentAudit
Pipes
Valve
ValveAudit
Valves
Legacy Data Models UPDM
50% Reduction in Records stored in the database
Improving Scalability thru Data Storage EfficiencyTransmission & Distribution
PipeSegment
PipeSegmentAudit Pipes
Legacy Data Models UPDM
33% Reduction in Records stored in the database
Mains
66% Reduction in tables stored in the database
Release Sequence
Configured for
Geometric
Network
Configured for
Facility
Network
ALRP
Schema
UPDM for 10.2 Yes No
UPDM for 10.3
(concurrent with
ALRP Beta release)
Yes Yes
UPDM release after
10.3
Yes Yes