Sep. 21, 2006v FME Worldwide User Conference - Vancouver
Geomatics and FME from a Corporate PerspectiveNadia Shahriari Namini – City of Calgary, Alberta
Geomatics and FME 2
Geomatics and FME 3
City of Calgary
Population ~ 1,000,000
22,583 growth last year
Area - 286 square miles and growing
Hosted 1988 Winter Olympics
Home of the Calgary Stampede
Alberta’s main industries are oil, gas and cattle
Geomatics and FME 4
The City of CalgaryMunicipal Government
City Council
Mayor and 14 Aldermen
Municipal Administration
City Manager, 6 Major Departments, 27 Business Units
11,733 Employees
Geomatics and FME 5
How Does Geomatics Fit In?
Utilities & Environm entalProtection
Land Inform ation &M apping
Geomatics M unicipalRights-of-W ay
EngineeringSurvey
InfrastructureInform ation
Corporate DataAccess & M arketing
City M anager
Geomatics and FME 6
Geomatics
Cadastral Mapping
Field Services
GIS Mapping
Base MappingManagement
Tri-ServicesDispatch Mapping
Rural RoadnetPhotogrammetric
ServicesCustom Mapping
GIS Analysis
Geomatics Division
Geomatics and FME 7
Provides data conversion/GIS analysis services to numerous IT projects and Business Unit clients
Responsible for loading and QA of numerous datasets to Corporate SDE (~350 SDE layers)
GIS Analysis
Geomatics and FME 8
Numerous technologies: FME, ArcGIS, ArcSDE, AML, Pro-C,
PL/SQL, … Batch jobs: nightly, weekly, monthly,
… Ad-hoc processes
GIS Analysis (Cont.)
Geomatics and FME 9
CLIENTS
Water ServicesWater Resources Roads
Parks
Fire
Police
LIM-CDAM
LIM- Infrastructure Information
Assessment
Trans. Planning
Calgary Transit
Information Technology
Urban Development
Development & Building
Approvals
Geomatics and FME 10
SERVICES
Spatial/Non-Spatial Data
Integration/Conversion
Maintenance of more than 350
Corporate SDE layers
Data Translations / Transformations
Data Schema Change
Spatial/Non-Spatial GIS Analysis
Quality Assurance
GIS Analysis Consultation
Data Conversion Consultation
Geomatics and FME 11
SDE Layers
56 Legal Survey Fabric (LSF) Layers 10 Ownership Parcel Fabric (OPF) Layers 2 Address POSSE Layers 44 Digital Aerial Survey (DAS) Layers 6 Road Network (RoadNet) Layers 42 Waterworks Layers 16 Sanitary Layers 26 Storm Layers 15 Layers for Transit/Transportation 14 Layers for Calgary Parks 5 Layers for Calgary Fire 7 Layers for Calgary Police 31 Layers for Calgary Census 8 Layers for Calgary Schools …..
Geomatics and FME 12
Example Projects
Trip Planning Application Street Lighting Enterprise
Geodatabase Permitted Use Building Envelope
Analysis Open Space GIS Analysis Parks Asset Management Waterworks and Wastewater Asset
Management …..
Geomatics and FME 13
Waterworks: a multi-million dollar public utility that manages all aspects of the water treatment and delivery process for The City of Calgary.
Wastewater: responsible for the design, construction, and maintenance of two separate collection systems: Storm drainage system: helps prevent flooding by
diverting rain and snow melt. Sanitary system: protects public health and the
environment by collecting and treating wastewater from residences, schools, hospitals, businesses, and industries.
Waterworks and Wastewater Asset Management
Geomatics and FME 14
Source data sets: MicroStation Design files (387 sections) Oracle database (about 100 tables)
Destination data sets: 39 Water Works SDE layers 14 Sanitary SDE layers 24 Storm SDE layers
Waterworks and Wastewater Asset Management
Geomatics and FME 15
Sample Source DGN Files
Geomatics and FME 16
Database Schemas
Sanitary StormWaterworks
Geomatics and FME 17
DGN files
Oracle DB
AML ScriptsCoverages SDE layers
ARCSDE commands
Old process:
New process:
DGN files
Oracle DB
FMESDE layers
Waterworks and Wastewater Asset Management
Geomatics and FME 18
- Data filtering
- Data Integration
- DB tables Join
- DB to DGN Join - Geometric Operations
- Linear Referencing - Data Manipulation
- Overlay Analysis- …
FME Processes Destination Data Sets
Source Data Sets
Waterworks and Wastewater Asset Management
Geomatics and FME 19
Geomatics and FME 20
4 Filtering Transformers: Perform tests on feature geometry/attribute and route the features to different ports.
9 Geometric Transformers: Operate on the geometry of individual features /groups of features.
9 String Transformers: Operate on character strings.
1 Linear Referencing Transformers: Create and apply measure related information onto the geometry.
3 Collector Transformers: Operate on collections of features at a time.
Utilized FME Tools
Geomatics and FME 21
8 Manipulator Transformers: Modify the geometry/attribute of individual features.
2 Database Transformers: Allow interactions with external databases.
6 Infrastructure Transformers: Interaction with the underlying FME engine facilities.
6 Calculator Transformers: Calculate a value and supply it to a new attribute.
8 List Transformers: Operate on FME attribute lists.
Utilized FME Tools (Cont.)
Geomatics and FME 22
Quality Assurance/Quality Control
Geomatics and FME 23
FME Workspaces: 20 for Water Works 16 for Sanitary 20 for Storm
Batch files: 3 batch files Running time: ~10 hrs.
Intel Pentium 4 CPU 2.80 GHz 2.00 GB of RAM
Output Data sets: 77 SDE layers
Summary
Geomatics and FME 24
Challenges
Backward Compatibility (with older versions)
Line-linked vs. Point-linked Annotation
StringReplacer and StringPairReplacer
Help Document Data cleaning (MRFCleaner
transformer)
Geomatics and FME 25
What Do We Like about FME?
Easy to maintain Easy to document Data Integration from Multiple sources Multiple Destination datasets No intermediate data sets required Complex spatial and non-spatial
analysis all in a single FME workspace QA/QC processes Batch mode Safe Software Support FUN …
Geomatics and FME 26
Thank You.