all pipes portal: a collaborative initiative
TRANSCRIPT
All Pipes Portal: A Collaborative InitiativeJennifer ChungAndrew TurveyNeil Hellas
About Us
York RegionGIS Technologist
York RegionGIS Technologist
Spatial DNAEnterprise Solutions
Architect
Jennifer Chung Andrew Turvey Neil Hellas
All Pipes ProgramAll Pipes is a collaborative initiative between York Region and its nine Area Municipalities to maintain a single common schema and water/wastewater utility dataset among partners.
Connecting our World: One pipe at a time!
All Pipes Structure
Continuous Improvement
In September 2015 York Region decided to enhance their current FME portal architecture.
Solution
Project Objectives• Removed ESRI Data Reviewer services– Replaced QA/QC checks with FME tools
• Increased email notifications• Integrate loading & viewer capabilities• Increased reporting functionalities• Reduce number of workspaces
Solution
The goal was to create a custom workflow to allow Geocortex to upload data to FME Server, and for FME Server to generate reports visible on Geocortex
Old ProcessNew
Process
Timeline2
weeks
8 weeks
6 weeks
Technical Approach
• Integrate with Geocortex
• QA/QC Data• Transform to
common schema• Limit workspace
editing• Increase
communications to user
Integration of data and components
User
User interface• Form items are
FME service parameters
• Active Directory permissions
• Leverage fmedataupload service
Data Exchange Portal
Old process – lots to maintain
New process – less to maintain
Configuration separated from functionality
Master WorkspaceStep 1:
Transform the feature class and attribute names
Do some “sanity” QC
Step 2:
Business rules QC
Conform attribute values
Step 3:
Write the data to the common database
Step 4:
Topology checks
Launched by web interface
Calls other FME services to complete process
Status table updates and email notification to user/admin
Step 1 - Schema Mappers
Feature class names Attribute names
Step 2 – QC - Business Rules
Should we test?Check configuration
Test! Record error Check results
Step 2 – QC – Business Rules
Configure which errors can be ignored
Step 3 and 4 – Upload
A User perspective!
All Pipes Portal FME Configuration
• Each Municipality has checks tailored to its unique data
• Changes and enhancements are easy to manage without recreating the entire workflow
CSV GISFME
Configuration and Efficient management
• Standardizes Data into All Pipes Schema• Value mapping is done in CSV files; no external
software Concrete Pipe = CP
Lessons Learned
• Guest token user
• Strict data rules• Happier users • Objectives met
Future Application
Thank you!All Pipes [email protected]
Spatial [email protected]