developing custom transformers to simplify a sanitary sewer geometric network
TRANSCRIPT
![Page 1: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/1.jpg)
Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network
Carl Von StettenCCCSD
![Page 2: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/2.jpg)
About Me
GIS Analyst, CCCSDCarl Von Stetten
![Page 3: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/3.jpg)
Last Year on the FME
World Tour…
![Page 4: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/4.jpg)
Our GoalGIS will serve as the authority of record for the inventory of District infrastructure assets.
![Page 5: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/5.jpg)
Our ProblemGIS sewer main features were not always 1:1 with physical pipes, sometimes they were n:1.
![Page 6: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/6.jpg)
![Page 7: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/7.jpg)
Historical Context…• From 1970’s thru mid-1990’s, infrastructure
maps produced by manual drafting• Annotation overload!
![Page 8: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/8.jpg)
…More Historical Context…• 1996 MGE deployed – similar hardcopy format,
just maintained with different tools• Sewer mains with attribute changes stored as
“minisegs”
# Main ID
Length
Diam.
Material
Job
1 75D1 M 70.5 75D1 80 131 6 VC X1558
2 75D1 80 75D1 81 114 8 CI X1558
3 75D1 81 75D1 82 18 8 CI X1558
4 75D1 82 75D1 83 100 8 CI X1558
5 75D1 83 75D1 84 18 8 CI X1558
6 75D1 84 75D1 M70 75 6 VC X1558
![Page 9: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/9.jpg)
…Almost Caught Up…• 2005-06 GeoMedia deployed – somewhat refined
hardcopy format, new tools and custom code• Automated process to calculate “majorsegs” from
“minisegs”# Majorseg Main ID1 75D1 M 70.5 75D1 M 70 75D1 M 70.5 75D1 80
2 75D1 M 70.5 75D1 M 70 75D1 80 75D1 81
3 75D1 M 70.5 75D1 M 70 75D1 81 75D1 82
4 75D1 M 70.5 75D1 M 70 75D1 82 75D1 83
5 75D1 M 70.5 75D1 M 70 75D1 83 75D1 84
6 75D1 M 70.5 75D1 M 70 75D1 84 75D1 M70
![Page 10: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/10.jpg)
So Where Are We?• “minisegs” solved the problem of tracking the
attribute changes over the length of a sewer main• “majorsegs” solved the problem of linking to external
databases (CMMS, CCTV, hydraulic modeling, etc.)
• But… still can’t reliably link back to GIS from the external databases 1:1• Which single GIS feature represents the whole pipe?
![Page 11: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/11.jpg)
Time to Rethink Things
How can we consolidate the “minisegs” into single features without losing any information?
![Page 12: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/12.jpg)
What do we do with “miniseg” data?
Pipe attribute changes tracked by “minisegs”
Need to track
spatially? New solution
Pipe material Yes Copy “miniseg” to ssAttributeChangeLine FC
Liner material/method Yes Copy “miniseg” to ssAttributeChangeLine FC
Diameter Yes Add reducer fitting in ssFitting FC – make it a defining structure
Slope (grade breaks, vertical curves) Yes Move mid-pipe elevation changes to ssElevationPoint FC, retain start/end invert elevations on pipe
Job number(s) No Move to a related JobLinks tableEncasement Yes Copy “miniseg” to ssCasing FC, remove
encasement attributes from pipe
![Page 13: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/13.jpg)
What do we do with “miniseg” data?A few leftover details:• When consolidated pipe has multiple materials set the
MATERIAL attribute to “Varies”• Same for multiple liner materials/methods
(LINERMATERIAL/LINERMETHOD)• If the “minisegs” can be consolidated at all before copying to
ssAttributeChangeLine, do so• Can consolidate job and slope changes if material or liner doesn’t
change between adjacent “minisegs”• Sum the total length of the consolidated pipes and
consolidated ssAttributeChangeLines
![Page 14: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/14.jpg)
How do we accomplish
this?
• With FME of course! (duh!)
• Using the LineJoiner transformer
• Using a reuseable Custom Transfomer
![Page 15: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/15.jpg)
Let’s see this in FME…
![Page 16: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/16.jpg)
The Mighty Workbench!
![Page 17: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/17.jpg)
MiniSeg Consolidation to Whole Pipes
![Page 18: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/18.jpg)
MiniSeg Consolidation to ssAttributeChangeLine
![Page 19: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/19.jpg)
MiniSegJoiner Custom Transformer
![Page 20: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/20.jpg)
MiniSegJoiner User Parameters
Define inside Custom Transformer
Set attributes on each placement
![Page 21: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/21.jpg)
Move Job info to a Relate
![Page 22: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/22.jpg)
JobHandler Custom Transformer
![Page 23: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/23.jpg)
JobHandler User ParametersDefine inside Custom Transformer
Set attributes on each placement
![Page 24: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/24.jpg)
Custom Transformers
rock!!!
• Keeps workbench DRY (don’t repeat yourself)
• Configureable behavior (through user parameters)
• Encapsulate your task logic
![Page 25: Developing Custom Transformers to Simplify a Sanitary Sewer Geometric Network](https://reader035.vdocument.in/reader035/viewer/2022070519/58f298e51a28ab37588b45c7/html5/thumbnails/25.jpg)
Thank you!Carl Von StettenEmail: [email protected]: http://centralsan.org
http://about.me/cfvonnerTwitter: @cfvonnerSlack: @cfvonner
http://gisdevs.slack.com signup: http://bit.ly/1HxiNv1