Analysing, Writing, Emailing, Sharing FME does it allJon HawkinsGIS Projects, Waterford City and County Council

Content

Analysing Irish Water survey data using the Attribute Exploder and the Null Attribute Replacer

Writing out Litter Quantity Survey data with the new Excel Writer [2015]

Emailing with Python Caller

Drive Time analysis with Network Cost Calculator and OSi Prime 2 data

Look at the SharePoint Reader and Writer

34 LocalAuthorities

2013

Analysing Survey Data

WaterServicesTransition

Office

Analysing Survey Data

9 Themes covering Assets, IT, Facilities, HR, Finance, Health & Safety, Legal

Each theme had a questionnaire

Fact Finding Summary 42+ questions

Individual items 20+ forms

WSTO charged with

Coordinating the circulation and collection

Initial review / validation of questionnaires

Checking associated documents uploaded

Transfer to Irish Water Programme

Analysing Survey Data

What they wanted us to analyse

WSTO said “no, have you never heard of FME”

After some late nights and a lot of lobbying we finalised on this

Analysing Survey Data

After multiple versions I ended up with 53 control workspaces

Produced Compliance Reports, National Summaries, National Data, Files Uploaded Reports etc…

And after all this the two transformers I found and grew to love, were the Null Attribute Replacer and the Attribute Exploder

Null Attribute Replacer and Attribute Exploder

Over 5 months of work in 2013, I learnt I could go from testing each attribute in turn. With 100’s of individual tester transformers

Null Attribute Replacer and Attribute Exploder

To 2 transformers and 1 tester

Excel Writer [2015]

Litter Quantity Survey

National surveys, Waterford City and County undertake about 200 a year

Paper based survey carried out by field staff

Administration staff then input survey information into a fixed excel template

ArcGIS Collector and FME to the rescue

Excel Writer [2015] – Old Way

Data Entry into excelPaper Form

Excel Writer [2015] – New Way

Excel XLSXW2 WriterArcGIS Collector

Excel Writer [2015]

Use a template

Don’t output Field Names

Set column position

Expose row_id & use lookup

Update cells don’t insert

Excel Writer [2015]

Demo

Emailing with Python Caller[With thanks to Andy Bates, City Of Armadale, WA, Australia, for his Bore Hole example which I downloaded from safe.com in 2011]

Use to send summary emails using a ListBuilder

With a ListElementCounter

Emailing with Python Caller[With thanks to Andy Bates, City Of Armadale, WA, Australia, for his Bore Hole example which I downloaded from safe.com in 2011]

And PythonCaller

Emailing with Python Caller[With thanks to Andy Bates, City Of Armadale, WA, Australia, for his Bore Hole example which I downloaded from safe.com in 2011]

Settings

Control frequency and who gets what when, with a Scheduler and some testers

Quick demo

NetworkCostCalculator[thank you safe.com]

Further to a national request to all Fire Services, FME and OSi Prime 2 were used in house to calculate response times for our Fire Stations. Sorry Mr Consultant

GDF2 layer used as source for network.

Data prepared by removing impassable roads, PathSplitter, ArcStroker and snapper

NetworkCostCalculator[thank you safe.com]

Demo

NetworkCostCalculator[thank you safe.com]

SharePoint Reader and Writer

A lot of databases and spreadsheets are starting to be maintained in SharePoint lists rather than excel and access

SharePoint does use SQL and can be accessed using file explorer, but good luck finding your data and trying to write to folder locations

SharePoint Reader

Lots of potential for reading

Current limitations

Can’t expose views

Can’t read lookups

SharePoint Writer

Lots of potential for writing and sharing data

Current limitations

Speed [but could be our set up]

Unable to Truncate

Thank You!

Questions?

For more information:

Jon Hawkins jhawkins@waterfordcouncil.ie

Resources

See safe.com for DriveTime: Search Calculating emergency response travel times