Mobile GIS with Augmented Reality

for

Utility & Telco Field Workers

GE Bali August 2014

The IssuesThe RequirementsThe TechnologyThe BenefitsExample Usage

o Mike Bundock• GIS industry since 1979

• Consultancy to Governments, utilities & telcos in UK, Europe, SE Asia, Australasia

• Product development for GIS products (Unisys, CIS, Smallworld)

• Smallworld Systems 1990-2000 (Cambridge, Australia, NZ)

• eMap, Terralink, SISL

o Augview• smart field systems incorporating GIS & Augmented Reality

• focussed on infrastructure management

Introduction

The IssuesThe RequirementsThe TechnologyThe BenefitsExample Usage

o Action: Industry RestructuringResults:

Deep subcontractor structure

Small specialist companies

Short lifespan

Have to be competitive – lower cost workforce

Short term workforce

o Action: New workforceResults:

Less training, less knowledge, less experience

New generation – short term job expectations

Expect GPS to be ubiquitous and accurate

Expect and experienced with 3D visualisation

The Issues

o Asset Data:

Existing data not Spatially accurate

Missing critical attributes

Not Complete – some assets simply not recorded

Need to update – SUE records research phase

o SUE Standards: Reducing risk

Quality level D – records research

Quality level C – field survey – whatever is visible

Quality level B – existence and horizontal position from locators, GPR etc.

Quality level A – highest accuracy (e.g. survey after exposure using vacuum excavation)

The Issues

o Ageing Assets:

Refurbishment, replacement, abandonment

o New Assets:

Increasing congestion underground

New technology rollout

Collateral damage - an example

Known - average 1 event per 800m drilling

Not known?

cable insulation damage,

stormwater/sewer drill through

The Issues

The Issues

The RequirementsThe TechnologyThe BenefitsExample Usage

o Modern, Mobile GIS

o Usability (HCI)

• Usable by inexperienced field staff

• Convey information clearly and easily

• Large icons/menus

• Internationally accepted icons

• Simplicity for interrogation and update/capture

Requirements

o Outdoor usable (environment)

• Screen visibility• Screen size• Lightweight• Sensors available? • Sensor accuracy (e.g. GPS accuracy, reproducibility)• Communications – [, 3G, 4G• Connection to external devices – Bluetooth, cable• Battery life• Robustness• Map Styles – simpler, bolder, more contrast

Requirements

o Platform independence

• Leapfrog technologies – rapid change

• iOS

• Android

• Windows (8?)

Requirements

o Server Agnostic

• GE Smallworld GSS (native)

• OGC (for open source servers, most GIS servers,

Autodesk, map info, Intergraph …)

• ESRI ArcGIS Server (rest API)

• Google (maps, fusion), Bing, OSM

• Country-specific (e.g. Germany)

Requirements

o Online• Online, no data saved on device, secure

• Requires good 3G or 4G data network

o Offline• No Network

• Outside urban areas

• Rugged terrain

• Download target area prior to visit

• Synchronise when network is stable

Requirements

o Security• Data security

• HTTPS

• User authentication

• Device authentication

• Malaysia – Full Audit trail – log of all interactions

• Downloaded data encrypted and timebombed

• Data access only from a device in restricted area

• Read-only or Update

• User-specific access rights

Requirements

o Who are the users?• Mobile technology experience

• Adaptability

• Age

• Young play 3D games at home & on phones/tablets

• IT experiences

• At work

• At home

Requirements

The IssuesThe Requirements

The TechnologyThe BenefitsExample Usage

o Augmented Reality (AR) provides a live view of a physical, real-world environment which is augmented by computer-generated input such as information, sound, video, graphics, or location data

Definition

Marker & Image Recognition

Geospatial Augmented Reality

o Augview Video Presentation

Geospatial Augmented Reality

Authentication

Augview registration

server Client

Device authorised – unlock app, display login panelUser name & password

LoginUser authorised – display project list

Request maps

and data from

project URLs

21

Select ProjectNext

View/accept disclaimers

GIS DB

GIS Application

server

WEB server Internet

The Solution – Mobile GIS

Smart phone knows where

it is

Augview overlays 2D

data of assets on street

maps

Data can be searched and

interrogated in real time by field

engineers

GIS DB

GIS Application

server

WEB server

GIS DB

GIS Application

server

WEB server Internet

Smart phone knows where it

is and its orientation

The Solution – Mobile AR

Real time video of surroundings from

phone’s camera

Augview creates 3D model of

hidden assets and overlays on

video

GIS DB

GIS Application

server

WEB server

Device RequirementsCamera plus Sensors

GNSS (GPS/GLONASS)• Where on earth are you?

Magnetometer (digital compass)• Where are you looking (horizontally)?

Accelerometer• Where are you looking (vertically)?

Gyro• How am I accelerating?

Samsung Note 10.1 GPS

26

Note 10.1 GPS

Elapsed time

24 minutes

Mean coordinate (without post processing)

0.10, -0.71

Standard deviation

1.21 metres

Test Results

Samsung Galaxy S4Average coordinate (-0.66, -1.79)

Standard deviation (1.11)

Samsung Galaxy Note 10.1Average coordinate (0.10, -0.71)

Standard deviation (1.21)

Getac Z710Average coordinate (-0.70, 0.38)

Standard deviation (0.44)

28

Test Results

iPhone 5Average coordinate (1.86, -1.95)

Standard deviation (2.71)

iPad (4th generation)Average coordinate (3.80, 3.19)

Standard deviation (1.70)

External Dual Bluetooth GPS Average coordinate (0.40, 0.71)

Standard deviation (1.15)

o Enhanced GPS – e.g. Trimble Juno

o RTK – pricing coming down – e.g. swift-nav.com

o 1-10cm accuracy

Improving GPS Accuracy

Architected for the Future

o Low Unit Cost of Implementation and Use

o Multi-Platform Native Application

o Compatible With Multiple GIS Servers

o Enhanced Security

o In-field Interrogation & Update

o Flexible Control Over Users Data

o Intelligent Search functions

Product overview - Features

o Real time, in-field data correction by engineersFeatures for advanced, authorized users only

Asset condition recording (condition, lifespan, needed maintenance)

OSH safety surveys

Asset serial numbers, specs etc..

Asset location update

o Photo Capture

Product Overview - Features

The IssuesThe RequirementsThe Technology

The BenefitsExample Usage

Benefits

o Low Cost

o Rapid to deploy

o Ease of use

o Reduced Health & Safety Risks

o Reduced collateral damage

o Improved data timeliness, data accuracy, data completeness

o Licencing – per deviceCapex:

licence (in perpetuity) purchase $1500

15% PA maintenanceSubscription:

Monthly fee (min 3 month agreement) NZ$125/month

o ServicesProvided by Augview or local distributor

35

Return On Investment?

WHAT’S YOUR TIME WORTH?

STAFF $ 70,000

OVERHEAD $ 35,000

VEHICLE $ 20,000

$ 125,000

WEEKS PER YEAR 48

COST PER WEEK $ 2,604

WHAT’S IT GOING TO COST ME?

DEVICE COST (PA) $ 1,500

DATA PLAN (PA) $ 300

AUGVIEW (PA) $ 900

$ 2,700

WEEKS PER YEAR 48

COST PER WEEK $ 56.25

THE UPSIDE?

Efficiency Requirement 2.16%

Saving Required p/day (minutes) 9.7

Return On Investment?

HowTime

(hrs/week)

Saving

($/week)Benefit

Value

($/week)Risk

Events

(per year)

Cost

(per year)

Data always available 1 65.00$ Improving Data Quality 50.00$ H & S 2 1,040.00$

Comprehension 2 130.00$ Data Timeliness 50.00$ Network Damage 2 1,500.00$

Portability 1 65.00$ Back office update 100.00$

Value 260.00$ 200.00$ 2,540.00$

Value Annual 11,960.00$ 9,200.00$ 2,540.00$

Assumptions

Hrs/week 40

Staff cost/week 2,600.00$

Network Damage cost 750.00$

Worked weeks/annum 46

Efficiency Savings In-Field Data Update Risk Reduction

Total Savings/annum 23,700.00$

The IssuesThe RequirementsThe TechnologyThe Benefits

Example Usage

LAKU Background

Located in Miri, Sarawak, Malaysia, on island of BorneoMiri is second largest city in SarawakMiri Division has a population of approx 375,000Miri Division is 1 of 11 divisions in SarawakPrimary Industries are oil and gas, followed by palm oil2012 water treatment plant contaminated by deisel leaking from petrolum plant

LAKU is a state owned company, responsible for collection, treatment and distribution of potable waterArea covers Miri, Limbang, Bintulu

350 staffCorporate office in MiriArea offices in Limbang, Bintulu and Miri

Multiple water treatment plantsTotal treatment capability approx 300 MLD

o Ease of Use

o Integration with existing systemsGE Smallworld GIS

o Access to external datasets Other utilities

Miri City Council (MBM)

Sewerage Services Department Sarawak (SSD)

Sarawak Energy (formerly SESCO)… and Google imagery

o Asset records maintenance

o Burst/maintenance recording

o Low Cost

o Support from local distributor

LAKU – User Requirements for Mobile Solution

Example Usage

Laku Water Authority

WEB server

Internet

GIS DB

Google imageryCouncil GIS serverUtility GIS server …

SmallworldVMDS

Third party geo servers

WEB server

GIS DBWEB

serverGIS DB

GSS

Augview Users

FTTx Optimised Design Process

WEB server

Internet

GIS DB

Google imageryCouncil GIS serverUtility GIS server …

GSS VMDSReplica

Third party geo servers

WEB server

GIS DBWEB

serverGIS DB

Cloud server

https

Notify ready for reviewRequest

reoptimisation

Design Optimisation

Review, validate, add constraints

Design ReOptimisation

Notify ready for review

Revalidate, add

constraints

PNI

SmallworldVMDS

GSS

VPN

replica synchronisation

Questions?

www.augview.net