the geocentric water utility - recent proceedings · 2019-04-26 · data models web maps &...

45
The Geocentric Water Utility Jonas Rugys

Upload: others

Post on 29-May-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

The Geocentric Water UtilityJonas Rugys

Page 2: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Improving Efficiency,

Collaboration and

Communication

GIS Connects IT and OT Technologies Connecting People, Processes, Things and Data About Them

System of

Insight

System of

Engagement

System of

Record

Supports Multiple

Types of Systems

Helping Utilities

Understand . . .

. . . And Be Aware, Alert,

and Responsive

Page 3: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Client / Server Web Services & Apps

Stand-Alone Desktop Connected Desktop

Data Models Web Maps & Layers

Static Data Real-Time

Single Server Distributed Computing

Custom Applications Configurable Templates & Apps

Proprietary Data Open Data & Shared Services

2D Features 3D Features

Spatial Analysis Spatiotemporal & Big Data Analytics

Digital Cartography Smart Mapping

ArcGIS is Evolving

Page 4: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

ArcGIS | Implementation Patterns

Server

Desktop

Distributed

System of Systems

Enterprise/Online

Page 5: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Transforming How We Think and Act . . .

. . . Creating a More Sustainable Future

Moving to the

Cloud

Going Mobile

Advanced Analytics

Integrating

IoT and

Sensor

Networks

Water

Industry

Technology

Trends

Page 6: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Apps

Desktop

APIs

Deployable On-Premises

and in the Cloud

ArcGIS | A Complete GIS Platform

A System for Managing and

Applying Geographic Information

Available as SaaS

Page 7: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Web GIS for Water

Utilities

Page 8: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Connecting the Field with the Enterprise

Field GIS

• Collecting Data

• Reporting Observations

• Managing Work

Supporting the Entire Field Operations Workflow with Apps

Page 9: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Workflow Example

– Water Outage

Page 10: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

GeoEvent

Server

Real-Time

Data

Situational

Awareness

Analytics Alerting

GeoAnalytics

Server

Real-Time Analytics | Integrating Sensor Networks and the IoT

Supporting Real-Time GIS Applications . . .

• High-Velocity Data Streams

• Monitoring and Alerting

Improvements

• Scalability

• Availability

• Cloud IoT Connectors

Page 11: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

GeoEvent Server

Page 12: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

things that move… things that “just happen”…

• airplanes

• vehicles

• animals

• storms

• crimes

• lightning

• accidents

• tweets

Real-Time GIS – Types of observations and data

stationary sensors…

• water gauges

• weather stations

• air quality sensors

• device temperature

• ships

• satellites

• trains

• people

Page 13: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server

server role

spatiotemporal big

data store

Vehicle Location❖ Ingest Data:

GeoEvent Server – Key Capability #1

Page 14: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server

server role

spatiotemporal big

data store

Sensors and Instruments❖ Ingest Data:

GeoEvent Server – Key Capability #1

Page 15: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server

server role

spatiotemporal big

data store

Weather Monitoring❖ Ingest Data:

GeoEvent Server – Key Capability #1

Page 16: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server

server role

spatiotemporal big

data store

Public Safety Data Feeds❖ Ingest Data:

GeoEvent Server – Key Capability #1

Page 17: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server

server role

spatiotemporal big

data store

Commercial, Industrial, Utilities❖ Ingest Data:

GeoEvent Server – Key Capability #1

Page 18: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server

server role

spatiotemporal big

data store

Configurable inputs for any type of data❖ Ingest Data:

GeoEvent Server – Key Capability #1

Page 19: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

Filter:

Blue / Orange

▪ Identify event records with specified attribute values

❖ Apply real-time analytics: Filtering

GeoEvent Server – Key Capability #2

GeoEvent Server

server role

spatiotemporal big

data store

Page 20: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

▪ Identify event records with specified attribute values

▪ Determine spatial relationships with established geofences

❖ Apply real-time analytics: Filtering

GeoEvent Server – Key Capability #2

geofence

outside

inside

outside

geofence

disjoint crosses

GeoEvent Server

server role

spatiotemporal big

data store

Page 21: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

✓ Field Calculator

✓ Field Mapper

✓ Buffer Creator

✓ GeoTagger

✓ Incident Detector

✓ Track Gap Detector

GeoEvent Server – Key Capability #2

▪ Configure and use over two dozen types of processors

❖ Apply real-time analytics: Processing

GeoEvent Server

server role

spatiotemporal big

data store

Page 22: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server – Key Capability #2

▪ Configure and use over two dozen types of processors

❖ Apply real-time analytics: Processing

GeoEvent Server

server role

spatiotemporal big

data store

✓ Field Calculator

✓ Field Mapper

✓ Buffer Creator

✓ GeoTagger

✓ Incident Detector

✓ Track Gap Detector

Page 23: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

▪ Configurable outputs enable processed events to bestored in a traditional relational geodatabase

▪ When data is received at a high volume, high velocity,or is accumulated over time, a spatiotemporal big datastore is an available noSQL option for enterprise storage

❖ Store data as feature records in a geodatabase

GeoEvent Server – Key Capability #3

GeoEvent Server

server role

spatiotemporal big

data store

Page 24: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

▪ Relational geodatabase feature services supporttraditional RESTful web applications and APIs

▪ Big data map and feature services support on-the-flyfeature aggregation

❖ Visualize feature records

GeoEvent Server – Key Capability #4

GeoEvent Server

server role

spatiotemporal big

data store

Page 25: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

▪ Relational geodatabase feature services supporttraditional RESTful web applications and APIs

▪ Big data map and feature services support on-the-flyfeature aggregation

▪ Stream Services

❖ Visualize feature records

DesktopApps and

APIs

ArcGISData Store

ArcGISEnterprise

GeoEventServer

GeoEvent Server – Key Capability #4

GeoEvent Server

server role

spatiotemporal big

data store

Page 26: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

▪ Configurable outputs provide the capability to format ane-mail or SMS text message

▪ How you choose to disseminate processed event recordsis entirely up to you

❖ Notify stakeholders about detected patterns of interest

GeoEvent Server – Key Capability #5

!

GeoEvent Server

server role

spatiotemporal big

data store

Page 27: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Bringing real-time and big data capabilities to your ArcGIS Enterprise

GeoEvent Server – Key Capability #5

❖ Adjust the behavior of things in our environmentthrough actuation

IoT

Amazon Azure

GeoEvent Server

server role

spatiotemporal big

data store

Page 28: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

GeoEvent Server

server role

spatiotemporal big

data store

Page 29: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

GeoEvent Server

server role

spatiotemporal big

data store

Page 30: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

GeoEvent Server

server role

spatiotemporal big

data store

Page 31: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Out of the Box Input connectors

• Poll an ArcGIS map or feature service

• Poll an external web server or service

• Receive data records via HTTP/POST

• Receive data records via TCP / UDP socket

• Subscribe to an external web socket

• Watch a system folder for changes to a file

GeoEvent Gallery Samples

• FlightAware

• Verizon Connect / Telogis

• Waze

• Apache Kafka

• GeoTab Fleet Management

• …

Partner Gallery connectors

• exactEarth

• Valarm

• CompassLDE

• enviroCar

• …

spatiotemporal big

data store

GeoEvent Server

server role

You can create your owncustom inputs through the

GeoEvent Manageror SDK (Java)

Working with Real-Time DataConfigurable Input Connectors

Page 32: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Out of the Box Output Connectors

• Add or Update a feature

• Add or Update a spatiotemporal big data store

• Send Features to a Stream Service

• Push data records to an external website

• Push data records to an external websocket

• Send data records via TCP/UDP socket

• Send a text, email, or instant message

• Write a local file (CSV, JSON, GeoJSON)You can create your owncustom outputs through the GeoEvent Manager

or SDK (Java)

spatiotemporal big

data store

GeoEvent Server

server role

Gallery Components

• Amazon & Azure IoT

• Hadoop

• Kafka

• MQTT

• ActiveMQ

• RabbitMQ

• MongoDB

• Twitter

• …

Working with Real-Time DataConfigurable Output Connectors

Page 33: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

spatiotemporal big

data store

GeoEvent Server

server role

Out of the Box Output Geoprocessing

• Attribute & Spatial Filtering

• Buffer Creator

• Convex Hull Creator

• Difference Creator

• Envelope Creator

• Field Calculator

• Field Enricher

• Field Mapper

• Field Reducer

• Geotagger

• Incident Detector

• Intersector

• Projector

• Simplifier

• Symmetric Difference

• Track Gap Detector

• Union Creator

Sample Add-on Processors

• Add XYZ

• Event Volume Control

• Motion Calculator

• Range Fan

• Reverse Geocoder

• Service Area Creator

• Track Idle Detector

• …You can create your owncustom processors through

the GeoEvent Manageror SDK (Java)

Working with Real-Time DataConfigurable Filters & Processors

Page 34: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Using GeoEvent Server for event

notification

Water Main Break

Alert

Page 35: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Vehicle Location and Monitoring (Demo)Water Main Break Alert Input

Page 36: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Vehicle Location and Monitoring (Demo)Water Main Break Alert Service

Page 37: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Vehicle Location and Monitoring (Demo)Water Main Break Alert Output (Email)

Page 38: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Apps

Desktop

APIs

ArcGISEnterprise

ArcGIS GeoEventServer

spatiotemporalbig data store

analytics storage

visualization

live & historic

aggregates & features

live features

stream services

ArcGIS GeoEvent Serversummary

ingestion

actuation

Page 39: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Spatial / BI

GIS

New Charts

Linked and Responsive

Charts and Maps

On-the-Fly

Visual Models

Integrated Spatial

and Tabular Analysis

• SQL Server

• Oracle

• SAP HANA

• Teradata

DBMSs• Excel

• CSV

Local

Insights | A New Experience for Spatial Analytics

For Analysts and Data Scientists

• Visual, Intuitive, Responsive

• Exploratory Data Analysis and Visualization

Page 40: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Insights for ArcGIS

– Leak Main Break

Analysis

Page 41: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Digitization of Water Trends

Page 42: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Problem Solving More ChallengingMove out from foundational

Imagery

Big Data

Analytics

AR/VR

3D Real-Time (IoT)

Page 43: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks

Utility configurations designed for rapid deployment

Asset Management

Real-Time

Water Outage Management

Mobile Workforce

Analytics

Water Loss

Page 44: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks
Page 45: The Geocentric Water Utility - Recent Proceedings · 2019-04-26 · Data Models Web Maps & Layers Static Data Real-Time Single Server Distributed Computing ... IoT and Sensor Networks