the geocentric water utility - recent proceedings · 2019-04-26 · data models web maps &...
TRANSCRIPT
The Geocentric Water UtilityJonas Rugys
Improving Efficiency,
Collaboration and
Communication
GIS Connects IT and OT Technologies Connecting People, Processes, Things and Data About Them
System of
Insight
System of
Engagement
System of
Record
Supports Multiple
Types of Systems
Helping Utilities
Understand . . .
. . . And Be Aware, Alert,
and Responsive
Client / Server Web Services & Apps
Stand-Alone Desktop Connected Desktop
Data Models Web Maps & Layers
Static Data Real-Time
Single Server Distributed Computing
Custom Applications Configurable Templates & Apps
Proprietary Data Open Data & Shared Services
2D Features 3D Features
Spatial Analysis Spatiotemporal & Big Data Analytics
Digital Cartography Smart Mapping
ArcGIS is Evolving
ArcGIS | Implementation Patterns
Server
Desktop
Distributed
System of Systems
Enterprise/Online
Transforming How We Think and Act . . .
. . . Creating a More Sustainable Future
Moving to the
Cloud
Going Mobile
Advanced Analytics
Integrating
IoT and
Sensor
Networks
Water
Industry
Technology
Trends
Apps
Desktop
APIs
Deployable On-Premises
and in the Cloud
ArcGIS | A Complete GIS Platform
A System for Managing and
Applying Geographic Information
Available as SaaS
Web GIS for Water
Utilities
Connecting the Field with the Enterprise
Field GIS
• Collecting Data
• Reporting Observations
• Managing Work
Supporting the Entire Field Operations Workflow with Apps
Workflow Example
– Water Outage
GeoEvent
Server
Real-Time
Data
Situational
Awareness
Analytics Alerting
GeoAnalytics
Server
Real-Time Analytics | Integrating Sensor Networks and the IoT
Supporting Real-Time GIS Applications . . .
• High-Velocity Data Streams
• Monitoring and Alerting
Improvements
• Scalability
• Availability
• Cloud IoT Connectors
GeoEvent Server
things that move… things that “just happen”…
• airplanes
• vehicles
• animals
• storms
• crimes
• lightning
• accidents
• tweets
Real-Time GIS – Types of observations and data
stationary sensors…
• water gauges
• weather stations
• air quality sensors
• device temperature
• ships
• satellites
• trains
• people
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server
server role
spatiotemporal big
data store
Vehicle Location❖ Ingest Data:
GeoEvent Server – Key Capability #1
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server
server role
spatiotemporal big
data store
Sensors and Instruments❖ Ingest Data:
GeoEvent Server – Key Capability #1
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server
server role
spatiotemporal big
data store
Weather Monitoring❖ Ingest Data:
GeoEvent Server – Key Capability #1
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server
server role
spatiotemporal big
data store
Public Safety Data Feeds❖ Ingest Data:
GeoEvent Server – Key Capability #1
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server
server role
spatiotemporal big
data store
Commercial, Industrial, Utilities❖ Ingest Data:
GeoEvent Server – Key Capability #1
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server
server role
spatiotemporal big
data store
Configurable inputs for any type of data❖ Ingest Data:
GeoEvent Server – Key Capability #1
Bringing real-time and big data capabilities to your ArcGIS Enterprise
Filter:
Blue / Orange
▪ Identify event records with specified attribute values
❖ Apply real-time analytics: Filtering
GeoEvent Server – Key Capability #2
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
▪ Identify event records with specified attribute values
▪ Determine spatial relationships with established geofences
❖ Apply real-time analytics: Filtering
GeoEvent Server – Key Capability #2
geofence
outside
inside
outside
geofence
disjoint crosses
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
✓ Field Calculator
✓ Field Mapper
✓ Buffer Creator
✓ GeoTagger
✓ Incident Detector
✓ Track Gap Detector
…
GeoEvent Server – Key Capability #2
▪ Configure and use over two dozen types of processors
❖ Apply real-time analytics: Processing
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server – Key Capability #2
▪ Configure and use over two dozen types of processors
❖ Apply real-time analytics: Processing
GeoEvent Server
server role
spatiotemporal big
data store
✓ Field Calculator
✓ Field Mapper
✓ Buffer Creator
✓ GeoTagger
✓ Incident Detector
✓ Track Gap Detector
…
Bringing real-time and big data capabilities to your ArcGIS Enterprise
▪ Configurable outputs enable processed events to bestored in a traditional relational geodatabase
▪ When data is received at a high volume, high velocity,or is accumulated over time, a spatiotemporal big datastore is an available noSQL option for enterprise storage
❖ Store data as feature records in a geodatabase
GeoEvent Server – Key Capability #3
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
▪ Relational geodatabase feature services supporttraditional RESTful web applications and APIs
▪ Big data map and feature services support on-the-flyfeature aggregation
❖ Visualize feature records
GeoEvent Server – Key Capability #4
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
▪ Relational geodatabase feature services supporttraditional RESTful web applications and APIs
▪ Big data map and feature services support on-the-flyfeature aggregation
▪ Stream Services
❖ Visualize feature records
DesktopApps and
APIs
ArcGISData Store
ArcGISEnterprise
GeoEventServer
GeoEvent Server – Key Capability #4
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
▪ Configurable outputs provide the capability to format ane-mail or SMS text message
▪ How you choose to disseminate processed event recordsis entirely up to you
❖ Notify stakeholders about detected patterns of interest
GeoEvent Server – Key Capability #5
!
GeoEvent Server
server role
spatiotemporal big
data store
Bringing real-time and big data capabilities to your ArcGIS Enterprise
GeoEvent Server – Key Capability #5
❖ Adjust the behavior of things in our environmentthrough actuation
IoT
Amazon Azure
GeoEvent Server
server role
spatiotemporal big
data store
GeoEvent Server
server role
spatiotemporal big
data store
GeoEvent Server
server role
spatiotemporal big
data store
GeoEvent Server
server role
spatiotemporal big
data store
Out of the Box Input connectors
• Poll an ArcGIS map or feature service
• Poll an external web server or service
• Receive data records via HTTP/POST
• Receive data records via TCP / UDP socket
• Subscribe to an external web socket
• Watch a system folder for changes to a file
GeoEvent Gallery Samples
• FlightAware
• Verizon Connect / Telogis
• Waze
• Apache Kafka
• GeoTab Fleet Management
• …
Partner Gallery connectors
• exactEarth
• Valarm
• CompassLDE
• enviroCar
• …
spatiotemporal big
data store
GeoEvent Server
server role
You can create your owncustom inputs through the
GeoEvent Manageror SDK (Java)
Working with Real-Time DataConfigurable Input Connectors
Out of the Box Output Connectors
• Add or Update a feature
• Add or Update a spatiotemporal big data store
• Send Features to a Stream Service
• Push data records to an external website
• Push data records to an external websocket
• Send data records via TCP/UDP socket
• Send a text, email, or instant message
• Write a local file (CSV, JSON, GeoJSON)You can create your owncustom outputs through the GeoEvent Manager
or SDK (Java)
spatiotemporal big
data store
GeoEvent Server
server role
Gallery Components
• Amazon & Azure IoT
• Hadoop
• Kafka
• MQTT
• ActiveMQ
• RabbitMQ
• MongoDB
• …
Working with Real-Time DataConfigurable Output Connectors
spatiotemporal big
data store
GeoEvent Server
server role
Out of the Box Output Geoprocessing
• Attribute & Spatial Filtering
• Buffer Creator
• Convex Hull Creator
• Difference Creator
• Envelope Creator
• Field Calculator
• Field Enricher
• Field Mapper
• Field Reducer
• Geotagger
• Incident Detector
• Intersector
• Projector
• Simplifier
• Symmetric Difference
• Track Gap Detector
• Union Creator
Sample Add-on Processors
• Add XYZ
• Event Volume Control
• Motion Calculator
• Range Fan
• Reverse Geocoder
• Service Area Creator
• Track Idle Detector
• …You can create your owncustom processors through
the GeoEvent Manageror SDK (Java)
Working with Real-Time DataConfigurable Filters & Processors
Using GeoEvent Server for event
notification
Water Main Break
Alert
Vehicle Location and Monitoring (Demo)Water Main Break Alert Input
Vehicle Location and Monitoring (Demo)Water Main Break Alert Service
Vehicle Location and Monitoring (Demo)Water Main Break Alert Output (Email)
Apps
Desktop
APIs
ArcGISEnterprise
ArcGIS GeoEventServer
spatiotemporalbig data store
analytics storage
visualization
live & historic
aggregates & features
live features
stream services
ArcGIS GeoEvent Serversummary
ingestion
actuation
Spatial / BI
GIS
New Charts
Linked and Responsive
Charts and Maps
On-the-Fly
Visual Models
Integrated Spatial
and Tabular Analysis
• SQL Server
• Oracle
• SAP HANA
• Teradata
DBMSs• Excel
• CSV
Local
Insights | A New Experience for Spatial Analytics
For Analysts and Data Scientists
• Visual, Intuitive, Responsive
• Exploratory Data Analysis and Visualization
Insights for ArcGIS
– Leak Main Break
Analysis
Digitization of Water Trends
Problem Solving More ChallengingMove out from foundational
Imagery
Big Data
Analytics
AR/VR
3D Real-Time (IoT)
Utility configurations designed for rapid deployment
Asset Management
Real-Time
Water Outage Management
Mobile Workforce
Analytics
Water Loss