arcgis geoevent processor for server: an introduction
TRANSCRIPT
ArcGIS GeoEvent Processor
for Server: An Introduction
2013 Esri Mid-Atlantic User Conference December 10-11 | Baltimore, MD
Derek Law
Esri, Redlands
Agenda
• Real-time GIS overview
• Working with real-time data
• Performing continuous processing and analysis
GIS data
Credit: iStockphoto/chris_lemmens
• GIS data typically represents state at a specific moment in time:
“historic”, “current”, or “future”.
Real-time GIS data
• Real-time GIS data is a continuous stream of events flowing from
sensors where each event represents the latest state of the sensor.
- Emergency Response
- Utility Networks and Warehouses
- Environmental
Web Desktop
Runtime
Mobile
Applications
Features Challenge #1
Police Person
Ambulance
Police Car
110°
Storm
Wind
Temperature
Earthquake
Wild Fire
Network Sensor
Warehouse Item
Analyzing real-time GIS data
• Are my field personnel working within the designated project area?
Web Desktop
Runtime
Mobile
Applications Features
Equipment
Alert
Challenge #2
Continuous
Analysis
Outside
Boundary
Analyzing real-time GIS data
• Tell customer when their delivery truck is 15 minutes away.
Continuous
Analysis
Web Desktop
Runtime
Mobile
Applications Features
Delivery Vehicle
Notification Enter
Customer Area
Challenge #3
ArcGIS supports real-time GIS
Real-time data
ArcGIS Online /
Portal for ArcGIS
Operations
Dashboard Collector
ArcGIS Server
GeoEvent Processor
ArcGIS GeoEvent Processor for Server
• Receives real-time streaming data
• Performs continuous processing and analysis
• Sends updates and alerts to those who need it where they need it
Continuous Processing
and Analysis
Connectors
Connectors
im
ws://
Alerts
Real-Time Data Features
Web Desktop
Runtime
Mobile
Applications
ArcGIS Server
GeoEvent Processor
Working with real-time data
You can add your own connectors.
Receiving real-time data Input connectors
• You can easily integrate real-time data with ArcGIS by using a
connector that meets your needs.
Real-time data
ArcGIS for Server
GeoEvent Processor
Receive NMEA
Receive Sierra Wireless
Receive Tweets
Receive Instagram
Receive Trimble
Receive GPX
NMEA
GPX Receive Vessels
Receive Geomessages
Receive Air Traffic Control
Receive Cursor-on-Target
Receive VMF
CoT
VMF
Message Geo
Watch a folder for new Files
Receive RSS
Receive from a Socket
Receive from a Web Socket
Receive on a REST Endpoint
Poll an ArcGIS Server
Poll an external website
ws://
http://
http://
Receive RSS
Receive from a Socket
Receive from a Web Socket
Receive on a REST Endpoint
ws://
http://
Receive from a Socket
Receive from a Web Socket ws://
Twitter monitoring
Demonstration
Demo
Sending real-time data Output connectors
• You can easily send resulting streams to those who need it where
they need it using a connector.
Web Desktop
Runtime
Mobile ArcGIS for Server
GeoEvent Processor
Real-time data
You can
add your
own
connectors
Send to RabbitMQ
Send to ActiveMQ
Send to HornetQ
Write to Hadoop
Write to MongoDB
Send a Tweet
Send to CESIUM
im
ws://
Send an Instant Message
Send an email
Update a Feature
Add a Feature
Send to Tracking Analyst
Send a Text Message
Publish to REST Endpoint
Send to a Web Socket
Send to a Socket
Write to a File
im
ws://
Send an Instant Message
Send an email
Update a Feature
Add a Feature
Send to Tracking Analyst
Send a Text Message
im
Update a Feature
Add a Feature
Send to Tracking Analyst
Update a Feature
Add a Feature
ArcGIS for Server
feature layers
Sending real-time data to features Using local feature services
GeoEvent Processor
Filters Processors
Inp
uts
Ou
tpu
ts
GeoEvent Services
Update a Feature
Add a Feature
Operations Dashboard
for ArcGIS
ArcGIS
Online / Portal
operation view
web map
Your Dashboards
Your
Applications
Web APIs
JavaScript
Flex
Silverlight/WPF
Mobile GIS
iOS
Android
Windows Phone
Runtimes
Windows Store
Mac OS X
Java
Qt
Real-time
data
Your
Applications
Web APIs
JavaScript
Flex
Silverlight/WPF
Mobile GIS
iOS
Android
Windows Phone
Runtimes
Windows Store
Mac OS X
Java
Qt
ArcGIS
Online / Portal
operation view
web map
Sending real-time data to features Using remote feature services
ArcGIS for Server
feature layers
GeoEvent Processor
ArcGIS for Server
Filters Processors
Inp
uts
Ou
tpu
ts
GeoEvent Services
Update a Feature
Add a Feature
Operations Dashboard
for ArcGIS
Your Dashboards
Real-time
data
Your
Applications
ArcGIS
Online / Portal
operation view
web map
Sending real-time data to features Using ArcGIS Online feature services
feature layers
GeoEvent Processor
ArcGIS for Server
Filters Processors
Inp
uts
Ou
tpu
ts
GeoEvent Services
Update a Feature
Add a Feature
Web APIs
JavaScript
Flex
Silverlight/WPF
Mobile GIS
iOS
Android
Windows Phone
Operations Dashboard
for ArcGIS
Your Dashboards
Runtimes
Windows Store
Mac OS X
Java
Qt
Real-time
data
Real-time
data
Sending real-time data to big data stores
• GIS Tools for Hadoop
- http://github.com/Esri/gis-tools-for-hadoop
ArcGIS for Desktop
Geoprocessing
GIS Tools for Hadoop
2013/03/06/10/vehicles-2013-03-06-10.json
2013/03/06/11/vehicles-2013-03-06-11.json
2013/03/06/12/vehicles-2013-03-06-12.json
2013/03/06/13/vehicles-2013-03-06-13.json
2013/03/06/10/vehicles-2013-03-06-10.tsv
2013/03/06/11/vehicles-2013-03-06-11.tsv
2013/03/06/12/vehicles-2013-03-06-12.tsv
2013/03/06/13/vehicles-2013-03-06-13.tsv
GeoEvent Processor
ArcGIS for Server
Filters Processors
Inp
uts
Ou
tpu
ts
GeoEvent Services
Write to Hadoop
Write to MongoDB
Write to a Hadoop Distributed File System (HDFS)
Write to a MongoDB Document Store
Performing continuous
processing and analysis
Web Desktop
Runtime
Mobile
im
ws://
Continuous processing and analysis GeoEvent Services
• A GeoEvent Service configures the flow of GeoEvents,
- the Filtering and GeoEvent Processing steps to perform,
- what input(s) to apply them to,
- and what outputs(s) to send the results to.
ArcGIS for Server
GeoEvent Processor
Real-time data
Twitter Input Add Tweet Feature Geolocated
Filter
Write Tweets to Hadoop
Twitter Monitor (GeoEvent Service)
Continuous processing and analysis
• Calculate new fields on a geoevent: Field Calculator, GeoTagger
• Modify a geoevent: Field Enricher, Field Reducer
• Derive a new geoevent: Field Mapper, Incident Detector
GeoEvent Service
GeoTagger
Field Calculator
Field Enricher
Field Reducer
Field Mapper
Incident Detector
Input 1 Output 1
ArcGIS Server with GeoEvent Processor
Processors
Processors Calculate new field on a geoevent
• A Field Calculator processor uses an expression to
- calculate a new field or update an existing field.
- Expressions can be mathematical expressions or regular expressions.
• A GeoTagger processor
- uses a spatial condition to tag the event with related geometries.
Expression
Enriched GeoEvent
GeoEvent
Spatial Condition
Enriched GeoEvent
GeoEvent
Processors Modify a geoevent
• A Field Enricher processor
- enriches the geoevent with new fields derived from a data source:
feature service or file.
Enriched GeoEvent
GeoEvent
Feature Service
• A Field Reducer processor
- removes fields from a geoevent.
Reduced GeoEvent
Fields to remove
Processors Derive a new geoevent
• A Field Mapper processor
- translates from one geoevent format to another.
Translated GeoEvent
Incoming GeoEvent
Mapping
Continuous processing and analysis
• An Incident Detector processor
- creates an incident upon an opening condition being met,
- maintains state for the duration of the incident,
- closes the incident based on a closing condition or expiration.
GeoEvent Service
Incident Detector
91 90 92 65 68 90 91 90 92 81 73 68 66
Close Incident
81
Open Incident
90 noiseDecibel >= 90
Opening Condition
Input 1 Output 1
Derive a new geoevent
Ambulance monitoring
Demonstration
Demo
Processors Using an incident detector to monitor conditions
AmbulanceMonitor (GeoEvent Service)
ArcGIS Server with GeoEvent Processor
AmbulanceMonitor/1 “Vehicle”
ambulance-feature-service-out
Speed
Monitoring
AmbulanceMonitor/0 “Alerts”
alert-feature-service-out
Panic
Monitoring
ambulance-in
DangerousAreaMonitor (GeoEvent Service)
Dangerous Area
Monitoring alert-feature-service-out ambulance-in
HospitalArrivalMonitor (GeoEvent Service)
Hospital
Proximity
text-message-out
email-out
alert-feature-service-out ambulance-in
Solutions and sample applications Applying real-time GIS
• A number of sample applications and solutions leverage GeoEvent
Processor to enable real-time GIS capabilities within them including:
- Defense and Intelligence: http://resources.arcgis.com/en/communities/defense-and-intelligence/
- ArcGIS for the Military
- ArcGIS for the National Guard
- ArcGIS for Intelligence
- Asset Monitor
- Route Monitor
ArcGIS
for the Military
ArcGIS for
Intelligence
Route
Monitoring
Asset
Monitoring
Real-time GIS with GeoEvent Processor Summary
• ArcGIS is a dynamic platform that enables real-time visualization,
continuous analysis, and understanding of our world.
• GeoEvent Processor allows you to:
- be alerted when interesting events occur
- react and make smarter decisions faster
- to know what is happening, as it happens
• Product Page
- http://pro.arcgis.com/share/geoevent-processor
Copyright © 2013 All Rights Reserved