geospatial analytics data science sg meetup
TRANSCRIPT
UNLOCKING AND EMPOWERING LOCATIONAL INFORMATION
1© 2017 National University of Singapore. All Rights Reserved
THE NEW DIMENSION OF ANALYTICS
BRANDON NG
23rd March 2017
Agenda
© 2017 National University of Singapore. All Rights Reserved 2
• The Evolution
• Geospatial analytics with Spatial
Statistics
• Geovisualisation
• Traffic Analytics – using Tool
• Geospatial Analytics – using
Programming
• Emerging Trend and Technologies
THE EVOLUTION
FROM GIS TO GEOSPATIAL ANALYTICS AND GEOVISUALISATION
© 2017 National University of Singapore. All Rights Reserved 3
Microscopic Traffic Simulation Model
© 2017 National University of Singapore. All Rights Reserved 4
Prescriptive
Analytics
Multi-
Disciplinary
S T NG, Travel time savings for trucks with real-time traffic information during incidents, NUS 2004.
Widespread Location Data Will Enable
All Forms of Social and Commercial Interactions
© 2017 National University of Singapore. All Rights Reserved 5
Location, the Next Champion in Analytics , Gartner, Inc. | G00276851
Locationthe Next Champion in Analytics
Where are things happening? Or
Where are the customer?
spatial dimension not yet a key component
• BI and analytics strategy
to expand the knowledge and expertise within the organisation
© 2017 National University of Singapore. All Rights Reserved 6
Thomas W. Oestreich, Location, the Next Champion in Analytics, Gartner 2015.
Hype Cycle for Business Intelligence and Analytics, 2016
© 2017 National University of Singapore. All Rights Reserved 7
Kurt Schlegel, Hype Cycle for Business Intelligence and Analytics, 2016, Gartner 2016.
Domain Analytics
© 2017 National University of Singapore. All Rights Reserved 8
Valerie A. Logan, Melissa Davis, Svetlana Sicular, Gareth Herschel, Kurt Schlegel, Jorgen Heizenberg,
Domain Analytics: Harnessing the Pervasive Nature of Analytics, Gartner 2016.
Supply Chain Analytics
© 2017 National University of Singapore. All Rights Reserved 9
Valerie A. Logan, Melissa Davis, Svetlana Sicular, Gareth Herschel, Kurt Schlegel, Jorgen Heizenberg,
Domain Analytics: Harnessing the Pervasive Nature of Analytics, Gartner 2016.
Location Intelligence
© 2017 National University of Singapore. All Rights Reserved 10
Valerie A. Logan, Melissa Davis, Svetlana Sicular, Gareth Herschel, Kurt Schlegel, Jorgen Heizenberg,
Domain Analytics: Harnessing the Pervasive Nature of Analytics, Gartner 2016.
London Cholera Map
© 2017 National University of Singapore. All Rights Reserved 11
Data Maps :
Pioneer Maps for
Healthcare
Use of map to
chart patterns of
disease using dot
map
Plotted the
location of deaths
from cholera in
central London for
September 1854
By Dr. John Snow
Visualisation of Train Movement
© 2017 National University of Singapore. All Rights Reserved 12
Marey's graphical train
schedule for Paris to Lyon
in the 1880s.
Operation diagram for
12:00 noon, July 25,
1985, Tokaido and Sanyo
Shinkansen Lines
(bullet train), Japanese
National Railroad
control room, Tokyo.
Edward R. Tufte, The Visual Display of Quantitative Information, 1983
Edward R. Tufte, Envisioning Information, 1990
Visualisation of Train Movement
© 2017 National University of Singapore. All Rights Reserved 13
Visualizing MBTA DataAn interactive exploration of Boston's subway system
http://mbtaviz.github.io/
How the Circle Line rogue train was caught with data
© 2017 National University of Singapore. All Rights Reserved 14
https://blog.data.gov.sg/how-we-caught-the-circle-line-rogue-train-with-data-79405c86ab6a#.mr0axgyy1
GIST Body of Knowledge (BoK)
© 2017 National University of Singapore. All Rights Reserved 15
http://carto.byu.edu/bokviswiki/
GEOSPATIAL ANALYTICS WITH SPATIAL STATISTICS
FOR ANALYZING SPATIAL PATTERNS
© 2017 National University of Singapore. All Rights Reserved 16
Spatial Statistics for Analyzing Spatial Patterns
• To identify any patterns, trends, spatial
relationships
• Random patterns and clustering
• Geographic distribution measurements
• Geographic pattern analysis
• Geographic cluster analysis
© 2017 National University of Singapore. All Rights Reserved 17
Functional Area:
Geographic distribution measurements
• Mean Center
• Central Feature
• Standard Distance
• Directional Distribution (Standard Deviational
Ellipse)
• Linear Directional Mean
• Address the “Where is the centre?”, “What is the shape
and orientation?”, “How dispersed are the features?”
© 2017 National University of Singapore. All Rights Reserved 18
Functional Area:
Geographic pattern analysis
• Average Nearest Neighbor
• Spatial Autocorrelation (Moran's I)
• High/Low Clustering (Getis-Ord General G)
• Evaluate features, or the values associated with features form a
clustered, dispersed, or random spatial pattern
© 2017 National University of Singapore. All Rights Reserved 19
Functional Area:
Geographic cluster analysis
• Cluster and Outlier Analysis (Anselin Local Moran's I)
• Hot Spot Analysis (Getis-Ord Gi*)
• To identify hot spots, cold spots, or spatial outliers
• To identify or group features with similar characteristics
© 2017 National University of Singapore. All Rights Reserved 20
GEOVISUALISATION
© 2017 National University of Singapore. All Rights Reserved 21
Spatial-Temporal Analytics
© 2017 National University of Singapore. All Rights Reserved 22
https://brandonng.carto.com/viz/a0188ae0-4a45-11e6-af6c-0ef24382571b/public_map
https://shwetasharma.carto.com/viz/d8aeafc8-7e80-11e6-a0ae-0e233c30368f/public_map
Dot Plot / Bubble Plot Map / Heat Map
© 2017 National University of Singapore. All Rights Reserved 23
https://brandonng.carto.com/viz/a0188ae0-4a45-11e6-af6c-0ef24382571b/public_map
Story Map
© 2017 National University of Singapore. All Rights Reserved 24
http://wdcintel.maps.arcgis.com/apps/MapJournal/index.html?appid=7c71437449dd468e8949bdfcd404a002
Geo-Dashboard
© 2017 National University of Singapore. All Rights Reserved 25
http://www.darkhorseanalytics.com/
Geo-InfographicsCybersecurity Poverty Index 2016
© 2017 National University of Singapore. All Rights Reserved 26
http://www.enterpriseinnovation.net/infographic/infographic-cybersecurity-poverty-index-
2016?utm_source=silverpop&utm_medium=newsletter&utm_campaign=EIDaily_enews
TRAFFIC ANALYTICS- TOOL
CROWD MANAGEMENT
© 2017 National University of Singapore. All Rights Reserved 27
Traffic Analytics
• Crowd management
• Public transport management
• Traveler behavior
• Travel pattern (OD Matrix)
© 2017 National University of Singapore. All Rights Reserved 28
Origin and Destination (OD) Matrix
© 2017 National University of Singapore. All Rights Reserved 29
Routing
© 2017 National University of Singapore. All Rights Reserved 30
Heatmap
31© 2017 National University of Singapore. All Rights Reserved
Geoprocessing Model
© 2017 National University of Singapore. All Rights Reserved 32
Part I: Geovisualization of points on map and creation of a database
Part II: Creation of routes using network analysis tools
Part III: Creation of heat map using route layer
GEOSPATIAL ANALYTICS - PROGRAMMING
ESRI ARCGIS API ON ONEMAP
© 2017 National University of Singapore. All Rights Reserved 33
Point-of-Interest Identification
© 2017 National University of Singapore. All Rights Reserved 34
Facilities Identification with
Polygon Drawing
Location Visualisation
© 2017 National University of Singapore. All Rights Reserved 35
Visualisation of Walking Distance to
School (1km, 2km)
Identification of Facilities/Point-of-
Interest/ Nearby Amenities
Dynamic Routing
© 2017 National University of Singapore. All Rights Reserved 36
Visualisation of Construction Site
© 2017 National University of Singapore. All Rights Reserved 37
Accident Occurrence & Severity Level
© 2017 National University of Singapore. All Rights Reserved 38
School Compound Safety Analysis
© 2017 National University of Singapore. All Rights Reserved 39
School Compound Safety Analysis
© 2017 National University of Singapore. All Rights Reserved 40
GeoCode and Reverse GeoCode
© 2017 National University of Singapore. All Rights Reserved 41
http://www.onemap.sg/API/Help/HTMLSource/ReverseGeocode.aspx
EMERGING TRENDS AND TECHNOLOGIES
IN GEOSPATIAL SPACE
© 2017 National University of Singapore. All Rights Reserved 42
Social Media Analytics
© 2017 National University of Singapore. All Rights Reserved 43
Tweet Sentiment
(Positive, Neutral
or Negative)
Intelligent System (AI) for Intelligent Transportation System
© 2017 National University of Singapore. All Rights Reserved 44
https://www.theguardian.com/sustainable-business/2016/aug/23/uber-for-couriers-australian-logistics-software-promises-to-
minimise-traffic-and-emissions
Mobility-as-a-Service
© 2017 National University of Singapore. All Rights Reserved 45
https://www.ncs.com.sg/documents/20184/111927/Changing+the+way+you+travel+with+Mobility-as-a-
Service/2c8f561c-0af1-4213-83d2-b02b65c390fd
3 trends that will shape Geo Industry in 2017
Jan Erik Solem, CEO of Mapillary
Automotive mapping
• Self-driving vehicle / digital mapping
Deep Learning & AI
• Machine-generated to maps
Lots of outsiders
• In the GIS industry
© 2017 National University of Singapore. All Rights Reserved 46
http://geoawesomeness.com/3-trends-will-shape-geo-industry-2017-according-jan-erik-solem-ceo-mapillary/
2017 in Geo- Javier de la Torre, CEO at CARTO
strong growth in the
• Data Analytics space & Location Based Services (LBS)
the next 1 Million users to start using geospatial technology in 2017 will not even know what GIS is
Location Intelligence will be delivered seamlessly via their apps, embedded in Data Analytics space
© 2017 National University of Singapore. All Rights Reserved 47
http://geoawesomeness.com/2017-geo-according-javier-de-la-torre-ceo-carto/
8 Crazy Predictions for Geospatial in 2017 - Matt Sheehan of WebMapSolutions
1. Continued hype around drones, augmented reality and anything shiny and new.
2. Mobile GIS is dead
3. Greater demand and competition in the BI-GIS space
4. Dramatic increase in demand for GIS professionals
5. More focus on solving problems
6. From complex & expensive to easy, affordable, does exactly what is needed
7. Wider adoption of (new) Web GIS
8. The emergence of a new breed of geospatial service companies
© 2017 National University of Singapore. All Rights Reserved 48
My opinion………every single aspect of analytics with Geospatial Dimension
Real Time / Edge Analytics with geospatial dimension
Web GIS/ GIS-as-a-Service
Story map / Geo-Dashboard & Geo-Infographics
Big Data Analytics
Internet-of-Things
Drone
Cognitive Computing - Deep Learning
© 2017 National University of Singapore. All Rights Reserved 49