geo-analytics with apache spark and in-memory data grids
TRANSCRIPT
Geo-Analytics with Apache Spark and In-Memory Data Grids
Copyright © GigaSpaces 2016. All rights reserved.
Ali HodrojVP, Products and Strategy
@ahodrojStrata+Hadoop New York 2016
2
In-Memory Computing Product Portfolio
Direct customers300+
Fortune / Organizations
40+ / 500+ Cloud Customers
75+ISVs
25+
3
Selected Customers
Geo-Spatial Intelligence
Beyond just maps and visualizations….
GeoSpatial Intelligence: Confluence of 3 Trends
5
GeoSpatial Insight is Essential
Financial Services: Detect and prevent fraud by correlating spatial, temporal, and transactional data altogether
Retail: Geospatial data in personalization can help retailers optimize their promotional activity based on customer locations
Insurance: Risk is often tied to location. Insurers can perform risk simulations against vast amounts of data to come up with the right risk model
6
Implementing true GeoSpatial insight
Batch + Real-timeData
Convergence
Closed Loop Analytics(Insights trigger
workflows)
Multi-tenant, Geo-
Federated, Scale-out
requires…
7
XAP: fast scale-out in-memory data grid
Large-scale data processing framework
Low-Latency GeoSpatial SQL
Apache Spark meets Low-Latency GeoSpatial Processing
8
GigaSpaces XAP In-Memory Data Grid
Elastic Scale-out In-Memory Storage (Shared-nothing, Linear scalability, Elastic capacity)
Low latency and High Throughput (co-located ops, event-driven, fast indexing)
High Availability and Resiliency (auto-healing, multi-data center replication, fault tolerance)
Rich API and Query Language (SQL, Spring, Java, .NET, C++)
9
Pluggable data initial load
High Performance Spark with OLTP Capabilities
10
Pluggable data initial load
12
Case Study: Vehicles/Fleet Spatial Analytics
Challenge
• Stream data from 1,000s of Taxis• Actively monitor and generate real-
time notifications• Location-based tracking, Geo-fencing
Solution
• Elastically scale stream processing and transactional apps together
• Real-time operational intelligence through live in-memory data grid
• Extensible and dynamic pricing/routing/fleet rebalancing rules
Edge components
Data Sources
Try it out
http://insightedge.io
@InsightEdgeIO Booth #667