winning the on-demand economy with spark and predictive analytics
TRANSCRIPT
![Page 1: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/1.jpg)
Winning the On-Demand Economy with Spark and Predic9ve Analy9cs
Ankur Goyal, VP Engineering, MemSQL
Gartner BI March 20161
1 Deckset Plain Jane Black
![Page 2: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/2.jpg)
We live in an on-demand economy
![Page 3: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/3.jpg)
Consumers are condi.oned to instant services, like Uber, Stripe, and Airbnb
![Page 4: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/4.jpg)
Where does that leave enterprises?
![Page 5: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/5.jpg)
Racing to meet internal and external expecta1ons for speed and
personaliza,on
![Page 6: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/6.jpg)
Batch processing is the enterprise enemy
![Page 7: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/7.jpg)
Enterprises must move from overnight to
Real-&me, intra-day opera&ons
![Page 8: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/8.jpg)
Because businesses need tomake every moment work for them
![Page 9: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/9.jpg)
The key to harnessing data in real 1me?
A real-(me data pipeline with Apache Ka3a, Apache Spark, and an Opera(onal Database such as MemSQL
![Page 10: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/10.jpg)
Massive Ingest and Concurrent Analy5cs• Instant accuracy to the latest repin
• Build real-5me analy5c applica5ons
• 1 GB/sec totaling 72 TB/day
![Page 11: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/11.jpg)
Using Real-Time for Personaliza3on• Reach overlap and ad op/miza/on
• Over 60,000 queries per second
• Millisecond response /mes
![Page 12: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/12.jpg)
MemSQL PowerStreamPredic'ng the global health of wind turbines
Dataset: 200,000 wind turbines, 20,000 wind farms
<$20,000 annual cost for AWS hardware
![Page 13: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/13.jpg)
Let's build PowerStream
![Page 14: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/14.jpg)
Move from a Real-Time Dashboard to Predic7ve Applica7ons
![Page 15: Winning the On-Demand Economy with Spark and Predictive Analytics](https://reader031.vdocument.in/reader031/viewer/2022022414/587c0f321a28ab03768b63cd/html5/thumbnails/15.jpg)
Ques%ons?Stop by MemSQL Booth #119