big data for disruptive models - connekt · devops agile all data lakes for all analytics prevent...
TRANSCRIPT
![Page 1: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/1.jpg)
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
David de Santiago, Digital Transformation EMEA, Amazon Web Services
April 2016
Big Data for
Disruptive Models
![Page 2: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/2.jpg)
SOFTWARE IS EATING THE WORLD
DATA IS FUELING
SOFTWARE
![Page 3: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/3.jpg)
What to Expect from the Session
![Page 4: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/4.jpg)
“We use Amazon Machine
Learning to analyze customer
feedback on packaging and
create predictions to identify
products that are suited for our
Frustration Free and
eCommerce ready packaging
standards”
![Page 5: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/5.jpg)
Few Examples at Amazon…
It is what allows us to unload an
entire truck full of products and
make them available for purchase in
as little as 30 minutes
![Page 6: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/6.jpg)
It is what makes Amazon Echo able
to respond to your voice
![Page 7: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/7.jpg)
50 Billions
Predictions
Per Week
![Page 8: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/8.jpg)
What does it take to be data driven?
Applications
DevOps
Agile
All Data
Lakes
For ALL
Analytics
Prevent
Predict
Prescript
![Page 9: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/9.jpg)
Gartner: User Survey Analysis: Key Trends Shaping the Future of Data Center Infrastructure Through 2011
IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares
Available for analysis
Generated data
Data volume - Gap
1990 2000 2010 2020
A Growing Gap
Volume
Velocity
Variety
Veracity
Value
![Page 10: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/10.jpg)
Extracting the value of the data
µs ms s min hour day month Year +
Value $
Time
Predict Prevent Prescript
Streams Operational Traditional Scientific
Comfort Zone
![Page 11: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/11.jpg)
Big Data is Breaking the Old Tools
![Page 12: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/12.jpg)
Lower cost,
higher throughput
Highly constrained
Generation Collection &
Storage
Analytics &
Computation
Collaboration &
Sharing
![Page 13: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/13.jpg)
Elastic and highly scalable
No upfront capital expense
Only pay for what you use+
+
Available on-demand+
=Remove constraints
![Page 14: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/14.jpg)
AnalyzeStore
Glacier
S3
DynamoDB
RDS, Aurora
AWS Big Data Portfolio
Data Pipeline
CloudSearch
EMR (Hadoop)
Redshift
(DWH)
Machine
Learning
ElasticSearchDatabase
Migration QuickSight SQL over
Streams
Kinesis
Firehose
Import Export
(SnowBall)
Direct Connect
Collect
Kinesis (Streams)
![Page 15: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/15.jpg)
TRANSFORMATIONis treating Data as a
Production Assetas Capital
![Page 16: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/16.jpg)
Many Thousands of Companies Use AWS for Big Data
![Page 17: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/17.jpg)
”
“ • Wanted a platform to provide greater speed and
scalability for analyzing petabyte-scale data
• Migrating mission-critical operations to AWS
• Can provide analysts with real-time access to 75
billion records collected daily
• Can move faster, more efficiently in serving core
business processes
FINRA Performs Daily Petabyte-Scale Analysis on Trading Data Using AWS
The Financial Industry Regulatory Authority (FINRA) is
the largest independent regulatory authority in the
United States. It is based in Washington, D.C.
We chose AWS to deliver
innovation at a much larger
scale and much faster to our
core business.
Saman Michael Far
Sr. Vice President of Technology
”
“
![Page 18: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/18.jpg)
World’s leading online travel company, with a portfolio that
includes more than 150 travel sites in 70 countries.
![Page 19: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/19.jpg)
Migrated off legacy DW to Redshift (start to finish) in 7 man-months
Redshift costs 43% of legacy DW for the same data set (legacy DW cost $1.2M/ year)
Tuned queries now running faster in Redshift than on legacy system
![Page 20: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of](https://reader033.vdocument.in/reader033/viewer/2022052000/6012bc43f504e17e4623dce6/html5/thumbnails/20.jpg)
TRANSFORMATION
underpinned by Big Data
Join me on next session for the disruption recipe