Download - AWS Big Data Platform_Final_FRA.pptx
![Page 1: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/1.jpg)
Antonio Alvarez | EMEA BDM for Big Data E-mail: [email protected] @A_AlvarezGarcia
AWS Big Data Pla-orm
![Page 2: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/2.jpg)
Better Visibility of Your Business
![Page 3: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/3.jpg)
Big Data & The Cloud
![Page 4: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/4.jpg)
BIG DATA Platform:
Big Data Challenges:
Capacity Planning & Scalability
Lower Cost, OpEx
Experiment & learn more
Advanced profiles
IT Complexity
Data Variety…
..Volume, velocity Old Answers
& Questions
Managed Services
Fully managed,
secured & automated
services that brings agility &
focus
S3, EMR, Kinesis, Redshift,
DynamoDB:
Collect all data, do Complex
computations and processing it, both in Real-Time &
Batch
Sensors (IoT)
Social
Images
Videos
E. Apps.
Documents
Web Logs
Big Value
Machine Learning
Easy deployment of ML powerful models without the need of ML Experts ready to
be used
Virtually unlimited &
Elastic Resources
No heavy lifting & Reduced Time to Market, parallel processing on
demand
New Answers/questions &
Business Ideas Extract the
meaning from all your data & focus on new business
Ideas, Models, etc..
High Cost & Commitment
![Page 5: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/5.jpg)
IT Challenges: SLAs, Sa;sfac;on, low u;liza;on (all?)
![Page 6: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/6.jpg)
Massively Parallel Processing (on demand)
![Page 7: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/7.jpg)
ON A SINGLE INSTANCE
COST: 4h x $2.1 = $8.4 RENDERING TIME: 4h
![Page 8: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/8.jpg)
ON MULTIPLE INSTANCES
COST: 4 x 1h x $2.1 = $8.4 RENDERING TIME:
![Page 9: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/9.jpg)
Expand to 25 instances
EMR (Steady State)
EMR (Batch Processing)
Shrink to 9 instances
EMR (Steady State)
![Page 10: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/10.jpg)
On and Off Fast Growth
Unpredictable peaks Predictable peaks
USAGE PATTERNS: Flexibility and Agility
Fixed!
![Page 11: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/11.jpg)
Some References
![Page 12: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/12.jpg)
netflix
More than 25 Million Streaming Members
50 Billion Events Per Day
![Page 13: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/13.jpg)
~10 PB of data stored in Amazon S3
S3
![Page 14: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/14.jpg)
Data consumed in mul;ple ways
S3
EMR
Prod Cluster (EMR)
Recommenda;on Engine
Ad-‐hoc Analysis Personaliza;on
![Page 15: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/15.jpg)
EMR
S3EMR
EMR
Prod Cluster (EMR)
Query Cluster (EMR)
EMR
EMR
![Page 16: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/16.jpg)
Enterprise DWH
AWS Redshi; helped FT to increase performance (98% faster queries), reduce TCO (80%) and increase Agility
![Page 17: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/17.jpg)
500,000 WRITES PER SECOND DURING SUPER BOWL
![Page 18: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/18.jpg)
FINRA is moving its platform to the AWS Big Data Platform (AWS)
Finra: Financial Industry Regulatory Authority
• Stores and anlyses: 30B Market events per Day
• $10 to $20M annual Savings (Estimations)
• They have increase their Agility, Speed and Cost savings to operate at scale
hVp://aws.amazon.com/solu;ons/case-‐studies/finra/
![Page 19: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/19.jpg)
How Much could this cost me? i.e. Real-time Analysis scenario
![Page 20: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/20.jpg)
![Page 21: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/21.jpg)
500MM tweets/day = ~ 5,800 tweets/sec
Kinesis (Ingestion) cost is $0.765/hour
Redshift (DWH) cost is $0.850/hour (for a 2TB node)
S3 (Data Lake) cost is $1.28/hour (no compression)
Total: $2.895/hour
Cost & Scale
![Page 22: AWS Big Data Platform_Final_FRA.pptx](https://reader034.vdocument.in/reader034/viewer/2022051318/584a2cdc1a28ab0b678b6b96/html5/thumbnails/22.jpg)
Thank you
Contact information: Antonio Alvarez EMEA BDM for Databases & Big Data E-mail: [email protected] @A_AlvarezGarcia