amazon web services - ucf computer sciencedcm/teaching/cda5532... · amazon web services: caching...
TRANSCRIPT
![Page 1: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/1.jpg)
Amazon Web Services:Caching and Storage Options
Summarized by: Michael Riera
9/17/2011
University of Central Florida – CDA5532
![Page 2: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/2.jpg)
Agenda
• Purpose
– Cost Saving and reduced latency
• Cache Framework and Relative Options
• Related Work• Related Work
• Experiment Results
• Conclusion
![Page 3: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/3.jpg)
Introduction
• Evaluating the performance and costsassociated with a number of caching andstorage options offered by the Cloud.
– High performance system:– High performance system:
• Benefits: fetching, data fetching and reuse
– Trade-off between performance and usage cost
![Page 4: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/4.jpg)
AWS Options
• Approach 1: Instantiating VM and save data inmemory or in storage (limited capacity)– Higher Cost, fastest access time
• Approach 2: Persistent storage with AWS S3• Approach 2: Persistent storage with AWS S3– Overhead in slower throughput
• Approach 3: Persistent storage with ElasticBlock Storage– Storage can only connect to 1 instance at a time
– EC2 can connect to multiple EBS
![Page 5: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/5.jpg)
Cache Framework• Automatically allocatesmachine instances as toexpand cache’s capacity
• Managed using aconsistent hashing approach
• Data set k
• Nodes which should store• Nodes which should storedata is referenced by thenearest bucket larger than k
• Each node stores a B+-Tree which indexes the storeddata.
![Page 6: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/6.jpg)
Experiment Setup
• Resource Configuration: We have run experiments over thefollowing configurations:– S3: Data stored as files directly onto the S3 storage service
(persistent).– ec2-m1.small-mem: Data stored in memory on Small EC2 instance
(volatile, moderate I/O).– ec2-m1.small-disk: Data stored as files on disk on Small EC2 instance– ec2-m1.small-disk: Data stored as files on disk on Small EC2 instance
(volatile, moderate I/O).– ec2-m1.small-ebs: Data stored as files on a mounted Elastic Block
Store volume on small EC2 instance (persistent, moderate I/O).– ec2-m1.xlarge-mem: Data stored in memory on Extra Large EC2
instance (volatile, high I/O).– ec2-m1.xlarge-disk: Data stored as files on disk on Extra Large EC2
instance (volatile, high I/O).– ec2-m1.xlarge-ebs: Data stored as files on a mounted Elastic Block
Store volume on Extra Large EC2 instance (persistent, high I/O).
![Page 7: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/7.jpg)
Experiment Application
• Land Elevation Change Process
– Input: A Location L, and a coordinate t, where t’ :t< t’ representing the times of interest
– Output: Locates Digital Elevation Models (DEM)– Output: Locates Digital Elevation Models (DEM)Files with respect to (L, t) and (L, t’) representinglarge matrix.
• 2000 Random queries with different instanttypes
![Page 8: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/8.jpg)
Experiment Results
![Page 9: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/9.jpg)
Experiment Results
![Page 10: Amazon Web Services - UCF Computer Sciencedcm/Teaching/CDA5532... · Amazon Web Services: Caching and Storage Options Summarized by: Michael Riera 9/17/2011 University of Central](https://reader030.vdocument.in/reader030/viewer/2022041005/5eaa4957fdbbeb3bcc61a689/html5/thumbnails/10.jpg)
Experiment Results