inside dropbox: understanding personal cloud storage services · personal cloud storage services...
TRANSCRIPT
![Page 1: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/1.jpg)
Inside Dropbox: Understanding Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, Sadre, Pras University of Twente
![Page 2: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/2.jpg)
What they’ve done
• First to study Dropbox • Characterize the workload typical users have • Find bottlenecks
![Page 3: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/3.jpg)
How Dropbox works
• Two main types of Dropbox servers: ▫ Control ▫ Data storage
• Dropbox owns the control servers • Outsources the data storage servers to Amazon.
![Page 4: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/4.jpg)
Dropbox communication
![Page 5: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/5.jpg)
Communication specifics
• Client interacts with control to get working orders
• Routes to storage to store directly • ACK-ing is sequential in storage
![Page 6: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/6.jpg)
Control Servers
• 3 types: ▫ Notification ▫ Meta-data administration ▫ System-log servers
• They talk about 1 and 2, but not really 3…
![Page 7: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/7.jpg)
Control Servers
• Dropbox client keeps open continuous TCP connection
• Connects to notification server about changes being pushed to other machines
• These connections not encrypted.
![Page 8: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/8.jpg)
Metadata servers
• Communicate with several short TLS connections
• Done to handle batches sent and received. • Used mainly during file transfer.
![Page 9: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/9.jpg)
Data servers
• Over 500 distinct domain names point to Amazon servers
• Two basic types of commands: store and retrieve • In new version of Dropbox, there is store_batch
and retrieve_batch
![Page 10: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/10.jpg)
Testing protocols
• Basic Idea: ▫ Analyze traffic from two university campuses ▫ Analyze traffic from two different residential
networks ▫ Devise a methodology for monitoring cloud
storage traffic
![Page 11: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/11.jpg)
How they monitored traffic
• Most client communications are encrypted with TLS
• Dropbox client was told to use a Squid server they set up
• Module SSL-bump terminated SSL connections and saved decrypted traffic flows.
• Then they mirrored the required Dropbox certificates to prevent server ending communication
![Page 12: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/12.jpg)
Tstat and key data points
• Tstat ▫ Exposes client and server Ips ▫ Amount of exchanged data ▫ Retransmitted segments ▫ RTT ▫ Number of TCP segments that had PSH flag
• Used Tstat at 3 vantage points and collected data for 42 straight days
![Page 13: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/13.jpg)
College 1 and College 2
• College 1 is a wired main campus network • Most of the machines are used for either
research or administration (akin to Tlab or Wilk machines)
• College 2 monitors the peripheral nodes of a college network
• Dorms, Norris, etc.
![Page 14: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/14.jpg)
Home 1
![Page 15: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/15.jpg)
Home 1 for Data Volume
![Page 16: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/16.jpg)
Home 1 implications
• Dropbox is more popular and more widely used • Makes sense, although they (rightly) point out
that Google Drive didn’t really exist in its final form
• How useful is this data?
![Page 17: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/17.jpg)
Youtube and Dropbox comparisons
![Page 18: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/18.jpg)
How Dropbox manages data
![Page 19: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/19.jpg)
YouTube and Dropbox
• Exists to show how popular Dropbox is compared to YouTube on college campuses.
• Also used to show weekly network traffic
![Page 20: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/20.jpg)
Differences between networks
![Page 21: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/21.jpg)
Network differentiation
• Implication: Better network, better performance • Other implication: Networks closer to Dropbox
servers operate really fast.
![Page 22: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/22.jpg)
Differences between Storage and Control
![Page 23: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/23.jpg)
Storage Throughput (upload)
![Page 24: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/24.jpg)
Storage Throughput (download)
![Page 25: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/25.jpg)
Their takeaways
• Dropbox has more traffic because Google Drive and SkyDrive weren’t launched.
• Dropbox performs better when it has storage servers closer to its clients
• Dropbox’s overall throughput is pretty low • Most of their recommendations were fixed with
the update
![Page 26: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/26.jpg)
Dropbox User Profiles
• Different people use Dropbox for different things • Home users tend to download more • 40% of college users have at least 5 shared
folders
![Page 27: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/27.jpg)
Discussion
• A lot of their results seem kind of basic • They say that one of the big things they’re doing
is devising a method for monitoring cloud storage traffic, and they barely mention it.
• They say it’s an analysis, but their data still ends up being more of a comparison
![Page 28: Inside Dropbox: Understanding Personal Cloud Storage Services · Personal Cloud Storage Services Drago, Mellia, Munafo, Sperotto, ... Differences between Storage and Control . Storage](https://reader034.vdocument.in/reader034/viewer/2022043010/5f9fe54b54dde40c24529ffa/html5/thumbnails/28.jpg)
Discussion, cont’d
• Are their recommendations any different than what you would tell any other company?
• Is the YouTube comparison at all relevant or necessary?
• If Dropbox is global, why is improving their network topology on a local scale important (as opposed to global optimization)?
• Why don’t they talk about their methodology???