content distribution

Content Distribution and Archival in a Digital Age

!!

Dan Coffey dan_coffey@harvard.edu

!David J. Malan

malan@harvard.edu

EC2

EC2 EC2...

EC2 EC2

ELB

...

EC2 EC2

ELB

RDS

...

EC2 EC2

ELB

RDSVPC

...

EC2 EC2

ELB

RDS

student

VPC

...

EC2 EC2

ELB

RDS

Route 53

student

VPC

...

EC2 EC2

ELB

RDS

SESRoute

53

student

VPC

...

S3

student

CF

Content Distribution

Outbound Data

Bandwidth Bucket Size

CS50x 2012 342.49 TB 335 GB

CSE1 2013 27.65 TB 123 GB

http://naturalearth.springercarto.com/ne3_data/8192/textures/3_no_ice_clouds_8k.jpg http://webdesignledger.com/wp-content/uploads/2009/03/icons_9.jpg

CDNContent Delivery Network

http://naturalearth.springercarto.com/ne3_data/8192/textures/3_no_ice_clouds_8k.jpg http://webdesignledger.com/wp-content/uploads/2009/03/icons_9.jpg

http://upload.wikimedia.org/wikipedia/commons/f/f9/NCDN_-_CDN.png http://blog.cloudlytics.com/wp-content/uploads/2014/01/s3.png

Local copy

S3 copy

CloudFront copies

Live Streaming

Alternative Services

Archiving

Media Lifecycle for CS50

Source Files Project Files Master Files

Day 0 Backed up on fast RAID Created

Project Completion

Archived locally to slow RAID

Archived locally to slow RAID

Archived locally to slow RAID

Day 365 Removed Removed Archived to Amazon Glacier

Content Distribution and Archival in a Digital Age

!!

Dan Coffey dan_coffey@harvard.edu

!David J. Malan

malan@harvard.edu