studio of the future: production workflow in aws
DESCRIPTION
On 3/29/12, Dave Rocamora, VP of DevOps at Control Group, Charlie Miller, Associate Partner, Media & Entertainment at Control Group, and Mark Ramberg, AWS Business Development Manager discussed the media production roadmap for the Studio of the Future. This webinar provided architecture guidance and highlight vendors and AWS products that will help studio managers, production managers, and IT leaders understand how AWS can be used to power the Media Production Studio of the Future.TRANSCRIPT
TITLE
1MTA
TITLE
1
STUDIO OF THE FUTURE
March 29, 2012
CGbeautifully engineered
CONTROL GROUP +
BIOS
2
CHARLIE MILLER
Associate PartnerM&E
Control Group
DAVID ROCAMORA
VP of DevOpsCloud ExpertControl Group
MARK RAMBERG
Business Development& Strategy for Media
Amazon Web Services
CONTROL GROUP
CONTROL GROUP
3
•Technology & design company in NYC
•Founded in 2001, currently ~85 developers, engineers, UX designers, and strategists
•Expertise from infrastructure to interface
CONTROL GROUP
CONTROL GROUP
4
RAARalph Applebaum
Associates Incorporated
CONTROL GROUP
CONTROL GROUP
5 CONTROL GROUP
Traditional M&E solutions for broadcast and post environments
Cloud systems architecture and
integration expertise
6
• Inflexible and fixed
• Requires large upfront expense
• Pay for peak capacity at all times
• Sheer volume of content
STUDIOS TODAY
• Number of formats required
• Users and teams are distributed
• Deadlines are shrinking
• Rapidly evolving technology
CHALLENGES
CONTROL GROUP
7
Render
Encode/Transcode Archive
iTunes/Netflix
Broadcast
OVP
Storage
Content Creators
Distribution
Customers/Viewers
STUDIOS TODAY
CONTROL GROUP
8
HOW AMAZON GOT INTOCLOUD COMPUTING
CONTROL GROUP
?
9
GLOBAL INFRASTRUCTURE FOR GLOBAL ENTERPRISES
CONTROL GROUP
US West (Northern California)
US East (Northern Virginia)
EU (Ireland)
Asia Pacific
(Singapore)
Asia Pacific (Tokyo)
AWS Regions
AWS Edge Locations
GovCloud (US ITAR Region)
US West (Oregon)
South America (Sao Paulo)
10
AWS PLATFORM
CONTROL GROUP
Your Applications
Foundation Services
Building Block Services
Compute Amazon EC2 Auto Scale
Storage Amazon S3
Amazon EBS AWS Storage Gateway
Database Amazon RDS
Amazon DynamoDB Amazon Elasticache
Networking Amazon VPC
Elastic Load Balancing Amazon Route 53
AWS Direct Connect
Application Platform Services
Management & Administration
Content Distribution
Amazon CloudFront
Messaging Amazon SNS Amazon SQS Amazon SES
Parallel Processing
Elastic MapReduce
Libraries & SDKs Java, PHP, Python,
Ruby, .NET
Web Interface Management Console
Identity & Access AWS IAM
Identity Federation Consolidated Billing
Deployment & Automation
AWS Elastic Beanstalk AWS CloudFormation
Monitoring Amazon CloudWatch
AWS Global Infrastructure Regions
Availability Zones Edge Locations
11
MEDIA APPLICATIONSON AWS
CONTROL GROUP
Samsung runs its Smart Hub
application on AWS
Uses AWS to process media files
and deliver them to customers
Runs its online business almost entirely on AWS
“We moved to the clouds looking for availability. We have also found a tremendous agility by eliminating complexity, process, and control.”
Kevin McEntee, VP of Content Engineering, Netflix
12 CONTROL GROUP
1. STORAGE
2. ENCODING/RENDERING
3. DISTRIBUTION
THE ROADMAP FOR THE STUDIO OF THE FUTURE
STORAGE
TODAY’S CHALLENGES:
• Inflexible
•Expensive
•Fixed
13 CONTROL GROUP
14
Example: Video library for cable TV show that airs 4x a week
Challenges:• Production must record news channels in HD to reference and
play back in the show each day • Everything must be archived, searchable and retrievable quickly• Assets must be shared with sister show
Present State:• They use a SAN that needs more and more space every year• Increases power and cooling capacity and costs• Running fiber between studio and sister show’s studio
STORAGE
CONTROL GROUP
Studio of the FutureStore data on infinitely scalable AWS systems:• Simple Storage Service (S3) • Elastic Block Store (EBS)
Connect to AWS via VPC
or DirectConnect
15
STORAGE
CONTROL GROUP
Small local bucket of storage
Studio 1
Small local bucket of storage
Studio 2
16
KEY TECHNOLOGY
CONTROL GROUP
AWS Direct Connect
Amazon Virtual Private Cloud (VPC)
S3 Server Side Encryption
Encryption of data while at rest in S3
Dedicated connection between your datacenter
and AWS
Private VPN connection to your AWS resources
Encrypt data on upload, automatic decryption on
retrieval
Internet
Benefits of AWS Solution:• Flexible, available• Infinitely scalable• Distributed & protected• Pay per GB of storage and transfer
ENCODING & RENDERING
17
TODAY’S CHALLENGES:
•Requires investment in expensive, special purpose hardware
•Uses lots of energy and physical space
•You don’t need it all the time, but when you do, it’s never enough!
CONTROL GROUP
18
Example: Media production studio that needs on-demand rendering
Challenges: • Little need for rendering at beginning of projects but lots of
capacity needed near end of projects• Renderfarm hardware is expensive and takes time to troubleshoot• Hardware must be reconfigured for different types of projects
Present State:• Renderfarm is a rack of computers that sits idle at the beginning of
projects and is overtaxed by the end• Increasing capacity takes days or weeks
ENCODING & RENDERING
CONTROL GROUP
19
Studio of the Future• Create render nodes on-demand with EC2• Pay for only what you use
ENCODING & RENDERING
Connect to AWS via VPC
or DirectConnect
CONTROL GROUP
20
KEY TECHNOLOGY
CONTROL GROUP
EC2 Virtual Server
Provision and boot new servers
Benefits of AWS Solution:
• Flexible
• Scalable
• Pay for the exact capacity you need, when you need it
• Have the ability to track and bill infrastructure costs back to clients
DISTRIBUTION
21
TODAY’S CHALLENGES:
•Teams are distributed
•Consumers are distributed
•Expensive to build your own global distribution network
CONTROL GROUP
22
Example: Digital media company distributes video to multiple platforms
Challenges: • Finished video must be transcoded and uploaded to numerous
systems quickly
Present State:• Manual and inflexible content distribution processes are used (FTP)• Labor intensive• Distribution platform is not integrated with production or encoding
workflows
DISTRIBUTION
CONTROL GROUP
23
Studio of the Future• Files are processed by EC2• Files distributed using S3• All controlled by SWF
DISTRIBUTION
Connect to AWS via VPC
or DirectConnect
CONTROL GROUP
SWF
24
Files are distributed using S3 and CloudFront
DISTRIBUTION
Broadcast
OVP
Customers/Viewers
CONTROL GROUP
iTunes/Netflix
25
KEY TECHNOLOGY
CONTROL GROUP
CloudFront
Global content delivery network
26 edge servers
Benefits of AWS Solution:
• Simple
• Scalable
• Distributed
CloudFront
Global content delivery network
26 edge servers
Simple Workflow Service (SWF)
Workflow Automation
26
THE STUDIO OF THE FUTURE
CONTROL GROUP
Small local bucket of storage
Studio 1
Small local bucket of storage
Studio 2
SWF
APPROACHING THE FUTURE
27
• Each system architecture & implementation depends on business and workflow
• Technologies and platforms are changing continuously and will offer new functionality and optimization opportunities
• Take a rolling approach (one system at a time, hybrid models)
• Use a partner that understands all of the components: production workflow and the intricacies of AWS technologies
CONTROL GROUP
Q & A
28 CONTROL GROUP
Got more questions?
For more information on moving media production infrastructure to AWS:
[email protected] x189
www.controlgroup.com
David Rocamora, [email protected] Miller, [email protected]
Mark Ramberg, [email protected]
CG THANK YOU!