digital storage innovations and trends for the professional media

Digital Storage Innovations and Trends for the

Professional Media and Entertainment Industry

Thomas Coughlin

Coughlin Associates

www.tomcoughlin.com

1 © 2012 Coughlin Associates

Outline

• More Real = More Digital Storage (and performance)

• Content Acquisition Trends and Drivers

• Post Production and Delivery

• Archiving and Preservation

• Conclusions


Storage Manager

Hard Disk

Drive

Flash Memory

Host Interface

Richer content = more storage • Frame rates for movie content

are increasing from the historical 24 frames per second (fsp) to 48 fps (e.g. in The Hobbit by Peter Jackson) and 60 fps and may eventually be as high as 300 fps.

• Cameras are now available that can support 120 fps

• 4K production is commonplace but 6K and even 8K movie production is starting to appear in professional video projects. Video resolutions of 16K and even higher are contemplated in the future.


Japanese drive 8K content

• NHK from Japan has been making steady progress on their Super Hi-Vision TV that could display 33 megapixel video with 22:1 multichannel sound.

• Sharp demonstrated an 8K X 4K LCD Display in 2011 and at the 2012 CES

• The BBC plans some 8K Summer Olympic Content


BBC Image of HNK Super Hi-Vision Camera

Sharp 8K X 4K LCD Display

Professional video production is moving to multiple petabyte requirements!

• As video resolution and frame rate increase and stereoscopic projects multiply, the storage capacity and bandwidth performance of these devices and systems becomes staggering.

• A calculation shows that 16,000 X 8,000 pixel resolution, 64 color bits/pixel, 300 fps raw video content could require 307 GB/s data rates and 1.1 PB/hour. If this was full stereoscopic capture then these requirements would double.

• Truly the bandwidth and capacity requirements to work with future rich media formats are staggering! © 2012 Coughlin Associates 5

6

Media Content Size Trends

0.01

0.1

1

10

100

1000

One page ASCII text

1KB 10KB 100KB 1GB 1MB 10MB 100MB 10GB 100GB 1TB

CD Quality Stereo Audio

DVD Movie (MPEG-2)

HD Movie

Ultra HD Movie

Virtual Reality, 3D

Movie

Data

Rate

(Mbps)

Multimedia Object Size

Content Capture

© 2012 Coughlin Associates 7

Acquisition, post-production, and distribution workflow.

Telecine

Render Farm

Digital Camera

Film Camera

Network and Other Digital Sources

NLE Compositing

Shared Storage

Color Correction

Grain and Noise

Conform and

Assembly

DI

Transcode

Film Print

Digital Cinema

Broadcast

Cable/Satellite

Internet/Phone

Archive or Backup


Profession video camera media

© 2012 Coughlin Associates

Film 8% Magnetic

tape 25%

Hard disk drives 22%

Optical discs 17%

Flash

memory28%

9

2011 Digital Storage in Media and Entertainment Report, Coughlin Associates, www.tomcoughlin.com/techpapers

Sony CineAlt

F65 “8K” Camera

ARRI Alexa Camera

RED 5K Camera

Content shot for an hour of completed work


1 hour

4%1-3 hours

27%

4-6 hours27%

7-9 hours8%

10-12 hours

20%

Other14%

10


•55 % of 2010 SMPTE Storage Survey Participants said that they captured 4 hours or more of content for an hour of completed work •The low costs of digital capture encourage capturing more content than was economical with film—as costs decline the average number of content captured will likely increase further

Post Production and Delivery


Professional non-linear editing model system

• In addition to traditional local storage and network storage, content in cloud storage is starting to play a role in modern workflows

• In late 2010 M&E professionals involved in post production showed the following statistics: 83.8% had DAS – Over 69% of these had more than 1 TB of DAS

• 81.2% had NAS or SAN—use of network storage is increasing – Over 58% had more than 16 TB of NAS or SAN

Coughlin Associates Professional M&E Survey, 2009 & 2010

Video Editing Station

Local Storage

DRAM

GE Card Or HBA

SAN NAS

GE Card Or HBA

Cloud


Post production annual storage capacity demand (TB)



The cloud for M&E content

• In many regards cloud offerings are an out-sourcing approach

• But there are new M&E capabilities enabled by the rise of remote services

• Growth in cloud storage use by professional video – enables collaborative workflow – Internet enabled content distribution with technologies such as those

of Aspera or BitSpeed – new cost effective services through the cloud enable greater

sophistication for smaller shops – Some vendors offering cloud “archiving” services

• Cloud storage drives growth in tiered storage including flash memory, tape, HDDs



Internet content distribution system (CDN)

Source Content

(NAS or SAN)

Content Central ServerEdge Server

Edge Server

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Source Content

(NAS or SAN)

Content Central ServerEdge Server

Edge Server

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

Internet User

•Solid state storage devices being used for edge content delivery because they are more reliable in non-data center locations

•Solid state storage increasingly being used for caching and even some central content delivery applications

15

Archiving and Preservation



Digital archive media

Digital tape

36%

CD discs

4%DVD discs

10%

Blu-ray discs

7%

Hard disk

drives 24%

Other

19%

17


•Tape (esp. LTO) and HDDs predominate in long term archival media and are projected to show greatest growth in the future

•New optical disc technologies etching the surface of a ceramic layer may show long archival life

•Likewise some holographic technologies show media stability indicating a long storage life.

•About 39% of survey participants never update their digital archives

LTO66%

Digital Camera

Tape18%

DLT8%

Other7%

AIT1%


Comparison of estimated annual cost to save 1 PB for 20 years

$100

$1,000

$10,000

$100,000

$1,000,000

An

nu

al

Esti

mate

d C

ost

for

1 P

B

HDD

Tape

18



Growth in near-line and off-line digital storage for content archiving

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

2008 2009 2010 2011 2012 2013 2014 2015 2016

Near-Line 393 1,081 2,289 4,153 7,203 12,025 19,762 27,033 36,419

Off-Line 1,908 3,244 4,647 6,775 9,706 14,003 19,294 22,118 24,893

Archive Storage

(Petabytes)

Near-Line

Off -Line

19


Conclusions



Media and entertainment storage market trends (2011)

Post Production13%

Content Distribution

26%

Content Acquisition

4%

Archiving and Preservation

57%

21


Tape43.6%

Optical17.1%

HDD39.1%

Flash0.2%

2011 Storage Capacity Market Share

Media and entertainment market storage revenue

share by segment

Market share of storage media by storage capacity shipped

Total new storage capacity for media and entertainment 2011 Digital Storage for Media and Entertainment Report, Coughlin Associates

Total revenue for media and entertainment storage will increase about 1.7X from 2011 through 2016 ($3.8 B to $6.4 B)

(over 62 Exabytes of New Storage by 2016)

1

10

100

1,000

10,000

100,000

2008 2009 2010 2011 2012 2013 2014 2015 2016

To

tal N

ew

Cap

acit

y (

PB

)

Digital Conversion & Preservation

New Content Archiving

Film Scanning

Episodic Acquisition

Movie Acquisition

Digital Cinema

VOD Streaming

VOD Ingest

Internet Distribution Headends

Master Network Headends

Local Broadcaster Headends

Satellite Headends

Cable Headends

Compositing and Special Effects

Post Production


23

Summary and Conclusions


• Demand for higher resolution and higher frame rate content for media and entertainment applications is driving multiple-PB storage needs—these needs will only increase in the future • Storage devices and interfaces used in media and entertainment applications will evolve to meet changing needs and unique performance requirements for video workflows • Cloud-based services are playing an increasing role by enabling collaborative workflows • Lower costs for analog to digital conversion and long term storage of new digital assets are further driving archive storage demand • Increased storage demand will drive storage media and system sales

Thanks


Sources

• CES, Creative Storage and Storage Visions Conferences (www.storagevisions.com)

• Creative Storage Conferences (www.creativestorage.org)

• 2011 Digital Storage for Media and Entertainment Report, Coughlin Associates (2012 issue is in preparation)

• 2009 and 2010 Survey on Storage for Media and Entertainment, Coughlin Associates

• Go to www.tomcoughlin.com (tech papers page)

• SNIA SSSI: http://www.snia.org/forums/sssi/


http://www.storagevisions.com/

http://www.creativestorage.org/

http://www.tomcoughlin.com/

http://www.snia.org/forums/sssi/

digital storage innovations and trends for the professional media

Documents