cinegrid for digital cinema and beyond tom defanti research scientist california institute for...
TRANSCRIPT
CineGrid for Digital Cinema and Beyond
Tom DeFanti Research Scientist
California Institute for Telecommunications and Information TechnologyUniversity of California, San Diego
Distinguished Professor Emeritus of Computer ScienceUniversity of Illinois at Chicago
The CineGridThe CineGrid Initiative Initiative
• CineGrid is an initiative to provide media professionals access to global cyber-infrastructure capable of carrying ultra-high performance digital media using the photonic networks, middleware, transport protocols and collaboration tools originally developed for scientific research, visualization, and Grid computing.
• In the process, “learn by doing,” train the next generation, and cultivate global inter-disciplinary communities to help advance the state of the art
• CineGrid is people, facilities, networks and a not-for-profit organization
Economic Impact of Cinema in California Economic Impact of Cinema in California Major Employment from Movie Industry in California by County Major Employment from Movie Industry in California by County
In 2004, more than 236 new movies were produced in the State of California.
In 2005 movie production provided employment for over 245,000 Californians, with an associated payroll of more than $17 billion.
Typical big movies each spend more than $60 million on production, have a long-term $200 million economic impact, create more than 900 full-time jobs, and yield $11 million in state sales taxes and income taxes when fully made in California.
http://www.google.com/maps?q=http://research.calit2.net/a2i/ca.kmz
CENIC Already Connects CENIC Already Connects California Schools and Research LabsCalifornia Schools and Research Labs
Calit2UCI
USC
SFSU
Calit2UCSD
• Systems developed for CineGrid can be applied to scientific visualization and distance learning in many fields• Useful information exchange between communities looking at “extreme” digital media problems from different perspectives• CineGrid demonstrations will focus developers, driving a virtuous cycle of “learning by doing”
The CineGrid Node at UCSD/Calit2The CineGrid Node at UCSD/Calit2
200 Seats, 8.2 Sound, Sony SXRD 4K projector, SGI Prism w/21TB, 10GE connectivity, NTT JPEG 2000 codecs
The CineGrid Node at The CineGrid Node at Keio University, Tokyo JapanKeio University, Tokyo Japan
SXRD-105 4K Projector
Imagica 4K Imagica 4K Film ScannerFilm Scanner
Sony 4K Projectors Olympus4K Cameras
NTT JPEG2000 Codec
SAGE OptIPortal Software: SAGE OptIPortal Software: 10 Wireless Laptop Users All Pushing Their Desktops to the EVL 10 Wireless Laptop Users All Pushing Their Desktops to the EVL
OptIPortal--Goal is a Distributed Gigapixel in 2007OptIPortal--Goal is a Distributed Gigapixel in 2007
Source: Luc Renambot, EVL
A possible model for 4K workflow?
Los Angeles
Seattle
CineGrid Cisco 650610GigE Cisco NLR Wave1& 10 GigE CENIC WavesIEEAF Wave via PNWGP/TLEXCAVEwave (CENIC and NLR via PNWGP)
CineGrid InfrastructureCineGrid Infrastructure
Sunnyvale
CalIT2San Diego
Cisco is building two 10 GigE "Cisco Waves” on NLR on the West Coast and switches for access points in San Diego, Los Angeles,
Sunnyvale, & Seattle for CineGrid
CENIC is making available persistent 1 GigE access ports in San Diego, Los Angeles,
Sunnyvale, & San Francisco for CineGrid and the fiber for 2x10GigE between UCSD and LA
Via GLIF, CineGrid extends to Japan via Seattle & Chicago; to Canada via Seattle & Chicago;
to Europe via Chicago & Amsterdam.Further extension likely to China, Korea, Singapore,
India, New Zealand, Australia, others.
Tokyo
Chicago
Toronto
JGN2 CA*net4
CineGrid DriversCineGrid Drivers
• High-performance media is historically driven by three markets– 1) Entertainment, media, art and culture– 2) Science, medicine, education and research– 3) Military, intelligence, security and police
• All three are in digital convergence and all need: – Fast networking with similar profiles– Access shared instruments, specialized computers and massive storage – Collaboration tools for distributed, remote teams– Robust security to protect intellectual property– Upgraded systems to allow higher quality, greater speed, more distributed
applications– A next generation of trained professionals
CineGrid Target ApplicationsCineGrid Target Applications
• Store-and-forward secure content delivery• Streaming secure content transmission • Pre-production collaborative design & planning• Studio and remote production of sound and picture• Digital dailies, interactive viewing & mark-up• Distributed post production of audio/video• Digital film scanning and restoration• Digital media archiving• Remote calibration and quality control of audio/video• Education of next generation professionals
These and other CineGrid applications will challenge the engineering of networked systems at every level
DCI Digital Cinema SpecificationDCI Digital Cinema Specification20052005
“DIGITAL CINEMA INITIATIVES (DCI) ANNOUNCES FINAL OVERALL SYSTEM REQUIREMENTS AND SPECIFICATIONS FOR DIGITAL CINEMA
Agreement Gives Manufacturers of Digital Projectors and Theater Equipment One Universal Standard in Creating the Next Generation of Cinemas (Hollywood, CA - July 27, 2005)
Digital Cinema Initiatives, LLC (DCI) is a joint venture of Disney, Fox, Paramount, Sony Pictures Entertainment, Universal and Warner Bros. Studios. DCI's primary purpose is to establish and document voluntary specifications for an open architecture for digital cinema that ensures a uniform and high level of technical performance, reliability and quality control.”
• Image format: 2048x1080 (2K) and 4096x2160 (4K) • Color: 12-bits/color, 4:4:4, SMPTE XYZ• Frame rate: 24fps or 48fps for stereo• Compression: JPEG 2000 up to maximum of 250 Mbps for distribution• Encryption: AES 128 for Digital Cinema Package; SHA-2 (256bit) for Key• Watermarking: invisible injection of time/screen ID in projected image
More: TV and Motion Picture Bit RatesMore: TV and Motion Picture Bit Rates(Data from Laurin Herr, Pacific Interface, Inc.)(Data from Laurin Herr, Pacific Interface, Inc.)
Format frame
size in pixels
Mpixels
per frame
frame
rate
Mpixels
per second
frame
aspect ratio
color
encoding
bits per
pixel
frame
rate
uncompressed
bit rate
compressed
bit rate
720p/ 24 1280x72
0
0.92 24 22.1 16x9 =
1.77
YPbPr
4: 2: 2
8 or 10 24 1.5 Gbps (HD-SDI
aka "single link" aka SMPTE 292M)
DVCPRO HD @
100 Mbps
1080p/ 24 1920x1080
2.1 24 50.4 16x9 = 1.77
YPbPr 4: 2: 2
8 or 10 24 1.5 Gbps (HD-SDI aka "single link"
aka SMPTE 292M)
HDCAM @ 140 Mbps
1080p/ 24 1920x10
80
2.1 24 50.4 16x9 =
1.77
RGB 4: 4: 4 8 or 10 24 3.0 Gbps (so-called
"dual link" = 2 x HD-SDI)
HDCAM SR @
440 Mbps (Cameron's
format for Batt le Angels)
2K 2048x1080
2.2 24 53.1 1.896 SMPTE XYZ 4: 4: 4
12 24 1.9 Gbps, but using dual link interface
= 3.0 Gbps
J PEG 2000 @ 125-250 Mbps
4K 4096x2160
8.8 24 212.3 1.896 SMPTE XYZ 4: 4: 4
12 24 7.6 Gbps, but using 4x single link
interface = 6.0 Gbps; or 4x dual
link = 12.0 Gbps
J PEG 200 @ 200 - 400 Mbps
4K Open EXR 4096x21
60
8.8 24 212.3 1.896 RGBA
4: 4: 4: 4
16 24 13.6 Gbps LZW or other
lossless only(post
production format proposed
by ILM/ Pixar)
DCI DIGITAL CINEMA
DIGITAL CINEMA POST PRODUCTION
HD INSTEAD OF FILM
Test your existing network connection to Calit2, for example.
Use IPERF several times to test UDP and TCP performance.
If performance is sub-gigabit/s, use NLR and CENIC, for example, to connect to Calit2.
Engineering CineGrid Example
You
Create a new vlan for your local network
This will bypass local firewalls, expose local switches’ capabilities, motivate new fiber/copper runs, allow fat UDP
Remember, GigE is more than most campuses or businesses connect to the outside.
Engineering CineGrid: 2
You
Either extend this new vlan to Calit2 or route this local vlan to a shared vlan with Calit2.
This obviously takes great cooperation among the institutions and circuit owners.
CineGrid is ALL about arranging cooperation.
Engineering CineGrid: 3
You
Ensure all vlans support Maximum Transmission Unit (mtu) of 9216 (“jumbo frame enabled”).
Ensure all physical interfaces have mtu 9216 support as well.
Engineering CineGrid: 4
You
Set up at least one IP interface to the vlan.
Test the end-to-end connection again with IPERF.
IP interface
Engineering CineGrid: 5
You
CineGrid.org Starting in 2007CineGrid.org Starting in 2007
• CineGrid will be established as a non-profit international membership organization administratively based in California, starting early 2007.
• To support members’ research, CineGrid will organize network testbeds prepared to host a variety of experimental digital media projects designed to require very high bandwidth with appropriate security safeguards between a limited number of “trusted” users and systems around the globe.
• CineGrid will periodically organize inter-disciplinary workshops and demonstrations to share results and identify new avenues of research. Education and training of next-generation media professionals is our explicit goal.
Thank You Very Much!Thank You Very Much!
• Our planning, research, and education efforts are made possible, in major part, by
funding from:
– US National Science Foundation (NSF) awards ANI-0225642, EIA-0115809, and
SCI-0441094
– State of California, Calit2 UCSD Division
– State of Illinois I-WIRE Program, and major UIC cost sharing
• Argonne National Laboratory and Northwestern University for StarLight and I-WIRE
networking and management
• National Lambda Rail, Pacific Wave and CENIC
• NTT Network Innovations Lab
• Cisco Systems, Inc.
• Pacific Interface, Inc.
CineGrid NetworkingCineGrid NetworkingAs Prototyped by the OptIPuter ProjectAs Prototyped by the OptIPuter Project
• 4K JPEG2000 compressed video is 500Mb/s—peaks to a gigabit/s• Uncompressed needs 6Gb/s or more• Most campus networks use 10-100Mb/s lans to labs. Some have 1Gb/s.• Most campus networks have 155Mb/s, 622Mb/s or 1Gb/s connections
– Internet connectivity is usually 10s to 100s of Mb/s– Internet2 connectivity is usually 100s of Mb/s to 1Gb/s– A few campuses have 10Gb/s connectivity to Internet2 and/or NLR
• Future connections will widely support 10Gb/s, but not today• However, bandwidth is not the only issue
– Need to use protocols that handle the bandwidth (UDP, not TCP)– It’s rude to use large-flow UDP on shared networks– Firewalls are a problem; large-flows are often shut down – Need fiber/copper to the end device(s) from the campus main switch
• So, at this point, we use virtual local area network (vlan) “layer2” tech– Arguably not scalable, but works, controllable by GMPLS– MPLS has been shown to work as well (with big core routers)