Light-field 3DTV ResearchLight-field 3DTV Research

Péter Tamás Kovács

Holografika

Trends and VisionTrends and Vision

• Next generation displays will be 3D

• Black&White Colour High Definition TV

• A paradigm shift in visualization

• The market is waiting for a real solution

• 3D data is already there, but lost while displaying

Background

• 3D images contain more information than 2D

• Stereoscopic: 2x (L+R)

• Multiview: ~8-16x

• Volumetric: 20-200 slices

• True 3D: continous (~100x)

• Total number of beams law, points/sec rate

• Determine the quality of any 3D solution

• Direction selective light emission

• Common for all 3D systems having a screen

3D Display Technologies3D Display Technologies

FundamentalsFundamentals

• Additional independent variant to X, Y : Φ

• Emission range: FOV

• Number of independent beams in the range: Angular resolution Φ = FOV / n

• Angular resolution determines FOD

FundamentalsFundamentals

• Vertical / horizontal parallax

• Reduce the number of beams by omitting vertical parallax

• Different horizontal and vertical angular resolution

The HoloVizio SystemThe HoloVizio System

• Optical modules

• Project light beams to the points of the screen from various angles

• Holographic screen

• Direction selective property with angularly dependent diffusion characteristics

• Emission angle geometry determined

• The screen performs the necessary optical transformation, but makes no principal change in directions

• No optical road-blocks like at parallax barrier, lenticular lenses

The HoloVizio SystemThe HoloVizio System

• Specific distributed image organization

• A module is not associated to a direction

• Each view of the 3D image comes from multiple modules

• Smooth and continous transition between views

• Light field reconstruction instead of views

The HoloVizio SystemThe HoloVizio System

• HoloVizio image synthesis• Spatially addressable light-rays

• 2D + Angular resolution

• Horizontal (vertical) parallax

• Scalability• High pixel count

• Any aspect ratio

• From small to large scale systems

• Price / Performance• Possible to build perfect 3D

displays

HoloVizio DisplaysHoloVizio Displays

• HoloVizio Monitors

• 7-10 Mpixel

• Single PC

• 1-4 DVI inputs for 25 FPS

• Large-scale HoloVizio System

• Rendering cluster of 16 PCs

• Gigabit Ethernet

• Digital signage HoloVizio system

• Rendering cluster of 3 PCs

• Gigabit Ethernet

HoloVizio DisplaysHoloVizio Displays

• The world first glasses-free 3D cinema system:

• HoloVizio C80

• 3,5 m dia Holoscreen (140”)

• No glasses, no optical contradiction

• LED based 3D projection unit

• Exceptional 1500 Cd/m2 brightness

• 40 degrees FOV

• 2D compatible

• Fitting cinema rooms, 3D simulators

HoloVizio SW SystemHoloVizio SW System

• Integrate existing applications / display 3D models in real-time

• Interactive applications

• Display pre-rendered3D models

• High quality images

• Display real-life 3Dscenes

• Light field streaming

Integrate Existing AppsIntegrate Existing Apps

• OpenGL wrapper for HoloVizio display systems

User computer

Legacy OpenGL Application

OpenGL Wrapper

OpenGL

Display driver

2D display

HoloVizio

Display Pre-Rendered 3DDisplay Pre-Rendered 3D

3D display

HoloVizioConverter

HoloPlayer

Favourite Renderer

HoloVizio scripts

Live 3D transmissionLive 3D transmission

• Linear camera array

• 27 cameras

• 640x480 at 15 FPS

• 960x720 at 10 FPS

• Camera calibration

• Mapping of camera pixels to light rays

• Transmission

• Video streams

• 100 Mbit now, 30 Mbit with H.264

• Display

• Any HoloVizio display

COHERENT projectCOHERENT project

• To create a networked holographic platform to support multi-user real-time collaborative 3D interaction between geographically distributed teams.

• To create two innovative applications:

• a collaborative medical visualisation system

• a collaborative design review system for the automotive industry

Large-scale HoloVizio

Intranet

Internet

Intranet

Internet

HOLOVISION projectHOLOVISION project• To realize a >100x capacity jump

of current displays

• real technology challenge

• to build a no-compromise display

• a milestone towards Gigapixel displays

• To realize a novel principle

• combination of spatial and time multiplexing

• to fully exploit component capabilities

• To use latest available technologies and components

• Hi-res microdisplays, LEDs

World’s first 100 MPixel 3D display

OSIRIS projectOSIRIS project

• Glasses-free 3D cinema prototype

• 2nd generation desktop monitor

• Real-time Light-field capture

MUSCADE projectMUSCADE project• The MUSCADE project defines, develops,

validates and evaluates the technological innovations in 3DTV capturing, data representation, compression, transmission, rendering and display adaptations required for a technically efficient and commercially successful 3DTV broadcast system.

3D VideoPrograms

Satellite

Satellite

ComputerGenerated

Broadcaster

2D Display

3D Professional Camera

Post- Production

Internet

ADSL, ADSL2+, VDSL

Wireline

3D

Pla

yer

Wireless

WiMAX, WLAN, DVB-T(2)

Autostereoscopic display

(Tracked stereo)

Stereoscopic display + binoculars

Multiview display

Lightfield display

Residential consumerUser interactivity

Remote control

DIOMEDES projectDIOMEDES project• DIOMEDES focuses on new

methods for the compression and delivery of multi-view video and multi-channel audio to users.

• The DIOMEDES approach is to develop a 3D Peer-to-Peer (P2P) distribution system, which will be designed jointly with novel video compression techniques. The compression, distribution, and security technologies developed within DIOMEDES will be demonstrated in the form of an integrated test bed.

Peer Peer

Peer

Master Peer

BroadcastTx

BroadcastRx

BroadcastRx

BroadcastRx

3D Content Server

3D Media IPTVStreamingServer

3D VIVANT project3D VIVANT project• The 3D VIVANT project investigates the possibility of using different

technologies for capture and display of 3D content

• For capture, 3D VIVANT takes full advantage of 3D Holoscopic imaging technology, where a single camera is required

• For the display, the project takes advantage of the hologram geometrical principles to provide immersive, ultra high resolution presentation of 3D content

Thank You!Thank You!

www.holografika.com

EU IST-FP7 Integrated Project MUSCADEhttp://www.muscade.eu/