byo3d 2011: history

17
Course Outline Introduction: History and Physiology Constructing Glasses-free 3D Displays Multi-view Rendering using OpenGL Multi-view Interlacing using GLSL Designing Content for Glasses-free 3D Displays Emerging Technology Q & A and Demonstrations

Upload: matt-hirsch-mit-media-lab

Post on 17-May-2015

10.047 views

Category:

Art & Photos


0 download

DESCRIPTION

Driven by the recent resurgence of 3D cinema, depth cameras and stereoscopic displays are becoming commonplace in the consumer market. Introduced last October, Microsoft Kinect has already fostered gesture-based interaction for applications well beyond the intended Xbox 360 platform. Similarly, consumer electronics manufacturers have begun selling stereoscopic displays and inexpensive stereoscopic cameras. Most commercial 3D displays continue to require cumbersome eyewear, but inexpensive, glasses-free 3D displays are imminent with the release of the Nintendo 3DS.At SIGGRAPH 2010, the Build Your Own 3D Display course demonstrated how to construct both LCD shutter glasses and glasses-free lenticular screens, providing Matlab-based code for batch encoding of 3D imagery. This follow-up course focuses more narrowly on glasses-free displays, describing in greater detail the practical aspects of real-time, OpenGL-based encoding for such multi-view, spatially multiplexed displays.The course reviews historical and perceptual aspects, emphasizing the goal of achieving disparity, motion parallax, accommodation, and convergence cues without glasses. It summarizes state-of-the-art methods and areas of active research. And it provides a step-by-step tutorial on how to construct a lenticular display. The course concludes with an extended question-and-answer session, during which prototype hardware is available for inspection.

TRANSCRIPT

Page 1: BYO3D 2011: History

Course Outline

Introduction: History and Physiology Constructing Glasses-free 3D Displays Multi-view Rendering using OpenGL Multi-view Interlacing using GLSL Designing Content for Glasses-free 3D Displays Emerging Technology Q & A and Demonstrations

Page 2: BYO3D 2011: History

Limitations of Conventional Displays

Monocular Depth Cues Supported by Conventional Displays relative and familiar size perspective and occlusion texture gradient, shading and lighting, atmospheric effects

Page 3: BYO3D 2011: History

Limitations of Conventional Displays

Monocular Depth Cues with Conventional Displays relative and familiar size perspective and occlusion texture gradient, shading and lighting, atmospheric effects

Page 4: BYO3D 2011: History

What is missing?

Additional Monocular Depth Cues motion parallax [Hermann von Helmholtz, 1866] accommodation

Page 5: BYO3D 2011: History

Binocular Depth Cues

Binocular Depth Cues retinal disparity [Charles Wheatstone, 1838] convergence

“It being thus established that the mind perceives an object of three dimensions by means of the two dissimilar pictures projected by it on the two retinae, the following question occurs: What would be the visual effect of simultaneously presenting to each eye, instead of the object itself, its projection on a plane surface as it appears to that eye?”

Page 6: BYO3D 2011: History

Physiology of Depth Perception

• Monocular Cues– Motion Parallax

– Perspective

– Relative Size

– Atmospheric Effects

– Occlusion

– Texture

– Shading/Lighting

Also sometimes called psychological cues, these effects can be captured by a monocular camera and perceived by a viewer of a traditional screen.

Page 7: BYO3D 2011: History

Physiology of Depth Perception

• Another Monocular Cue– Accommodation

• Binocular Cues– Convergence

– Stereopsis• This is the cue added by 3D displays covered in this course

• The brain determines depth by observing the scene disparity between two viewpoints

• Can simulate this depth cue by multiplexing a different synthetic image to each eye

These effects are due to physical functions of the eye, and not interpretation of the scene

Page 8: BYO3D 2011: History

Conflicting Cues

• The HVS can ignore conflicting or missing depth cues

• Understand depth in 2D (monocular) video

• Perceive shape in “noise”

Ponzo Illusion: © Walt Anthony 2006 magiceye.com

Page 9: BYO3D 2011: History

Missing Binocular Cues

• Ponzo Illusion

• We perceive depth without binocular cues

• Depth perception changes perception of line length

Page 10: BYO3D 2011: History

Only Binocular Cues

• Random Dot Stereograms

Bela Julesz

Page 11: BYO3D 2011: History

Violating Accommodation Cues

• All presented displays do this

• Possibly leads to fatigue over time

Page 12: BYO3D 2011: History

Course Outline

Introduction: History and Physiology Physiology

History

Constructing Glasses-free 3D Displays Multi-view Rendering using OpenGL Multi-view Interlacing using GLSL Designing Content for Glasses-free 3D Displays Emerging Technology Q & A and Demonstrations

Page 13: BYO3D 2011: History

Early History

• 1838 Wheatstone Stereoscopes

– 1848 Brewseter

– 1881 Popularized by Oliver Wendell Holmes

• 1853 Earliest Anaglyph photographs

http://courses.ncssm.edu/gallery/collections/toys/html/exhibit01.htm Viewmaster1939-Today EquivalentLeonardo DaVinci had realized that two images would be

needed for stereo viewing, but never created a 3D painting

Page 14: BYO3D 2011: History

20th Century

• 1908 Lippmann, Integral Imaging, Lenticular Printing

• 1934 Polarizing Glasses (two synchronized projectors)

• 1950s Anaglyph and polarizing glasses popular to counter rise of television

Page 15: BYO3D 2011: History

Interesting Historical Examples

American Civil War-era stereoscopic photos

• Available from the US library of congress•http://www.loc.gov/pictures/search - Search for “stereographs civil war prints”

• Lincoln in 3D• Selection of stereographs converted to red-

cyan anaglyph images•John J. Richter: ISBN 978-0811872317

Page 16: BYO3D 2011: History

Interesting Historical Examples

• Colorized stereoscopic photos

• T. Enami, Japan ca. 1895

http

://w

ww

.how

tobe

aret

rona

ut.c

om//2

010/

06/o

ld-ja

pan-

in-

3d

Page 17: BYO3D 2011: History

Course Outline

Introduction: History and Physiology Constructing Glasses-free 3D Displays Multi-view Rendering using OpenGL Multi-view Interlacing using GLSL Designing Content for Glasses-free 3D Displays Emerging Technology Q & A and Demonstrations