byo3d 2011: emerging technology
DESCRIPTION
Driven by the recent resurgence of 3D cinema, depth cameras and stereoscopic displays are becoming commonplace in the consumer market. Introduced last October, Microsoft Kinect has already fostered gesture-based interaction for applications well beyond the intended Xbox 360 platform. Similarly, consumer electronics manufacturers have begun selling stereoscopic displays and inexpensive stereoscopic cameras. Most commercial 3D displays continue to require cumbersome eyewear, but inexpensive, glasses-free 3D displays are imminent with the release of the Nintendo 3DS.At SIGGRAPH 2010, the Build Your Own 3D Display course demonstrated how to construct both LCD shutter glasses and glasses-free lenticular screens, providing Matlab-based code for batch encoding of 3D imagery. This follow-up course focuses more narrowly on glasses-free displays, describing in greater detail the practical aspects of real-time, OpenGL-based encoding for such multi-view, spatially multiplexed displays.The course reviews historical and perceptual aspects, emphasizing the goal of achieving disparity, motion parallax, accommodation, and convergence cues without glasses. It summarizes state-of-the-art methods and areas of active research. And it provides a step-by-step tutorial on how to construct a lenticular display. The course concludes with an extended question-and-answer session, during which prototype hardware is available for inspection.TRANSCRIPT
Introduction: History and Physiology Construction Glasses-free 3D Displays Multi-view Rendering using OpenGL Multi-view Interlacing using GLSL Designing Content for Glasses-free 3D Displays Emerging Technology Q & A and Demonstrations
Course Outline
Summary:Glasses-Based 3D Displays
Glasses-Based 3D Displays(Stereoscopic Displays)
Immersive(blocks direct-viewing of real world)
See-through(superimposes synthetic images onto real world)
Head-mounted(eyepiece-objective and microdisplay)
Multiplexed (stereo pair with same display surface)
Spatially-multiplexed (field-concurrent)(color filters, polarizers, autostereograms, etc.)
Temporally-multiplexed (field-sequential)(LCD shutter glasses)
Summary:Glasses-Free 3D Displays
Glasses-Free 3D Displays(Automultiscopic Displays)
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Multi-planar(time-sequential projection onto swept surfaces)
Transparent Substrates(intersecting laser beams, fog layers, etc.)
Static(holographic films)
Dynamic(holovideo)
Possible Extensions:Slanted Lenticular Sheets
C. van Berkel and J. A. Clarke. Characterization and Optimization of 3D-LCD Module Design. Proc. SPIE, 1997
Vertical alignment of lenticular sheet only reduces horizontal display resolution A slanted lenticular distributes resolution loss between vertical and horizontal axes Commercialized as Philips WOWvx, but discontinued in March of 2009 and spun off as Dimenco
Recent Work:NYU Autostereoscopic Display
K. Perlin, S. Paxia, J. Kollin. An Autostereoscopic Display. ACM SIGGRAPH, 2000
K. Perlin, C. Poultney, J. Kollin, D. Kristjansson, S. Paxia. Recent Advances in the NYU Autostereoscopic Display. Proceedings of the SPIE, 2001
Time-Shifted Parallax Barriers
Varying-Width Parallax Barriers
Recent Work:Dynallax and Cylindrical Varrier Displays
D. J. Sandin et al. The Varrier Autostereoscopic Virtual Reality Display. ACM SIGGRAPH, 2005
T. Peterka et al. Dynallax: Solid State Dynamic Parallax Barrier Autostereoscopic VR Display. IEEE Virtual Reality, 2007
Reconstruction Filter Only
Combined Resampling Filter
Recent Work:Antialiasing for Automultiscopic Displays
M. Zwicker, W. Matusik, F. Durand, H. Pfister. Antialiasing for Automultiscopic 3D Displays. EGSR, 2006
Recent Work:An Interactive 360° Light Field Display
A. Jones, I. McDowall, H. Yamada, M. Bolas, P. Debevec. Rendering for an Interactive 360° Light Field Display. ACM SIGGRAPH, 2007
Recent Work:Zebra Imaging, Inc. and RabbitHoles Holdings Corp.
Generalizing Parallax Barriers:High-Rank 3D (HR3D) and Layered 3D
Parallax barriers use heuristic design: front mask with slits/pinholes, rear mask with interlaced views High-Rank 3D (HR3D) considers dual-layer design with arbitrary opacity and temporal multiplexing Layered 3D considers multi-layer design without temporal multiplexing
light box
mask 1
mask 2
Conventional Parallax Barrier
mask 1
mask 2
light boxHigh-Rank 3D (HR3D)
mask 2
mask 3
mask K
light box
mask 1
…Layered 3D
D. Lanman, M. Hirsch, Y. Kim, R. Raskar. Content-Adaptive Parallax Barriers: Optimizing Dual-Layer 3D Displays using Low-Rank Light Field Factorization. ACM SIGGRAPH Asia, 2010
G. Wetzstein, D. Lanman, W. Heidrich, R. Raskar. Layered 3D: Tomographic Image Synthesis for Attenuation-based Light Field and High Dynamic Range Displays. ACM SIGGRAPH, 2011
Recent Work:Conventional Parallax Barriers [Ives, 1903]
rear mask front mask
Recent Work:High-Rank 3D (HR3D) Display
D. Lanman, M. Hirsch, Y. Kim, R. Raskar. Content-Adaptive Parallax Barriers: Optimizing Dual-Layer 3D Displays using Low-Rank Light Field Factorization. ACM SIGGRAPH Asia, 2010
rear mask front mask
Recent Work:High-Rank 3D (HR3D) Display
D. Lanman, M. Hirsch, Y. Kim, R. Raskar. Content-Adaptive Parallax Barriers: Optimizing Dual-Layer 3D Displays using Low-Rank Light Field Factorization. ACM SIGGRAPH Asia, 2010
Recent Work:Layered 3D: Tomographic Image Synthesis
G. Wetzstein, D. Lanman, W. Heidrich, R. Raskar. Layered 3D: Tomographic Image Synthesis for Attenuation-based Light Field and High Dynamic Range Displays. ACM SIGGRAPH, 2011
Stereo & Disparity SessionThursday, 11 August
10:45 AM – 12:15 PMEast Building, Exhibit Hall A
Introduction: History and Physiology Construction Glasses-free 3D Displays Multi-view Rendering using OpenGL Multi-view Interlacing using GLSL Designing Content for Glasses-free 3D Displays Emerging Technology Q & A and Demonstrations
Course Outline
Build Your Own Glasses-Free 3D DisplayDouglas Lanman Matthew Hirsch
MIT Media Lab
{dlanman, mhirsch}@media.mit.eduhttp://cameraculture.media.mit.edu/byo3d