representation
DESCRIPTION
Section 2 of the BYO3D SIGGRAPH 2010 CourseTRANSCRIPT
![Page 1: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/1.jpg)
Course Outline
Introduction: History and Physiology Representation and Display Glasses-bound Stereoscopic Displays Unencumbered Automultiscopic Displays Source Material: Rendering and Capture Emerging Technology Conclusion and Q & A
![Page 2: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/2.jpg)
Taxonomy of 3D Displays:Glasses-bound vs. Unencumbered Designs
Glasses-boundStereoscopic
Immersive(blocks direct-viewing of real world)
See-through(superimposes synthetic images onto real world)
Head-mounted(eyepiece-objective and microdisplay)
Multiplexed (stereo pair with same display surface)
Spatially-multiplexed (field-concurrent)(color filters, polarizers, autostereograms, etc.)
Temporally-multiplexed (field-sequential)(LCD shutter glasses)
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Multi-planar(time-sequential projection onto swept surfaces)
Transparent Substrates(intersecting laser beams, fog layers, etc.)
Static(holographic films)
Dynamic(holovideo)
Taxonomy adapted from Hong Hua
![Page 3: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/3.jpg)
Taxonomy of 3D Displays:Immersive Head-mounted Displays (HMDs)
Glasses-boundStereoscopic
Immersive(blocks direct-viewing of real world)
Head-mounted(eyepiece-objective and microdisplay)
Multiplexed (stereo pair with same display surface)
![Page 4: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/4.jpg)
Taxonomy of 3D Displays:See-through Head-mounted Displays (HMDs)
Glasses-boundStereoscopic
Immersive(blocks direct-viewing of real world)
See-through(superimposes synthetic images onto real world)
Head-mounted(eyepiece-objective and microdisplay)
Multiplexed (stereo pair with same display surface)
![Page 5: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/5.jpg)
Taxonomy of 3D Displays:Spatial Multiplexing (e.g., Anaglyphs)
Glasses-boundStereoscopic
Immersive(blocks direct-viewing of real world)
See-through(superimposes synthetic images onto real world)
Head-mounted(eyepiece-objective and microdisplay)
Multiplexed (stereo pair with same display surface)
Spatially-multiplexed (field-concurrent)(color filters, polarizers, etc.)
![Page 6: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/6.jpg)
Taxonomy of 3D Displays:Temporal Multiplexing (e.g., Shutter Glasses)
Glasses-boundStereoscopic
Immersive(blocks direct-viewing of real world)
See-through(superimposes synthetic images onto real world)
Head-mounted(eyepiece-objective and microdisplay)
Multiplexed (stereo pair with same display surface)
Spatially-multiplexed (field-concurrent)(color filters, polarizers, autostereograms, etc.)
Temporally-multiplexed (field-sequential)(LCD shutter glasses)
![Page 7: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/7.jpg)
Taxonomy of 3D Displays:Parallax Barriers
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
NewSight MV-42AD3 42''(1920x1080, 1x8 views)
![Page 8: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/8.jpg)
Taxonomy of 3D Displays:Integral Imaging
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Alioscopy 3DHD 42''(1920x1200, 1x8 views)
![Page 9: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/9.jpg)
Taxonomy of 3D Displays:Multi-planar Volumetric Displays
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Multi-planar(time-sequential projection onto swept surfaces)
![Page 10: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/10.jpg)
Taxonomy of 3D Displays:Transparent-substrate Volumetric Displays
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Multi-planar(time-sequential projection onto swept surfaces)
Transparent Substrates(intersecting laser beams, fog layers, etc.)
![Page 11: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/11.jpg)
Taxonomy of 3D Displays:Static Holograms
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Multi-planar(time-sequential projection onto swept surfaces)
Transparent Substrates(intersecting laser beams, fog layers, etc.)
Static(holographic films)
capture reconstruction
![Page 12: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/12.jpg)
Taxonomy of 3D Displays:Dynamic Holograms (Holovideo)
UnencumberedAutomultiscopic
Parallax-based(2D display with light-directing elements)
Volumetric(directly illuminate points within a volume)
Holographic(reconstructs wavefront using 2D element)
Parallax Barriers(uniform array of 1D slits or 2D pinhole arrays)
Integral Imaging(lenticular sheets or fly’s eye lenslet arrays)
Multi-planar(time-sequential projection onto swept surfaces)
Transparent Substrates(intersecting laser beams, fog layers, etc.)
Static(holographic films)
Dynamic(holovideo)
Tay et al. [Nature, 2008]
MIT Media Lab Spatial Imaging Group[Holovideo, 1989 – present]
![Page 13: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/13.jpg)
Representing Light Transport Assume geometrical (ray) optics approximation Parameterize radiance of 3D rays using a 4D light field L(u,v,s,t)
Marc Levoy and Pat Hanrahan. Light Field Rendering. 1996.Steven Gortler et al. The Lumigraph. 1996.
u
v
s
t(u,v)
(s,t)
Introduction to Light Fields
![Page 14: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/14.jpg)
Introduction to Light Fields
Light Fields [Levoy and Hanrahan 1996, Gortler et al. 1996] Radiance along any direction at every point in 3D space
Light fields are 4D (e.g., two plane vs. position-angle parameterization)
q
Two Plane Parameterization Position-Angle Parameterization
su
s
![Page 15: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/15.jpg)
LCDu
s
(u,s) or
(u,a)
(u,v,s,t) or
(u,v,a,b)
u
v
Representing 3D Displays with Light Fields
Light Fields [Levoy and Hanrahan 1996, Gortler et al. 1996] Radiance along any direction at every point in 3D space
For a planar 3D display, the emitted light field is a 4D function
Parameterized using absolute or relative two plane parameterization
a
![Page 16: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/16.jpg)
Representing Multiple Views with Light Fields
viewer moves right
![Page 17: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/17.jpg)
Representing Multiple Views with Light Fields
![Page 18: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/18.jpg)
Representing Multiple Views with Light Fieldsvi
ewer
mo
ves
up
viewer moves right
u
v
u
v
u
v
u
v
u
v
u
v
u
v
u
v
u
v
a
b
![Page 19: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/19.jpg)
Example: Parallax Barriers
Light Fields [Levoy and Hanrahan 1996, Gortler et al. 1996] Radiance along any direction at every point in 3D space
For a planar 3D display, the emitted light field is a 4D function
Parameterized using absolute or relative two plane parameterization
Represents multiple views projected by parallax barrier displays
u
s
parallax barrier
LCD
(u,s)
![Page 20: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/20.jpg)
Example: Volumetric Displays
Light Fields [Levoy and Hanrahan 1996, Gortler et al. 1996] Radiance along any direction at every point in 3D space
For a general planar 3D display, the emitted light field is a 4D function
Light field is parameterized using intersection with two planes
Represents multiple views projected by volumetric displays
u
s(u,s)
![Page 21: Representation](https://reader035.vdocument.in/reader035/viewer/2022070316/55583743d8b42ac6078b4928/html5/thumbnails/21.jpg)
Course Outline
Introduction: History and Physiology Representation and Display Glasses-bound Stereoscopic Displays Unencumbered Automultiscopic Displays Source Material: Rendering and Capture Emerging Technology Conclusion and Q & A