Slide 1

Stereoscopic 3D 2013/10/30

Slide 2

Stereoscopic Image Transforms to Autostereoscopic Multiplexed Image Wei-Ming Chen, Chi-Hao Chiou and Sheng-Hao Jhang Computer Science and Automation Engineering (CSAE), 2011

Slide 3

Outline Introduction Related Work Proposed Method Experimental Results Conclusion 3

Slide 4

Introduction 4

Slide 5

3D technologies have become popular in recent years. Widely applied to movie, films and show. In early 3D vision technology: Anaglyph Polarization Shutter 5 With special glasses

Slide 6

Anaglyph Glass

Slide 7

Polarization Glass

Slide 8

Shutter Glass

Slide 9

Introduction Autostereoscopic 3D display Non-glass system Propose a new technique for generating Autostereoscopic multiplexed content. 9 Objective:

Slide 10

Related Work 10

Slide 11

Disparity Vertical Parallax Usually = 0 focus on horizontal parallax Horizontal Parallax Identify the distance of the object

Slide 12

Disparity retina

Slide 13

Image Rectification Zero Parallax Zero parallax plane

Slide 14

Image Rectification Simplified to one dimension - horizontal

Slide 15

Solution : All epipolar lines are parallel in the rectified image plane. Image Rectification

Slide 16

3D coordinate of real scene: Disparity to Depth f : focal length b : the length of baseline d : disparity (u 0, v 0 ) : coordinate of image center (camera intrinsic parameter matrix K) (u, v) : pixel coordinate Du Xin, Zhu Yun-fimg, "A Flexible Method for 3D Reconstruction of Urban Building", ICSP 2008 proceedings. Baseline Epipolar line

Slide 17

3D Reconstruction Wei-wei Ma, My-Ha Le, Kang-Hyun Jo, "3D Reconstruction and Measurement of Indoor Object Using Stereo Camera", The 6th International Forum on Strategic Technology, 2011.

Slide 18

Autostereoscopic 3D display Time-multiplexed Switch rapidly (left and right images) 2D & 3D : same resolution Spatial-multiplexed Parallax barrier Lenticular lenses Lower resolution for 3D 18

Slide 19

Autostereoscopic 3D display Parallax barrier 19 Lenticular lenses

Slide 20

Proposed Method 20

Slide 21

System Flow of Depth-map Generation 21 Stereo matching

Slide 22

Depth-map Generation 1) Feature point detection Use SURF algorithm [5] (based on SIFT) 2) Epipolar Geometry Matching the feature points 3) Interpolation Estimate the pixels which is not feature points 4) Graphcut Grouping the close pixels (segmentation) 22 Disparity between stereo images [5] H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF)," Computer Vision and Image Understanding, vol. 110, pp. 346-359, 2008.

Slide 23

System Flow of Synthesis 23

Slide 24

Zero-parallax setting The most comfortably distance between user and display could be determined from Z c. Z c ( Base plane) 24 Z far : the highest depth map value Z near : the lowest depth map value

Slide 25

Pre-processing the Depth Map Mean filter Gaussian filter 25

Slide 26

3D-image Warping Multi-View Need large storage space use depth map to create virtual views Warping Reference view Virtual view 26 warp

Slide 27

3D-image Warping Multi-View Need large storage space use depth map to create virtual views 27 Warping

Slide 28

3D-image Warping Lenticular autostereoscopic display DIBR 28 S0S0 The pixel position of the center view k View ID ( K= -4 ~ 4 ) b The distance between two eyes ZFZF Farthest distance ZNZN Nearest distance pzpz Depth value Pixels/cm (according to monitor) d Distance between eyes and screen

Slide 29

Issues[*]: Disparity Range Limitations of perception and technology Disparity Sensitivity More sensitive to nearby objects Disparity Gradient Disparity Velocity Temporal information 3D-image Warping 29 [*] :Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A. & Gross, M. (2010, July). Nonlinear Disparity Mapping for Stereoscopic 3D. To appear in ACM Transactions on Graphics (Proc. SIGGRAPH).

Slide 30

Disoccluded Regions-filling Disoccluded Regions : regions without warped pixel 30 warp Reference view Virtual view

Slide 31

Disoccluded Regions-filling Associated with DIBR: 31 Similar to occlusion handling

Slide 32

Disoccluded Regions-filling 32

Slide 33

Experimental Results 33

Slide 34

Experimental Results Disoccluded Regions-filling: 34 Previous Work Proposed

Slide 35

Experimental Results 35 The six warping views The six warping views

Slide 36

Experimental Results 36 Synthesized result

Slide 37

Conclusion 37

Slide 38

Conclusion 3D-image generation of stereo images with good 3D effect was proposed. Future : using temporal information Stereo images Disparity map 3D warping Hole filling Issues: Zero-parallax setting Disparity Range / Disparity Velocity Hole filling 38

Slide 39

Reference Optical Design, Fabrication, and Measurement 3D Introduction and Project (Dept. of Photonics & Display Institute,National Chiao Tung University) Image Rectification (Stereo), Guido Gerig AGENCY1903 BLOG http://www.agency1903.com/blog/2010/8/18/z-axis-power http://www.agency1903.com/blog/2010/8/18/z-axis-power 3D 3D ( )