3d object manipulation in a single photograph using stock 3d models

3D OBJECT MANIPULATION IN A SINGLE PHOTOGRAPH USING STOCK 3D MODELS

Overview• Video: http://www.cs.cmu.edu/~nkholgad/video/video.mp4

• Key idea: 3D manipulation in 2D photograph - beyond Photoshop.

• Essentially a data-driven interactive single image modeling problem.

Pipeline

Geometric Correction – Data term

Geometric Correction - Smoothness

Geometric Correction - Symmetry

Geometric Correction - Optmization

Illumination and Appearance Estimation

• Lambertian Surface

Illumination and Appearance Estimation

• Light model

Illumination&Appearance - Objective function

Illumination&Appearance - Data term

Illumination&Appearance – Illumination Prior• Sparse light sources

Illumination&Appearance – Appearance Prior

• Appearance similar to the stock model

Relating Hidden & Visible Parts via Symmetries

• Relating Hidden & Visible Parts via Symmetries• Completing Appearance via MRF

Relating Hidden & Visible Parts via Symmetries

Completing Appearance via MRF

Results

Results

Results - Comparisons

Results - Comparisons