The Uncanny Valleyin 3D Modeling

Steve Seitz and Rick Szeliski

BIRS Workshop onComputer Vision and the Internet

August 31, 2009

The Uncanny Valley

• "The uncanny valley hypothesis holds that when robots and other facsimiles of humans look and act almost like actual humans, it causes a response of revulsion among human observers. The "valley" in question is a dip in a proposed graph of the positivity of human reaction as a function of a robot's lifelikeness. It was introduced by Japanese roboticist Masahiro Mori in 1970." <exerpt from Wikipedia>

Final Fantasy

Polar Express

Façade

View-dependent texture mapping

1. Determine visible cameras for each surface element

2. Blend textures (images) depending on distance between original camera and novel viewpoint

Model-based stereo

• Compute offset from block model

• Some more results:

Graz reconstruction

Photo Tourism

Piecewise planar proxiesSinha, Steedly, Szeliski ICCV’09

http://research.microsoft.com/en-us/um/redmond/groups/ivm/PlanarStereo/

Reflections

Change blindnesshttp://www.psych.ubc.ca/~rensink/flicker/download/

Lightness constancy

Image Based Rendering

Real Scene

Real Cameras-or-

Expensive Image Synthesis

Images+Model

Image

Output

SyntheticCamera

Graphics/Imaging Continuum

Lumigraph

Light field

Geometry centric

Image centric

Warping Interpolation

Polygon rendering + texture mapping

Fixed geometry

View-dependent geometry

View-dependent texture

Concentric mosaics

Sprites with depth

LDI