tour into the picture: using a spidery mesh to make animation from a single image
DESCRIPTION
Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image. Youichi Horry, Ken-ichi Anjyo, and Kiyoshi Arai SIGGRAPH 1997 presented by Dave Edwards 10/31/2000. A Unique Problem. Can we create animation from a single image? Paintings Single photographs - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/1.jpg)
Tour Into the Picture:Using a Spidery Mesh to Make Animation from a Single
Image
Youichi Horry, Ken-ichi Anjyo, and Kiyoshi Arai
SIGGRAPH 1997
presented by Dave Edwards10/31/2000
![Page 2: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/2.jpg)
A Unique Problem
Can we create animation from a single image? Paintings Single photographs
Extremely difficult for a computer No information for depth or 3D structure
Not as difficult for a human brain
![Page 3: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/3.jpg)
A Unique Solution
A system that allows humans and computers to do what they do best Human supplies 3D scene information Computer supplies efficient interface
for:Specifying vanishing pointsDifferentiating foreground & backgroundBuilding the scene with simple polygons
![Page 4: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/4.jpg)
Tour Into the Picture (TIP)
System that allows efficient specification of 3D information
Basically, construct a diorama-like model of the scene Simple, generic representation
5 (or fewer) polygons for backgroundSmall number of polygons for each
foreground object
![Page 5: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/5.jpg)
Overview
Scene modeling Separate foreground & background Specify a vanishing point Model the background Model foreground objects
Scene animation & renderingConclusionsDemo
![Page 6: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/6.jpg)
Scene Modeling
Assumptions Scene is basically a box Sides of the box are orthogonal to each
other Virtual camera may not be tilted
View up vector is perpendicular to “floor”
![Page 7: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/7.jpg)
Separate Fore- & Background
Start with a single image:
![Page 8: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/8.jpg)
Separate Fore- & Background
Create two images with standard image editor
Foreground mask: One gray region for each object Grayscale map of alpha values
Background image: Original image w/o foreground Use neighboring pixels to fill gaps
![Page 9: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/9.jpg)
Separate Fore- & Background
Example foreground mask:
![Page 10: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/10.jpg)
Separate Fore- & Background
Example background image:
![Page 11: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/11.jpg)
Specify a Vanishing Point
Use a “spidery mesh” Inner rectangle
Specifies “rear wall” of scene
Radial perspective linesSpecify the location of the vanishing pointShould be parallel to guide lines in the
picture
Interface allows rapid changes in the mesh
![Page 12: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/12.jpg)
Specify a Vanishing Point
Example of Interface:
![Page 13: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/13.jpg)
Model the Background
Partition the background into 5 pieces: Rear wall (inner rectangle) Floor (y = 0) Ceiling Left Wall Right Wall
Calculate 3D coords for the vertices of the box
![Page 14: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/14.jpg)
Model the Background
Example of background model:
![Page 15: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/15.jpg)
Model the Foreground
Foreground objects defined by maskConstruct polygon model of each
object Must be orthogonal to one side of the box Calculate 3D coords for corners of
polygon
![Page 16: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/16.jpg)
Model the Foreground
More complex objects can be made of multiple polygons Each additional polygon must be
connected to the previous one This allows the system to determine its
3D coordinates
![Page 17: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/17.jpg)
Model the Foreground
Example of foreground model:
![Page 18: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/18.jpg)
Scene Animation & Rendering
Camera transformations: Rotation (change view-plane normal) Translation Zoom (move viewpoint forward) Change view angle Look around (orbit about central object)
![Page 19: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/19.jpg)
Scene Animation & Rendering
We know 3D coordinates for points in the scene
Given a pixel to render, find its 3D image in the original scene
Apply smoothing for the backgroundApply alpha blending for the
foreground objects
![Page 20: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/20.jpg)
Conclusions
TIP is very flexible In general, assumptions do not create
severe constraints Generic foreground/background model
works with many types of imagesInterface is (fairly) simple & intuitive,
even in the demo version It could use a little internationalization...
![Page 21: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/21.jpg)
Future Possibilities
Handle two-point perspective drawings
Allow multiresolution images
Improve the model for foreground objects
![Page 22: Tour Into the Picture: Using a Spidery Mesh to Make Animation from a Single Image](https://reader035.vdocument.in/reader035/viewer/2022062507/56812ac2550346895d8e8c51/html5/thumbnails/22.jpg)
Demonstration