siggraph 2007 computational photography papers fast forward€¦ · photography papers fast forward...
TRANSCRIPT
![Page 1: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/1.jpg)
SIGGRAPH 2007 Computational Photography Papers Fast Forward
Digital Visual Effects, Spring 2007Yung-Yu Chuang2007/5/29
![Page 2: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/2.jpg)
Announcements
• Voting for project #3 artifacts starts today and is due by the end of Next Monday
• Please send me the title and team members of your final project by the end of Sunday.
• Final project proposal next Tuesday. 5-min presentation for each team. Schedule will be announced next Monday.
![Page 3: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/3.jpg)
New cameras
• Active refocusing• Coded aperture
![Page 4: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/4.jpg)
Active Refocusing
![Page 5: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/5.jpg)
Active Refocusing
![Page 6: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/6.jpg)
Active Refocusing
![Page 7: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/7.jpg)
Active Refocusing
video
![Page 8: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/8.jpg)
Coded aperture
![Page 9: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/9.jpg)
Coded aperture
![Page 10: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/10.jpg)
Coded aperture
![Page 11: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/11.jpg)
Better images from multiple photographs
• Image deblurring with blurred/noisy image pairs*
• Multiscale shape and detail enhancement from multi-light image collections*
![Page 12: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/12.jpg)
Image deblurring
![Page 13: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/13.jpg)
Image deblurring
![Page 14: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/14.jpg)
Image deblurring
![Page 15: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/15.jpg)
Image deblurring
video
![Page 16: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/16.jpg)
Shape and detail enhancement
![Page 17: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/17.jpg)
Shape and detail enhancement
![Page 18: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/18.jpg)
Shape and detail enhancement
![Page 19: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/19.jpg)
Shape and detail enhancement
![Page 20: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/20.jpg)
Shape and detail enhancement
![Page 21: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/21.jpg)
Shape and detail enhancement
![Page 22: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/22.jpg)
Image manipulation
• Soft scissor*• Seam carving for resizing*
![Page 23: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/23.jpg)
Soft Scissor
![Page 24: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/24.jpg)
Soft Scissor
![Page 25: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/25.jpg)
Soft Scissor
video
![Page 26: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/26.jpg)
Seam carving for resizing
![Page 27: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/27.jpg)
Seam carving for resizing
![Page 28: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/28.jpg)
Seam carving for resizing
video
![Page 29: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/29.jpg)
Trends
• Many pictures– Photo clip art– Scene completion using millions of photographs
• Large pictures– Joint bilateral upsampling*– Real-time image processing with bilateral grid*– Efficient gradient-domain compositing– Capturing and viewing gigapixel images
![Page 30: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/30.jpg)
Photo Clip Art
Extracted from LabelMedatabase
![Page 31: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/31.jpg)
Photo Clip Art
• Challenges– Rich object library– Object segmentation– Estimating object size and orientation– Estimating light conditions– Intuitive user interface
![Page 32: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/32.jpg)
Photo Clip Art
video
![Page 33: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/33.jpg)
Scene Completion
![Page 34: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/34.jpg)
Scene Completion
![Page 35: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/35.jpg)
Scene Completion
![Page 36: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/36.jpg)
Scene Completion
![Page 37: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/37.jpg)
Scene Completion
![Page 38: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/38.jpg)
Joint bilateral upsampling
![Page 39: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/39.jpg)
Joint bilateral upsampling
![Page 40: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/40.jpg)
Joint bilateral upsampling
![Page 41: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/41.jpg)
Joint bilateral upsampling
![Page 42: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/42.jpg)
Joint bilateral upsampling
![Page 43: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/43.jpg)
Joint bilateral upsampling
![Page 44: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/44.jpg)
Joint bilateral upsampling
![Page 45: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/45.jpg)
Joint bilateral upsampling
![Page 46: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/46.jpg)
Bilateral grid
video
![Page 47: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/47.jpg)
Efficient gradient domain compositing
![Page 48: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/48.jpg)
Efficient gradient domain compositing
![Page 49: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/49.jpg)
Gigapixel images
video
![Page 50: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/50.jpg)
References• Francesc Moreno-Noguer, Peter Belhumeur, Shree Nayar, Active
Refocusing of Images and Videos, SIGGRAPH 2007. • Anat Levin, Rob Fergus, Fredo Durand, William Freeman, Image
and Depth from a Conventional Camera with a Coded Aperture, SIGGRAPH 2007.
• Lu Yuan, Jian Sun, Long Quan, Heung-Yeung Shum, Image Deblurring with Blurred/Noisy Image Pairs, SIGGRAPH 2007.
• Raanan Fattal, Maneesh Agrawala, Szymon Rusinkiewicz, MultiscaleShape and Detail Enhancement from Multi-light Image Collections, SIGGRAPH 2007.
• Jue Wang, Maneesh Agrawala, Michael Cohen, Soft Scissors: An Interactive Tool for Realtime High Quality Matting, SIGGRAPH 2007.
• Shai Avidan, Ariel Shamir, Seam Carving for Content-Aware Image Resizing, SIGGRAPH 2007.
• Jean-Francois Lalonde, Derek Hoiem, Alexei Efros, Carsten Rother, John Winn, Antonio Criminisi, Photo Clip Art, SIGGRAPH 2007.
• James Hays, Alexei Efros, Scene Completion Using Millions of Photographs, SIGGRAPH 2007.
![Page 51: SIGGRAPH 2007 Computational Photography Papers Fast Forward€¦ · Photography Papers Fast Forward Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/5/29. ... • Final project](https://reader035.vdocument.in/reader035/viewer/2022063018/5fdcb32ee99b5c73fc2f260f/html5/thumbnails/51.jpg)
References• Johannes Kopf, Michael Cohen, Dani Lischinski, Matt Uyttendaele,
Joint Bilateral Upsampling, SIGGRAPH 2007. • Jiawen Chen, Sylvain Paris, Fredo Durand, Real-time Edge-Aware
Image Processing with the Bilateral Grid, SIGGRAPH 2007. • Aseem Agarwala, Efficient Gradient-Domain Compositing Using
Quadtrees, SIGGRAPH 2007. • Johannes Kopf, Matt Uyttendaele, Oliver Deussen, Michael Cohen,
Capturing and Viewing Gigapixel Images, SIGGRAPH 2007.