![Page 1: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/1.jpg)
Object Removal by Exemplar-Based
Inpainting
Ye Hong
CS766
Fall 2004
![Page 2: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/2.jpg)
Introduction
Object Removal Idea: Remove object(s) from digital photographs,
and then fill the hole with information extracted from the surrounding area.
Filled region should look “reasonable” to the human eyes.
![Page 3: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/3.jpg)
An Example
Before After
![Page 4: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/4.jpg)
Approaches
Texture Synthesis Idea
Sample color values of the surrounding area Generate textures with sampling result to fill the hole
Advantage Cheap and effective No blur or other degradation
Disadvantage May lose linear structure and composite textures
![Page 5: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/5.jpg)
Approaches(cont.)
Inpainting Fill holes by propagating linear structures into the
target region via diffusion Advantage
Preserves the linear structures Disadvantage
Diffusion will cause blurs, which are usually noticeable
![Page 6: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/6.jpg)
Criminisi’s approach
Combine the strengths of two approaches Use a texture synthesis algorithm Give higher priority to linear structures
Result Linear Structures are preserved No blurs introduced
![Page 7: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/7.jpg)
Criminisi’s Algorithm
Assign each pixel with a priority value Give linear structures higher priorities
![Page 8: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/8.jpg)
Criminisi’s Algorithm(cont.)
Structure Propagation by exemplar-based texture synthesis
![Page 9: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/9.jpg)
Expected Results
Criminisi’s Algorithm vs. Texture Synthesis
Original Object Cut Tex. Syn. Criminisi
![Page 10: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/10.jpg)
Expected Results
Criminisi’s Algorithm vs. Inpainting
Original Object Cut
Inpainting Criminisi
![Page 11: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/11.jpg)
Future Works
More accurate propagation of curved structures
Object removal from videos
![Page 12: Object Removal by Exemplar-Based Inpainting Ye Hong CS766 Fall 2004](https://reader035.vdocument.in/reader035/viewer/2022062511/551bf4dc550346a84f8b45f3/html5/thumbnails/12.jpg)
References A. Criminisi, P. Perez, K. Toyama.
Region filling and object removal by exemplar-based inpainting.
In 2004 IEEE Transactions on Image Processing 9 1200-1212.
M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester.
Image inpainting. In Proc. ACM Conf. Comp. Graphics
(SIGGRAPH), pp. 417–424, New Orleans, LU, Jul 2000.
A. Efros and T. Leung.
Texture synthesis by non-parametric sampling.
In Proc. ICCV, pp. 1033–1038, Kerkyra, Greece, Sep 1999.