Drawing, Painting and Stylization; Interactive image

editing Xiaoguang Han

2011-07-04

Papers

• Interactive Editing of Massive Imagery Made Simple: Turning Atlanta into Atlantis (TOG)

• Geodesic Image and Video Editing (TOG)• Matting and Compositing of Transparent and

Refractive Objects (TOG)• Nonlinear Revision Control for Images (demo)• ShadowDraw: Real-Time User Guidance for Freehand

Drawing • A Programmable System for Artistic Volumetric

Lighting• Coherent Noise for Non-Photorealistic Rendering

Gigapixel images

Goal

• Interactive Editing - Real time - Minimal memory • Interactive Editing - Seamless cloning/panorama stitching - Gradient-based image processing

Panorama stitching

Progressive Poisson Solver

• A global progressive solver provides a near instant coarse approximation of the full solution

• A local progressive solver provides a quick solution for the visible pixels

Edinburgh panorama 16,950*2,956

Framework

• Initial solution • Progressive refinement• Local preview• Progressive full solution• Out-of-core solver

Turning Atlanta into Atlantis

Contribution

• A coarse-to-fine progressive Poisson solver running at interactive frame rates

• A method to locally refine solutions having time and space requirements

• A full out-of-core solver that maintains strict control over system resources

• A lightweight streaming framework that provides adaptive multi-resolution access to out-of-core imges

[ICCV2007] A geodesic framework for fast interactive image and video matting

Geodesic matting

Geodesic matting

Geodesic distance (binary region)

Generalized geodesic distance

Geodesic morphology

Geodesic Symmetric Filtering operator

Interactive segmentation of high resolution image

More results

Flattening

Goal

• Matting & Compositing - Cut and Paste

• Transparent and Refractive objects - no 3D information

Appearance model

• Specular highlights• Refractive Deformation• Light Attenuation

Attenuation-Refraction Matte(ARM)

ARM extraction

• M-extraction

G-extraction

Results

Results

Motivation

• Nonlinear Revision Control for documents

Current Linear Revision Control for images

Nonlinear Revision Control

Revision graph

Motivation

• Freehand Drawing - human intuition - rough & difficult

• Context based image retrieval - computer intelligence - not people’s want & time-consuming

Goal

• Real-time user guidance - computer is a partner in drawing process

Approach

• Database Creation - 40 categories: t-shirt, bicycle, car, etc. - edge extraction - patch descriptors - min-hash

Image Matching

• Candidate matches

• Image alignment • Image weighting

Results

User study

Goal

• Volumetric effect