peeling art designˆ˜浩.pdf · computational peeling art design hao liu, xiao-teng zhang,...

44
Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, Ligang Liu University of Science and Technology of China

Upload: others

Post on 29-Oct-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Computational Peeling Art Design

Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, Ligang Liu

University of Science and Technology of China

Page 2: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Peeling art design

Page 3: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Popular art form

Page 4: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Peeling art examples

Page 5: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Yoshihiro Okada’s method

Page 6: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Peeling art design problem

Page 7: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Challenges of the computational method

• Non-trivial to optimize the similarity

• Unsuitable input shape

Page 8: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Existing work: cut generation

• Minimum spanning tree method [Chai et al. 2018; Sheffer 2002; Sheffer and Hart 2002]

• Mesh segmentation approaches [Julius et al. 2005; Lévy et al. 2002; Sander et al. 2002, 2003; Zhang et al. 2005; Zhou et al. 2004]

• Simultaneous optimization [Li et al. 2018; Poranne et al.2017]

• Variational method [Sharp and Crane 2018]

Page 9: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Existing work: cut generation

• Minimum spanning tree method [Chai et al. 2018; Sheffer 2002; Sheffer and Hart 2002]

• Mesh segmentation approaches [Julius et al. 2005; Lévy et al. 2002; Sander et al. 2002, 2003; Zhang et al. 2005; Zhou et al. 2004]

• Simultaneous optimization [Li et al. 2018; Poranne et al.2017]

• Variational method [Sharp and Crane 2018]

unfolded shapes ≠ input shapes

Page 10: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Our approach

Cut generation

Page 11: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Key idea

Cut generation

Difficult

Mapping computation

Easy

Page 12: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

𝑅

𝑆𝑚 = Φ(𝑆)Input 𝑆

min𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 + 𝑤𝐸𝑠ℎ𝑟(𝑅)

Mapping computation

Φ

Two goals:1. Low isometric distortion 2. Area of 𝑅 approaches zero

Page 13: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

• ARAP distortion metric [Liu et al. 2008]

Isometric energy

𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 =

𝑖=1

𝑁𝑓

𝐴𝑟𝑒𝑎 𝑓𝑖 ||𝐽𝑖 − 𝑅𝑖||𝐹2

𝑅𝑖 is an orthogonal matrix

Page 14: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

• Our novel rank-one energy

𝐸𝑠ℎ𝑟 𝑅 = 𝑖=1𝑁𝑅𝑓𝐴𝑟𝑒𝑎 𝑡𝑖 ||𝐽𝑖 − 𝐵𝑖||𝐹

2

𝐵𝑖 is a rank one matrix

Shrink energy

||𝐽𝑖||𝐹2 det 𝐽𝑖 rank-oneInput

• Other choices• Frobenius energy ||𝐽𝑖||𝐹

2

• Determinant energy det 𝐽𝑖

Page 15: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Local-global solver min𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 + 𝑤𝐸𝑠ℎ𝑟(𝑅)

𝑠𝑡. 𝜕𝑅 = 𝜕𝑆𝑚 and 𝑣𝑚, 𝑣𝑅 ∈ 𝑀

𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 =

𝑖=1

𝑁𝑓

𝐴𝑟𝑒𝑎 𝑓𝑖 ||𝐽𝑖 − 𝑅𝑖||𝐹2 𝑅𝑖 = 𝑈𝑖𝑉𝑖

𝑇

𝐵𝑖 = 𝑈𝑖𝑑𝑖𝑎𝑔 𝜎𝑖 , 0 𝑉𝑖𝑇

𝐸𝑠ℎ𝑟 𝑅 =

𝑖=1

𝑁𝑅𝑓

𝐴𝑟𝑒𝑎 𝑡𝑖 ||𝐽𝑖 − 𝐵𝑖||𝐹2

𝑣𝑎𝑟𝑖𝑎𝑏𝑙𝑒𝑠 𝛿𝑣𝑘 𝑖𝑛 tangent space 𝑣𝑘𝑛𝑒𝑤 = 𝑃(𝑣𝑘 + 𝛿𝑣𝑘)

Local step:

Global step:

𝛿𝑣𝑘 𝑖𝑛 𝐹𝑗 𝑖𝑠 𝛿𝑣𝑘𝑗= 𝐹𝑘

𝑗 𝑇𝐹𝑘𝑣𝛿𝑣𝑘

Page 16: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Some details

stalk locations

Representations of M

Page 17: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Suitable input

Page 18: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Unsuitable input

Page 19: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Almost cover

Mapping Process

Interaction Process

Iterative interaction

Cut Generation

Final resulting cut

Iterative design

Page 20: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction place

Prune and Decompose

Unfold𝑆𝑚 and 𝑅

Page 21: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 1: shape augmentation

Page 22: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 2: part deletion

Page 23: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 3: angle augmentation

Page 24: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 4: curvature reduction

Page 25: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 5: pre-processing

Unprocessedhigh distortion

Processedlow distortion

Input Input with specify area

Page 26: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 5: pre-processing

Input with specify area Unprocessed: high distortion

Processed: low distortionAlign to initialize

Page 27: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Cut generation

Resulting cutMapped shape

Simplify boundary

Page 28: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Real peeling

Page 29: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Real design

Page 30: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Real peeling

Page 31: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Experiments

Page 32: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Shapes designed by Yoshihiro Okada

Page 33: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Comparison to Yoshihiro Okada

Okada’s

Ours

Dove Eagle Shrimp

Page 34: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 35: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Our results

Page 36: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 37: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 38: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 39: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 40: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 41: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

More results

Page 42: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Conclusion

• A computational tool for peeling art design and construction.

• Unsuitable input 2D shapes are rectified by an iterative process.

Page 43: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Limitations: conservation principle

User input

Interaction many times also cannot keep posture

Page 44: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Thank you