segmental brush stroke synthesis by example ryoichi ando and reiji tsuruno kyushu univ, japan. came...

16
Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Upload: marybeth-bell

Post on 05-Jan-2016

223 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Segmental Brush Stroke Synthesis

by ExampleRyoichi Ando and Reiji Tsuruno

Kyushu Univ, Japan.

Came from Here

!

Page 2: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

BackgroundDigital painting plays an important role

1. Education

2. Story telling

3. Production...

Page 3: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Real paintings have complex visual features...

Background

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Page 4: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Moxi

[SG

05

]

Physical simulation is not a panacea

Background

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Page 5: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

IdeaWhy not use images ?Very easy to gather exemplar strokes !

How to use images to generate new realistic strokes in realtime ?

Challenges

- Use fast texture synthesis technique

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Page 6: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Problem statement

Exemplar Synthesized

Analyze

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Page 7: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Approach

Decomposition1

Exemplar Images

Stitching2

Synthesized

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Page 8: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Decomposition1

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Decompose using CDT

Page 9: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Decomposition1

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Compute Feature Vector

Page 10: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Stitching

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

2

In such a way that goes lower ...

where

i

energy

( similarity )

Page 11: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Stitching

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

2

may be minimized using dynamic programming in time.energy

- is still costly for realtime synthesis

curvature, etc..neighboring colors, etc...

Page 12: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Stitching

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

2

Search ones with small static terms.

Choose the smallest one

1

2

- Not an optimal solution, but works fast in time.

Page 13: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Stitching

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

2

Compute Min-cut

Page 14: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Results

Page 15: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Future work•Poisson blending on GPUs [Farbman

SG09]

•Pack features ( PCA Projection )

•Find good features ( tilt, pressure ) ?

Page 16: Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

Segmental Brush Stroke Synthesis by Example - Ryoichi Ando

Conclusion

•We proposed an image-based brush generation method

•We employed a 1D texture synthesis method combined with min-cut method to generate strokes