[siggraph 2017] sequential line search for efficient visual design optimization by crowds
TRANSCRIPT
![Page 1: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/1.jpg)
Sequential Line Search for Efficient Visual Design Optimization by Crowds
Takeo IgarashiIssei SatoYuki Koyama Daisuke Sakamoto
![Page 2: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/2.jpg)
Motivation
![Page 3: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/3.jpg)
Parameter Tweaking Based on Preference
![Page 4: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/4.jpg)
Design Exploration Optimization
x
⇤= argmax
x2XGoodness(x)
![Page 5: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/5.jpg)
Optimization
x
⇤= argmax
x2XGoodness(x)
![Page 6: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/6.jpg)
Human-in-the-Loop Optimization
![Page 7: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/7.jpg)
Crowdsourced Human Computation
011001011101
Alexander J. Quinn and Benjamin B. Bederson. 2011. Human computation: a survey and taxonomy of a growing field. In Proc. CHI '11. 1403-1412.
![Page 8: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/8.jpg)
Related Work on Crowdsourced Human Computation
![Page 9: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/9.jpg)
Contributions
![Page 10: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/10.jpg)
Contributions
![Page 11: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/11.jpg)
![Page 12: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/12.jpg)
![Page 13: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/13.jpg)
![Page 14: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/14.jpg)
![Page 15: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/15.jpg)
![Page 16: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/16.jpg)
![Page 17: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/17.jpg)
Microtask Design
![Page 18: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/18.jpg)
Microtask Design
![Page 19: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/19.jpg)
😁
![Page 20: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/20.jpg)
Technical Challenges
![Page 21: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/21.jpg)
Technical Background: (Standard) Bayesian Optimization
![Page 22: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/22.jpg)
(Standard) Bayesian Optimization実験計画
![Page 23: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/23.jpg)
![Page 24: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/24.jpg)
![Page 25: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/25.jpg)
![Page 26: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/26.jpg)
![Page 27: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/27.jpg)
![Page 28: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/28.jpg)
![Page 29: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/29.jpg)
![Page 30: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/30.jpg)
![Page 31: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/31.jpg)
![Page 32: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/32.jpg)
New Technique: Bayesian Optimization Based on Line Search
![Page 33: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/33.jpg)
Our Method
comparative な答えしか使えない
![Page 34: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/34.jpg)
How to Define Slider Spaces
S
![Page 35: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/35.jpg)
How to Define Slider Spacesx
+= argmax
x2{xi}µ(x)
x
EI= argmax
x2XEI(x)
![Page 36: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/36.jpg)
![Page 37: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/37.jpg)
![Page 38: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/38.jpg)
![Page 39: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/39.jpg)
![Page 40: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/40.jpg)
![Page 41: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/41.jpg)
![Page 42: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/42.jpg)
![Page 43: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/43.jpg)
![Page 44: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/44.jpg)
![Page 45: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/45.jpg)
![Page 46: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/46.jpg)
![Page 47: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/47.jpg)
![Page 48: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/48.jpg)
![Page 49: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/49.jpg)
![Page 50: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/50.jpg)
![Page 51: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/51.jpg)
Web Interface for Crowdsourcing
![Page 52: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/52.jpg)
![Page 53: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/53.jpg)
Applications #1 Photo Color Enhancement (6D)
![Page 54: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/54.jpg)
![Page 55: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/55.jpg)
![Page 56: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/56.jpg)
Evaluation: Crowdsourced Voting
![Page 57: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/57.jpg)
![Page 58: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/58.jpg)
![Page 59: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/59.jpg)
![Page 60: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/60.jpg)
Applications #2 Material Appearance (3D / 7D)
![Page 61: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/61.jpg)
![Page 62: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/62.jpg)
![Page 63: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/63.jpg)
![Page 64: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/64.jpg)
![Page 65: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/65.jpg)
![Page 66: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/66.jpg)
![Page 67: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/67.jpg)
![Page 68: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/68.jpg)
Comparative Evaluation
![Page 69: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/69.jpg)
Comparative Evaluation
![Page 70: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/70.jpg)
![Page 71: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/71.jpg)
Experiment #1: Synthetic Setting
![Page 72: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/72.jpg)
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0 5 10 15 20
0.000.050.100.150.200.250.300.350.400.45
0 5 10 15 20
Optimizing a 2D function
![Page 73: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/73.jpg)
Optimizing a 6D function
0.000.100.200.300.400.500.600.700.800.901.00
0 5 10 15 20
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0 5 10 15 20
![Page 74: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/74.jpg)
Optimizing a 20D function
0.00
0.20
0.40
0.60
0.80
1.00
1.20
1.40
1.60
0 5 10 15 20
0.00
0.20
0.40
0.60
0.80
1.00
1.20
1.40
0 5 10 15 20
![Page 75: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/75.jpg)
![Page 76: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/76.jpg)
Experiment #2: Crowdsourcing Setting
![Page 77: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/77.jpg)
Experiment #2: Crowdsourcing Setting
0
5
10
15
20
25
30
35
0 2 4 6 8 10 12 14 16 18 20 0
5
10
15
20
25
30
35
0 2 4 6 8 10 12 14 16 18 20
![Page 78: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/78.jpg)
Summary
![Page 79: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/79.jpg)
Summary
Concept:
Strategy:
Technique:
Applications:
![Page 80: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/80.jpg)
Limitation & Future Work
![Page 81: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/81.jpg)
Sequential Line Search for Efficient Visual Design Optimization by Crowds
Takeo IgarashiIssei SatoYuki Koyama Daisuke Sakamoto
![Page 82: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/82.jpg)
![Page 83: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/83.jpg)
Optimization with Different Initial Conditions
![Page 84: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/84.jpg)
![Page 85: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/85.jpg)
Task Burden (Completion Time)
0
10
20
30
40
50
60
70
80
90
SSM 2GC 4GC
Task
Com
plet
ion
Tim
e [s
]
![Page 86: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/86.jpg)
Advantages of Involving Many Crowds
![Page 87: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/87.jpg)
Assumptions on Design Domains
![Page 88: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/88.jpg)
Assumptions on Crowds
![Page 89: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/89.jpg)
Difficult Cases
SIGGRAPH
SIGGRAPH
SIGGRAPH
![Page 90: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/90.jpg)
![Page 91: [SIGGRAPH 2017] Sequential Line Search for Efficient Visual Design Optimization by Crowds](https://reader033.vdocument.in/reader033/viewer/2022061306/5aaaff897f8b9a336d8b45c9/html5/thumbnails/91.jpg)