watchit: simple gestures and eyes-free interaction for wristwatches and bracelets s. perrault, e....
TRANSCRIPT
![Page 1: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/1.jpg)
1
WatchIt: Simple Gestures and Eyes-free Interaction for
Wristwatches and Bracelets
S. Perrault, E. Lecolinet, J. Eagan, Y. GuiardTélécom ParisTech – LTCI CNRS UMR 5141
![Page 2: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/2.jpg)
2
How to interact while…
![Page 3: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/3.jpg)
3
…walking on a crowded street
![Page 4: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/4.jpg)
4
…when your phone is hard to reach
![Page 5: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/5.jpg)
5
…if you need to pay attention to your surrounding
![Page 6: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/6.jpg)
6
Microinteractions
• Named by [Ashbrook2010]– Quick (~3-4 secs)– Punctual– Short interruption
![Page 7: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/7.jpg)
7
Examples of Microinteractions
• Reject call• Check messages• Check location• Check agenda/time• GPS Navigation• Manage music• Etc…
![Page 8: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/8.jpg)
8
Particular example: Music
10 commands + continuous control + list scrolling
![Page 9: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/9.jpg)
9
Where to perform Microinteractions?
![Page 10: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/10.jpg)
10
On the Wrist!
~60% of women & ~40% of men wear bracelets or wristwatches every day.
![Page 11: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/11.jpg)
11
Many Commercial Products
• Permanently on the user• Easy to access
Pebble I’m Watch iWatch?
![Page 12: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/12.jpg)
Interaction on a Wristwatch
• Occlusion• Fat finger problem
• Input/output– Limited– Merged
12
![Page 13: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/13.jpg)
13
[Ashbrook2008][Blasko2004][Baudisch2009]
Existing Solutions
• Bezel• Back of device• Contactless• Device motion
Watchband?[Harrison2009][Rekimoto2001]
![Page 14: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/14.jpg)
14
Novel Solution: Interaction on the Watchband
• Large surface• Tactile feedback• Input/output
separation– No occlusion– No fat finger problem
External band
Internal band
![Page 15: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/15.jpg)
15
Interaction on a Watchband
MOCKUP
![Page 16: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/16.jpg)
16
Implementation: the WatchIt Prototype
• Resistive technology• Advantages:– Low power– Few accidental activations– Not apparent– Cheap
• Drawback:– 1 dimension only
![Page 17: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/17.jpg)
17
Interaction Needs
10 commands + continuous control + list scrolling
![Page 18: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/18.jpg)
18
Eyes-free Interaction
10 commands + continuous control + list scrolling
![Page 19: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/19.jpg)
19
Gestures Technique
• 3 pointing zones– Extremities– Large central zone
• 2 sliding directionsClasp Screen
• Pinching= (3+2)*3 = 15 gestures
External band
Internal band
![Page 20: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/20.jpg)
« Apricot »
Pear
Kiwi
Fig
Banana
Apricot
Audio Menu Technique
• Inspired by earPod [Zhao2007]
• Each band divided in 5 zones
• 1 zone = 1 item• Continuous audio feedback
20
« Fig »
![Page 21: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/21.jpg)
21
Interaction Evaluation
Are users able to perform many commands without looking at the device?
• Gestures vs. Audio Menu• 8 participants• Accuracy & time– Time = reaction + travel + gesture
![Page 22: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/22.jpg)
Audio Menu Technique
• Accuracy 94%– No band effect
• Time– Average 3.2s– Band effect
22
Tim
e (s
)Ac
cura
cy (%
)
External Internal 2-contacts
External Internal 2-contacts22
![Page 23: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/23.jpg)
23
Gestures Technique
• Band effect– Accuracy– Time
• Comparison– Gestures faster– Menu + precise
External Internal 2-contacts 80
85
90
95
100
Accu
racy
(%)
External Internal 2-contacts0
1
2
3
4
Tim
e (s
)
![Page 24: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/24.jpg)
24
List Scrolling
10 commands + continuous control + list scrolling
![Page 25: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/25.jpg)
25
List Scrolling Evaluation
Are users able to scroll lists on the watchband quickly and precisely?
• Navigation task• Touchscreen vs 2 techniques
![Page 26: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/26.jpg)
26
Technique: Relative Scrolling on Watchband
• Same as scrolling on a screen– Pan– Flicking
• More vertical space
ApricotBananaCherry
DatFig
GrapeKiwi
MandarineNut
OrangePeanut
Watermelon
ApricotBananaCherry
DatFig
GrapeKiwi
MandarineNut
OrangePeanut
Watermelon
![Page 27: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/27.jpg)
27
Relative Scrolling Video
![Page 28: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/28.jpg)
28
Technique: Absolute Scrolling on Watchband
• Mapping between:– List space (virtual)– Watchband space (physical)
• Close to screen = Beginning• Close to clasp = End of list
• Instant scrolling• Not very precise for long lists
ApricotBananaCherry
DatFig
GrapeKiwi
MandarineNut
OrangePeanut
Watermelon
![Page 29: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/29.jpg)
29
Absolute Scrolling Video
![Page 30: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/30.jpg)
30
Experimental Design
• Touchscreen active– Selection– Watchband as a complement– User preference & strategy
• 3 list sizes (15/60/240 items)• 6 distances (5, 10, 20, 40, 80, 160 items)• 12 participants
ApricotBananaCherry
DatFig
GrapeKiwi
MandarineNut
OrangePeanut
Watermelon
D =
5 it
ems
![Page 31: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/31.jpg)
31
Results
• Absolute scrolling– Faster on any list
• Relative scrolling– Always slower– Friction?
Short Medium Long0
2
4
6
8
Touch screen
Absolute scrolling bracelet
Relative scrolling bracelet
List size
Nav
igati
on T
ime
(s)
![Page 32: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/32.jpg)
32
Interaction Strategy
• Relative technique:– 1.02 pans/trial on screen
• Absolute technique:– Fast imprecise on watchband– Corrections on screen (1.93/trial)
![Page 33: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/33.jpg)
User Preferences
• Interaction on watchband– More comfortable– No occlusion
• Favorite technique:– Absolute technique (9/12)
33
![Page 34: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/34.jpg)
List Scrolling Findings
• Hybrid technique?– Absolute for fast movement– Relative for adjusting
• Augmented input space– Effective list scrolling– Appreciated by users
34
![Page 35: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/35.jpg)
WatchIt: Takeaway Message
• Micro- and rich interactions– Many commands (10+)– Eyes-free interaction– List scrolling
• Properties:– Increase input space– Input/output space separated
35
![Page 36: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/36.jpg)
36
Thank you! Questions?
The VIA team is looking for postdocs!
![Page 37: WatchIt: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets S. Perrault, E. Lecolinet, J. Eagan, Y. Guiard Télécom ParisTech – LTCI](https://reader036.vdocument.in/reader036/viewer/2022062511/5517e3a2550346cb568b4610/html5/thumbnails/37.jpg)
37
Mapping from vocabulary to musicCommand Matching gesture
Play/pause Middle position, internal bracelet
Previous Top position, internal bracelet
Next Bottom position, internal bracelet
Volume control (continuous) 2-contact sliding gestures
Position in the song (continuous) Sliding gestures, internal bracelet
Repeat Top, external
Shuffle Middle, external