gamification-supported exploration of natural user interfaces
DESCRIPTION
In this paper, we describe a novel concept for motivating users to explore applications using natural user interfaces in the automotive domain. Based on prior findings, it can be very hard for users to detect opportunities of action in such systems. Additionally, traditional “did you know?” hints seem to be ignored by many users today. As a countermeasure, we describe an approach that shall motivate users to explore natural user interfaces by using game elements. By awarding the user with badges and experience level-ups, we hope to create a stronger motivation that is at least maintained until the user is used to the system.TRANSCRIPT
Technische Universität München Distributed Multimodal Information Processing Group
Gamification-supported Exploration of Natural User Interfaces
Stefan Diewald1, Andreas Möller1, Luis Roalter1, Matthias Kranz2
1Technische Universität München, Germany 2Luleå University of Technology, Department of Computer Science,
Electrical and Space Engineering, Luleå, Sweden
October 17, 2012 2nd Workshop on Automotive Natural User Interfaces (AutoNUI) at the 4th International Conference on
Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI), Portsmouth, NH, USA
Technische Universität München Distributed Multimodal Information Processing Group
Starting Situation: Complex Automotive User Interfaces
17.10.2012 Stefan Diewald 2
Image sources: Wikimedia Commons; http://www.e31.net/pics/Bordcomputer.jpg; http://www.auto123.com/ArtImages/102556/BMW_I_drive_i2.jpg;
Finding a desired functionality can be very time and attention-consuming.
Technische Universität München Distributed Multimodal Information Processing Group
Countermeasure: Natural User Interfaces
17.10.2012 Stefan Diewald 3
Image sources: http://www.autoguru.at/wp-content/uploads/2012/03/audi_multitouch_11.jpg; http://www.bmw.com/com/en/insights/technology/technology_guide/articles/_shared/img/voice_control_system.jpg
Natural User Interfaces: § Multi-touch § Gestures § Voice dialogs § … Less distraction and better user experience?
Technische Universität München Distributed Multimodal Information Processing Group
“Natural user interfaces are not natural”
17.10.2012 Stefan Diewald 4
“Speech utterances will have to be learned and gestures carefully developed and standardized through time.”
“None of these systems is inherently more natural than the others.”
Donald A. Norman. 2010. Natural user interfaces are not natural. interactions 17, 3 (May 2010), 6-10.
Technische Universität München Distributed Multimodal Information Processing Group
DriveAssist – Driver Assistance and Awareness System
17.10.2012 Stefan Diewald 5
§ Runs on mobile devices (Android smartphones and tablet PCs) § Multi-touch for interacting with the map view
Technische Universität München Distributed Multimodal Information Processing Group
DriveAssist – Driver Assistance and Awareness System
17.10.2012 Stefan Diewald 6
Technische Universität München Distributed Multimodal Information Processing Group
Interaction problems with DriveAssist
First test: § difficulties in exploring touch menus § unaware of gestures: e.g. “pinch-to-zoom” & rotation
17.10.2012 Stefan Diewald 7
Technische Universität München Distributed Multimodal Information Processing Group
“Did you know?”-hints for DriveAssist
17.10.2012 Stefan Diewald 8
12 participants
45 minutes
only 7 did notice the hint
and only 1 found the hint useful
Technische Universität München Distributed Multimodal Information Processing Group
The Challenge
Create a strong motivation for exploring natural user interfaces in the automotive domain:
§ Uncover hidden functions
§ Make usage more comfortable
17.10.2012 Stefan Diewald 9
Technische Universität München Distributed Multimodal Information Processing Group
The Idea: 1 - Gamification
17.10.2012 Stefan Diewald 10
… the use of game design elements in non-game contexts.
Sebastian Deterding et al. 2011. From game design elements to gamefulness: defining "gamification". In Proceedings of the 15th International Academic MindTrek Conference. ACM, New York, NY, USA, 9-15.
Technische Universität München Distributed Multimodal Information Processing Group
Gamification Example
17.10.2012 Stefan Diewald 11
Image sources: http://aboutfoursquare.com/wp-content/uploads/2011/03/photo-11.png; http://cdn3.techworld.com/cmsdata/reviews/3210966/foursquare_badges_360.jpg;
Technische Universität München Distributed Multimodal Information Processing Group
The Idea: 2 - Share and Compare
17.10.2012 Stefan Diewald 12
Image sources: http://www.uplaude.com/blog/; Wikimedia Commons; Nike+
Technische Universität München Distributed Multimodal Information Processing Group
Gamification in the Automotive Domain
17.10.2012 Stefan Diewald 13
MyFord – collect badges online. Chevy Volt – dashboard gamification for efficient driving.
Technische Universität München Distributed Multimodal Information Processing Group
Gamification-supported Exploration of NUIs
17.10.2012 Stefan Diewald 14
One-time badges For more common functions.
Experience Levels For less known and less
accessed functions.
Technische Universität München Distributed Multimodal Information Processing Group
What can be gained?
17.10.2012 Stefan Diewald 15
…
Open the windows through voice control.
Enter a navigation target via handwriting recognition.
Change the chassis configuration via voice control.
…
x1
Technische Universität München Distributed Multimodal Information Processing Group
When to award a Badge or Level-up?
17.10.2012 Stefan Diewald 16
Technische Universität München Distributed Multimodal Information Processing Group
How to award a Badge or Level-up?
17.10.2012 Stefan Diewald 17
Congratulations, you have just unlocked the “navigation target badge” by entering your destination via voice control.
Technische Universität München Distributed Multimodal Information Processing Group
“Share and Compare”
17.10.2012 Stefan Diewald 18
Image sources: http://2.bp.blogspot.com/-77IL5MZo1mQ/UDIpMenIf2I/AAAAAAAAPLg/szq3N3Iyj1Y/s1600/Tank.jpg
Share new badges and experience level-ups directly with friends in real time.
Technische Universität München Distributed Multimodal Information Processing Group
The Goal
Create a strong motivation for exploring natural user interfaces in the automotive domain,
… that is at least maintained until the user is used to the system.
17.10.2012 Stefan Diewald 19
Technische Universität München Distributed Multimodal Information Processing Group
Future Work
17.10.2012 Stefan Diewald 20
Technische Universität München Distributed Multimodal Information Processing Group
Thank you for your attention! Questions?
? ? Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 21
[email protected] www.vmi.ei.tum.de/team/stefan-diewald.html
Technische Universität München Distributed Multimodal Information Processing Group
Paper Reference
• Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/GamificationNUI_preprint.pdf
• Please cite this work as follows: • Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.
Gamification-supported Exploration of Natural User Interfaces In: Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI2012), pp. 47-48, Portsmouth NH, USA, October 2012
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 22
Technische Universität München Distributed Multimodal Information Processing Group
If you use BibTex, please use the following entry to cite this work:
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 23
@INPROCEEDINGS{NUIGamification2012, author = {Stefan Diewald and Andreas M\"{o}ller and Luis Roalter and Matthias Kranz}, title = {{Gamification-supported Exploration of Natural User Interfaces}}, booktitle = {{Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2012)}}, year = {2012}, month = oct, pages = {47--48}, location = {Portsmouth NH, USA}, }