effects of using a push to talk button for speech user interfaces on visual attention

Effects of using a push-to-talk button for speech user interfaces on visual attention

Authors: Nemanja Memarović, Oszkar Palinko, Andrew Kun

Effects of using a push-to-talk button for speech user interfaces on visual attention

Outline Introduction Problems Goal Hypothesis Approach Results

Effects of using a push-to-talk button for speech user interfaces on visual attention

Introduction

Ambient recognition

Push-to-talk button

VS.

Effects of using a push-to-talk button for speech user interfaces on visual attention

Low speech recognition accuracy Visual attention

What’s thatyou say?

Problems

Worse driving performance

Effects of using a push-to-talk button for speech user interfaces on visual attention

Problems – PTT operation

Effects of using a push-to-talk button for speech user interfaces on visual attention

Problems - Glances

Effects of using a push-to-talk button for speech user interfaces on visual attention

Goal To improve safety by reducing number of glances at the PTT button

Effects of using a push-to-talk button for speech user interfaces on visual attention

Hypothesis 1/2 Verbal instructions

Keep your eyeson the road

Effects of using a push-to-talk button for speech user interfaces on visual attention

Hypothesis 2/2 Warning sticker

Push-to-talk button

Effects of using a push-to-talk button for speech user interfaces on visual attention

Approach 1/2 Experiment setup

Eye tracker Head camera Hands camera

Eye tracker screen camera

Effects of using a push-to-talk button for speech user interfaces on visual attention

Approach 2/2 Experiment design

Primary task - following the lead vehicle Secondary task - speech control of the radio 8 subjects, 4 in each group 2x2x2 design

GroupsWith verbal instructions

Without verbal instructions

SUI solution

PTT Ambient PTT Ambient

AccuracyHigh

Low

1

2

3

4

Interactions for subject 1

Effects of using a push-to-talk button for speech user interfaces on visual attention

GroupsWith verbal instructions

Without verbal instructions

SUI solution

PTT Ambient PTT Ambient

AccuracyHigh

Low

2

1

4

3

Interactions for subject 2

Approach 2/2 Experiment design

Primary task - following the lead vehicle Secondary task - speech control of the radio 8 subjects, 4 in each group 2x2x2 design

Effects of using a push-to-talk button for speech user interfaces on visual attention

Results

Mea

n la

ne p

ositi

on v

aria

nce

(m2 )

Effects of using a push-to-talk button for speech user interfaces on visual attention

ResultsM

ean

stee

ring

whe

el

angl

e va

rianc

e (o

2 )

Effects of using a push-to-talk button for speech user interfaces on visual attention

Results

Mea

n ve

loci

ty v

aria

nce

(m2 /

s2 )

Effects of using a push-to-talk button for speech user interfaces on visual attention

Results

Effects of using a push-to-talk button for speech user interfaces on visual attention

Conclusion

Fewer glances

Further analysis of the data Determining statistical significance

Effects of using a push-to-talk button for speech user interfaces on visual attention

Thank you for your attention!

Questions?