in car speech user interfaces - swanh education event presentation, january 2009

In-Car Speech User Interfaces

Andrew Kun

Students @ ECE

Jon Oppelaar Oskar Palinko Zeljko Medenica

Owen Derby Alex Shyrokov Puneet Lakhanpal

Outline

• Ubicomp and cars• Studies• What’s next?

Navigation

Music, phones

Cars in the age of ubicomp

• Car = docking port (Russell Shields, Ygomi)• Good docking port = open interface• Liability?• Profit?

Police cars

• Toys vs. tools• Vanguard of in-car

ubicomp

Project54

Outline

• Ubicomp and cars

• Studies• What’s next?

Studies

• Problem:– In car devices vs. driving performance

Studies

• Goal: – Evaluation tool– Reduce distractions

Studies

• Major hypotheses:– UI characteristics– Road conditions– Psychological state

Evaluating hypotheses

• Driving simulator user studies

DriveSafety driving simulator• tinyurl.com/p54sim

Driving performance

• Variance:– Lane position– Steering wheel angle– Velocity– Distance to leading vehicle

• Lane departures• Collisions• Etc…

Seeingmachines eye tracker• tinyurl.com/eyetracker

Visual attention

• Fixations (> 100 ms): number, timing, etc.• Scanning• Time looking at road• Etc…

Studies

• Glove PTT:– Accuracy– PTT usage– PTT interaction type

• Glove PTT:– Accuracy– PTT usage– PTT interaction type

• Navigation:– Printed, GUI, speech– City, highway, curves

• Navigation:– Printed, GUI, speech– City, highway, curves

Glove PTT study

Fixed PTT operation

Fixed PTT – glances!

Glove PTT operation

Glove PTT – few glances

Navigation study

• Motivation: PNGs proliferating• Task: follow directions to destination• Design:– Directions: paper map/GUI + speech/speech– Road conditions: highway/suburban highway/city

Cabin setup

Printed directions

GUI and voice directions

Voice only directions

Outline

• Ubicomp and cars• Studies

• What’s next?

Navigation study

• Why is LCD screen important?

What’s next?• Frustration?

Acknowledgements

• NSF• US DOJ• Microsoft Research• Tellme

www.eceblogger.comFacebook page: tinyurl.com/eceunhfacebook