TechnicalInnovationof the DayDipl.-Ing. Dennis Sasse

Gaze-based Interaction

1) What is gaze-based interaction?

2) Relevance of gaze-based interaction?

3) What are potential applications?

Core Questions

What is gaze-based interaction?brief introduction to eye-tracking

Gaze-based Interaction

Interaction simply by looking at the screen

Eye movement replaces mouse movement

Can be combined with traditional interaction

Eye-Tracking

Reflecting invisible infrared light onto an eye

Recording reflection pattern with sensor system

Calculating exact point of gaze

Relevance of gaze-based interaction?motivation and expectations

Advantages of Gaze-based Interaction*

Gaze jumps directly to points of interest

Gaze preludes manual selection with mouse or keyboard

Requires no physical movement or hand-eye coordination

*in a graphical operating system

Broad Target Audience

Gaze-based interaction is beneficial to:

People with disabilities

Users requiring both hands for their tasks

Anybody open to innovative interaction

Advances in Eye-Tracking Technology

Increasing accuracy and error resistancetolerance to head movement and glasses

Increasing ease of useeasy setup and calibration

Decreasing costs for hardwaremass market compatible

Time to react now!

What are potential applications?applications and opportunities

Mouse Replacement

Gaze replaces mouse as poiting device

Speech recognition for command input

Use of keywords for confirmationselect this, click that, scroll up, zoom in

Application Example 1

Additional User Information trough Eye-Tracking

Head position and distance to screenmight indicate attention

Blink rate and fixation times relates to concentration and cognitive workload

Pupil diameter can indicate excitement

Smart Magnifier

Detect screen area of user interest

Automatically magnify area of interest

Zoom correlates with user distance to screenalternatively triggered by speech command

Application Example 2

Smart MagnifierApplication Example 2

Auto-detect screen area of user interest

Smart MagnifierApplication Example 2

Magnify screen area depending on user distance to screen

Smart Media Player

Determine user attention via gaze-data

Pause movie playback when focus is lost

Resume playback when user is watching

Application Example 3

Smart Media PlayerApplication Example 3

Smart Media Player

Pause video playback when user is not watching

Application Example 3

II

Smart Media Player

Automatically resume playback when user is watching

Application Example 3

Seize the Opportunity!in conclusion

Eye-Trackers grow sophisticated and affordable

Gaze-based interaction offers many opportunities for innovative user interfaces

Windows could be the first OS to feature gaze-based interaction reinforcing its position as innovative OS

Summary

Thank you!

images taken from stock.xchng

Questions?