Natural Gaze Behavior (and Gaze-Contingent Interfaces)Max Planck Institute for Biological CyberneticsTübingen

What is Florian attending to ?

2

?

Image courtesy of VIZ-KN

3Image courtesy of VIZ-KN

Foveal resolution

?

What is Florian attending to ?

Project goals Track user’s gaze in realtime

Describe natural gaze behavior on wall-sized displays

Factors that influence gaze behavior

Exploit gaze behavior

4

Tracking Gaze - Hardware

5

EyeSeeCamhttp://www.journalofvision.org/8/14/12/Schumann-2008-jov-8-14-12.pdf

Videobased eyetrackers

Body motion trackers

+

Tracking Gaze - Software(https://www.sourceforge.net/projects/libgaze)

6

libGaze ApplicationHeadTracker:

Vicon

EyeTracker: Eyelink2

Display:

Planar

Open-source framework for combining eye-tracking and head-tracking systems

Linux/MacOS/Windowsbasic

implementation in C APIs in:

o jGaze (Java)o pyGaze (Python)o libgazesharp (C#)

Tracking Gaze – Framework Herholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R….

7

-10 -8 -6 -4 -2 0 2 4 6 8 10-10

-8

-6

-4

-2

0

2

4

6

8

10Median fixation offset during movements and corresponding variance

Horizontal visual angle (deg)

Ver

tical

vis

ual a

ngle

(deg

)

libGaze evaluationHerholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R., libGaze: an open-source library for computing gaze in real-time,Journal of Vision. (in preparation)

8

91°/2.2m74

.5°/1

.8m

head free

head restrained

Movement Errors Calibration Errors Fixation Errors

10°=

Describing natural gaze behaviorChuang L., Herholz S., Bülthoff H.H., Fleming R., Unrestrained gaze statistics on natural image processing,Vision Research. (in preparation)

9

Eye-Head Coordination Natural task

1

FreeViewing

CountAnimals

10

What Influences Gaze Behavior ?

What Influences Gaze Behavior ?

11

Rate Attractiveness

Count Animals

COGNITIVE TASKPERCEPTUAL IMAGE SENSORY CUES

Exploit Gaze Behavior Multi-modal interfaces (demo in collaboration with HCI-KN)

Facilitate user experience with gaze-contingent actions (DFG proposal with HCI-KN)

Evaluate ‘real-estate’ value of large displays (VIZ-KN)

Overcome computational bottlenecks (CG-Tü)

12