2 ? image courtesy of viz-kn 3 foveal resolution ?
TRANSCRIPT
Natural Gaze Behavior (and Gaze-Contingent Interfaces)Max Planck Institute for Biological CyberneticsTübingen
What is Florian attending to ?
2
?
Image courtesy of VIZ-KN
3
Image courtesy of VIZ-KNFoveal resolution
?
What is Florian attending to ?
Project goals
Track user’s gaze in realtime
Describe natural gaze behavior on wall-sized displays
Factors that influence gaze behavior
Exploit gaze behavior
4
Tracking Gaze - Hardware
5
EyeSeeCamhttp://www.journalofvision.org/8/14/12/Schumann-2008-jov-8-14-12.pdf
Videobased eyetrackers
Body motion trackers
+
Tracking Gaze - Software(https://www.sourceforge.net/projects/libgaze)
6
libGazelibGaze ApplicationApplication
HeadTracker: Vicon
EyeTracker: Eyelink2
Display:
Planar
Open-source framework for combining eye-tracking and head-tracking systems
Linux/MacOS/Windowsbasic
implementation in C APIs in:
o jGaze (Java)o pyGaze (Python)o libgazesharp (C#)
Tracking Gaze – Framework Herholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R….
7
-10 -8 -6 -4 -2 0 2 4 6 8 10-10
-8
-6
-4
-2
0
2
4
6
8
10Median fixation offset during movements and corresponding variance
Horizontal visual angle (deg)
Ver
tical
vis
ual a
ngle
(de
g)
libGaze evaluationHerholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R., libGaze: an open-source library for computing gaze in real-time,Journal of Vision. (in preparation)
8
91°/2.2m74.5
°/1.8
m
head free
head restrained
Movement Errors Calibration Errors Fixation Errors
10°=
Describing natural gaze behaviorChuang L., Herholz S., Bülthoff H.H., Fleming R., Unrestrained gaze statistics on natural image processing,Vision Research. (in preparation)
9
Eye-Head Coordination Natural task
1
FreeViewing
CountAnimals
10
What Influences Gaze Behavior ?
What Influences Gaze Behavior ?
11
Rate Attractiveness
Count Animals
COGNITIVE TASKPERCEPTUAL IMAGE SENSORY CUES
Exploit Gaze Behavior
Multi-modal interfaces (demo in collaboration with HCI-KN)
Facilitate user experience with gaze-contingent actions (DFG proposal with HCI-KN)
Evaluate ‘real-estate’ value of large displays (VIZ-KN)
Overcome computational bottlenecks (CG-Tü)
12