Download - What is Florian attending to ?
![Page 1: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/1.jpg)
Natural Gaze Behavior (and Gaze-Contingent Interfaces)Max Planck Institute for Biological CyberneticsTübingen
![Page 2: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/2.jpg)
What is Florian attending to ?
2
?
Image courtesy of VIZ-KN
![Page 3: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/3.jpg)
3Image courtesy of VIZ-KN
Foveal resolution
?
What is Florian attending to ?
![Page 4: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/4.jpg)
Project goals Track user’s gaze in realtime
Describe natural gaze behavior on wall-sized displays
Factors that influence gaze behavior
Exploit gaze behavior
4
![Page 5: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/5.jpg)
Tracking Gaze - Hardware
5
EyeSeeCamhttp://www.journalofvision.org/8/14/12/Schumann-2008-jov-8-14-12.pdf
Videobased eyetrackers
Body motion trackers
+
![Page 6: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/6.jpg)
Tracking Gaze - Software(https://www.sourceforge.net/projects/libgaze)
6
libGaze ApplicationHeadTracker:
Vicon
EyeTracker: Eyelink2
Display:
Planar
Open-source framework for combining eye-tracking and head-tracking systems
Linux/MacOS/Windowsbasic
implementation in C APIs in:
o jGaze (Java)o pyGaze (Python)o libgazesharp (C#)
![Page 7: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/7.jpg)
Tracking Gaze – Framework Herholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R….
7
![Page 8: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/8.jpg)
-10 -8 -6 -4 -2 0 2 4 6 8 10-10
-8
-6
-4
-2
0
2
4
6
8
10Median fixation offset during movements and corresponding variance
Horizontal visual angle (deg)
Ver
tical
vis
ual a
ngle
(deg
)
libGaze evaluationHerholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R., libGaze: an open-source library for computing gaze in real-time,Journal of Vision. (in preparation)
8
91°/2.2m74
.5°/1
.8m
head free
head restrained
Movement Errors Calibration Errors Fixation Errors
10°=
![Page 9: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/9.jpg)
Describing natural gaze behaviorChuang L., Herholz S., Bülthoff H.H., Fleming R., Unrestrained gaze statistics on natural image processing,Vision Research. (in preparation)
9
Eye-Head Coordination Natural task
1
FreeViewing
CountAnimals
![Page 10: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/10.jpg)
10
What Influences Gaze Behavior ?
![Page 11: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/11.jpg)
What Influences Gaze Behavior ?
11
Rate Attractiveness
Count Animals
COGNITIVE TASKPERCEPTUAL IMAGE SENSORY CUES
![Page 12: What is Florian attending to ?](https://reader036.vdocument.in/reader036/viewer/2022081505/568164d8550346895dd71d92/html5/thumbnails/12.jpg)
Exploit Gaze Behavior Multi-modal interfaces (demo in collaboration with HCI-KN)
Facilitate user experience with gaze-contingent actions (DFG proposal with HCI-KN)
Evaluate ‘real-estate’ value of large displays (VIZ-KN)
Overcome computational bottlenecks (CG-Tü)
12