tatiana evreinova / multimodal interaction research group

TAUCHI – Tampere Unit for Computer-Human Interaction

Tatiana Evreinova / Multimodal Interaction Research Group

Oleg Spakov / Gaze-Based Interaction Research Group

Tampere Unit for Computer-Human Interaction

Usability Exploration

of the Visual Textual Imaging


ProblemsProblems

– lip reading requires a great concentration of visual

attention and can be very stressful

– even qualified sign language interpreters cannot

interpret everything in group situations

– the usage of subtitling signing has a high level of

transmission difficulties and still remains as an

extremely expensive method of information imaging


Previous researchPrevious research

To facilitate associative interpretation new tokens

were mapped through eight directions


Previous researchPrevious research 2/2


experimental setup

Objectives in generalObjectives in general

– to develop communication techniques through

graphical imaging of textual information for the

profoundly deaf and hard-of-hearing people

– to find out an approach that would require minimum

resources of visual perception by using pseudo-graphic

tokens; these tokens must be perceived preattentively

and reduce cognitive loading


ScheduleSchedule

No Project’s activity Time Results

1 Definition of research methods

Implementation of the software prototype for testing

Week 1-3

Software

2 Based on developed software to carry out tachistoscopic exploration and visibility assessment of the fonts (phonetic & graphic ones)

Week 4, 5 Usability exploration and analysis of received data

3 Doing project paper Week 6-8 the project paper


– constructive research to design and simulate the new techniques

for textual imaging, software tools and algorithms for visibility

evaluation of graphic tokens

– empirical research based on tracking of the eye movements

subjective / objective evaluation:

tachistoscopic evaluation

visual scan time measurement

Research methodsResearch methods


ResourceResourcess

SMI Eye-Gaze tracking system allows recording eye movements

iComponent provides a possibility to use SMI Eye_Gaze data in other

application through a simple interface [developed by Oleg Spakov]

iView 3.01 program processes SMI Eye_Gaze data and displays

saccadic movements (row data), fixations and scanpaths


20 volunteers from staff and students at the University

of Tampere took part in the testing

All participants had normal or corrected-to-normal vision

with no known hearing deficit

Testing Testing (1/2)

experimental setup

6 phonetic fonts were

exposed throughout

experimental session


Each font was exposed on the screen for 7 seconds

Formal experiment has taken 7 days

monitoring of the testing on the examiner side

Testing Testing (2/2)


Preliminary resultsPreliminary results 1/31/3

A AAA

Arial Comic

Courier Impact

fixations and scanpaths recorded by SMI iView 3.01 program


Times New Roman

A

pseudo-graphic token


fixations and scanpaths recorded by SMI iView 3.01 program


0

2

4

6

Arial Comic Courier Impact Styled TimesNew

the average value of fixation areas during an exposition of visual stimuli

Fixation areas



Prospective applicationsProspective applications

development of new communication techniques

for strengthening of visual and linguistic

feedback between the deaf /hard-of-hearing

people and digital television environment


Thanks for your time Thanks for your time & & attentionattention

tatiana evreinova / multimodal interaction research group

Documents