User-System Interactiona challenge for the present and the future

Prof. dr. Matthias RauterbergIPO Center for User-System Interaction

Eindhoven University of Technology

Two approaches for Ergonomics

limits attractors

assessment design principles

Interdisciplinary Research Approach

Design relevantknowledge

Empiricalevaluation

Interactive systems

What is an Interactive System (IS) ?

user interaction system

perception

action(s)

IS := {IS*, Human, ICT component, [additional component]}

What are the research topics of USI?

systemuser

Working domain • Communication / Co-operation• Home / Office Environment• Financial / Medical Sector• Knowledge Management• Product / Process Industry• Transportation / Logistic• Teaching and Learning

Working system

Science• perception• cognition• action

Application

• user-centered design

Engineering• audio interfaces• computer vision/graphics• speech interfaces• tactile interfaces

Goal:Pa => Pd

Cooperation with Industry

The optimization problem

user systemcosts

degree of usability

optimum

What are the technical challenges?

• New interaction styles– speech input/output– computer vision based input (e.g., gestures)– audio interfaces (e.g., non-speech audio)– tactile and force feedback

• New interface concepts– adaptive and intelligent software– natural user interfaces

Trends in User Interface Technology

Ubiquitous and Mobile computing Ambient rooms and Cooperative buildings

• Perception Space– The physical space where

the user’s attention is.

• Action Space– The physical space where

the user acts in.

• Design Principle:– perception space and action

space must coincide!

What is design relevant knowledge?

physical operation

feedback control of action

goal-, subgoal-setting

mental operation

task(s)

planning of execution selection of means

the complete action cycle

synchronisation in time

synchronisation in space

Electronic Performance Support System

• Food processing plant worker with a first-generation prototype wearable computer.

• Possible applications include support for quality control data collection or assistance with environmental auditing.

• This system gives its users the information the users need to perform a task as they actually perform the task.

Airline Applications

• This remarkable ultra-lightweight computer, worn as a belt, delivers maximum information to users with a minimum of work.

• Designed for individuals who demand mobility, this computer offers voice control and heads up display for complete, hands-free operation.

• Users can enter or retrieve information while going about their jobs, instead of constantly returning to the shop area to check a stationary computer, or stopping work to punch keys.

The Virtual Workbench

The KOSIMA projectat the TU Aachen

Head-up Displays in Cars

• More information and less distractionInformation on the state of the road, on the speed of the vehicle in front (supplied by the intelligent cruise control), on obstacles lying around the next bend in the road identified by the remote detection system, or direction arrows sent by the driver guidance system... drivers will be receiving more and more information from "intelligent" vehicle systems.

Natural User Interfaces (NUI)

No technical equipment inside the body space of the user!

2. design principle

Perception space and action space must coincide!

1. design principle

Architecture of a Natural User Interface (NUI)

Working Area

Communication & Working Area

Paper document

Electronic documents

Tognazzini B: Tog on Software Design. (1996).

Wellner P, Mackay W, Gold R: Computer-Augmented Environments: Back to the Real World. (1993)Fitzmaurice G, Ishii H, Buxton W: Bricks: Laying the Foundations for Graspable User Interfaces. (1995)

NUI: The First Round

Design principle

Field test

virtual player

real chipvirtual chips

overhead projector

video camera

NEW button

NUI (1): The Digital Playing Desk

0

50

100

150

200

250

300

350

400

450

500

Cel

l Me

an f

or

time

of

use

r (s

)Cell Line Chart for "playing time"

Grouping Variable(s): Interface type

Error Bars: ± 1 Standard Deviation(s)

CI MI TI DPD

P<.001P<.01P<.001

P<.001

P<.001

P<.001

Digital Playing Desk: Playing time per game

Digital Playing Desk: winning chance per dialog technique

computer win

remis

user win Cell Line Chart for "winning chance"

Grouping Variable(s): Interface type

Error Bars: ± 1 Standard Deviation(s)

CI MI TI DPD

P<.001P<.080P<.020

P<.802

P<.001

P<.007

NUI: The Second Round

Design principle

Experiments

BUILD-IT: an integrative design tool

• design team with different domain knowledge

• unconstrained social interaction

• integration of form and content

• intuitive interaction style