many roads lead to rome. mapping users’ problem solving strategies
DESCRIPTION
Presenter: Eva Mayr, Michael Smuc, Hanna RiskuBELIV 2010 Workshophttp://www.beliv.org/beliv2010/TRANSCRIPT
inside
Not only, whether one gets to Rome, but also how.Not only, whether a user solves a task, but also how.
What other processes lie in the dark?
problem solving
Many Roads Lead to Rome.Mapping Users’ Problem Solving Strategies
Eva Mayr, Michael Smuc, Hanna Risku
Research Center KnowCommDanube University Krems
Problem Solving
Problem Type
Well-defined
Ill-defined
Problem Type
Solution
Well-defined
One correct solution
Ill-definedMore than one correct solutions
Problem Type
SolutionProblem Solving Strategies
Well-defined
One correct solution
Multiple ways to get there
Ill-definedMore than one correct solutions
Multiple ways to get there
Problem Type
SolutionProblem Solving Strategies
Example
Well-defined
One correct solution
Multiple ways to get there
Reading in the data (e.g. concrete value)
Ill-definedMore than one correct solutions
Multiple ways to get there
Reading beyond data(e.g. new hypotheses)
Eyeryday work problems are often ill-defined!
User Study
Aim: Comparison of two prototyps of Visual Analytics tools
Sample: 12 data explorers
5 real-world data sets
6-7 problems (from well- to ill-defined)
Measures: think-aloud, eye-gaze, interaction
Multiscale vs. GROOVE
Problem 1: Reading the Data
What is the exact value on Christmas day 2007?meteorology
0
20
40
60
80
100
count fromDec, 31st
count fromDec, 1st
approximateweek 51
estimate
economic tunrovers
0
20
40
60
80
100
count fromDec, 31st
count fromDec, 1st
approximateweek 51
estimate
education
0
20
40
60
80
100
count fromDec, 31st
count fromDec, 1st
approximateweek 51
estimate
020
4060
80100
coun
t fro
mD
ec, 3
1st
coun
t fro
mD
ec, 1
st
appr
oxim
ate
wee
k 51
estim
ate
Groove Multiscale
traffic accidents
0
20
40
60
80
100
count fromDec, 31st
count fromDec, 1st
approximateweek 51
estimate
Problem 1: Reading the Data
What is the exact value on Christmas day 2007?
020
4060
80100
coun
t fro
mD
ec, 3
1st
coun
t fro
mD
ec, 1
st
appr
oxim
ate
wee
k 51
estim
ate
Groove Multiscale
Problem 2: Reading Beyond the Data
From which gastronomic business do the data stem?0 20 40 60 80 100
weekly sale pattern
circadian sale pattern
annual sale pattern
weekly opening hours
daily opening hours
turnover.
0
1
2
3
4
5
wrong solution no solution correct solution
Conclusions
Problem solving strategies can be identified with little effort.
Problem solving strategies are highly situated.
For ill-defined problems different information sources are used, both types of problems allow for multiple strategies.
Problem solving strategies are related to the solution quality.
Analyzing problem solving strategies provides suggestions how to improve a tool.
Postulations for Discussion
The black box of the „exploratory mind“ is still in the dark for a great extent. Analysing problem solving strategies can shed light on it.
Problem solving strategies are related to insights, time and errors.
A „good“ visual analytics tool allows for multiple ways to Rome. Insights, time or errors alone cannot unveal this fact.
Thanks …
… to our expert users for participating
… to the Austrian research foundation (FFG) for funding
… to the reviewers for re-directing the focus of our paper
… to you for your interest