many roads lead to rome. mapping users’ problem solving strategies

inside

Not only, whether one gets to Rome, but also how.Not only, whether a user solves a task, but also how.

What other processes lie in the dark?

problem solving

Many Roads Lead to Rome.Mapping Users’ Problem Solving Strategies

Eva Mayr, Michael Smuc, Hanna Risku

Research Center KnowCommDanube University Krems

Problem Solving

Problem Type

Well-defined

Ill-defined

Problem Type

Solution

Well-defined

One correct solution

Ill-definedMore than one correct solutions

Problem Type

SolutionProblem Solving Strategies

Well-defined

One correct solution

Multiple ways to get there

Ill-definedMore than one correct solutions

Multiple ways to get there

Problem Type

SolutionProblem Solving Strategies

Example

Well-defined

One correct solution

Multiple ways to get there

Reading in the data (e.g. concrete value)

Ill-definedMore than one correct solutions

Multiple ways to get there

Reading beyond data(e.g. new hypotheses)

Eyeryday work problems are often ill-defined!

User Study

Aim: Comparison of two prototyps of Visual Analytics tools

Sample: 12 data explorers

5 real-world data sets

6-7 problems (from well- to ill-defined)

Measures: think-aloud, eye-gaze, interaction

Multiscale vs. GROOVE

Problem 1: Reading the Data

What is the exact value on Christmas day 2007?meteorology

0

20

40

60

80

100

count fromDec, 31st

count fromDec, 1st

approximateweek 51

estimate

economic tunrovers

0

20

40

60

80

100

count fromDec, 31st

count fromDec, 1st

approximateweek 51

estimate

education

0

20

40

60

80

100

count fromDec, 31st

count fromDec, 1st

approximateweek 51

estimate

020

4060

80100

coun

t fro

mD

ec, 3

1st

coun

t fro

mD

ec, 1

st

appr

oxim

ate

wee

k 51

estim

ate

Groove Multiscale

traffic accidents

0

20

40

60

80

100

count fromDec, 31st

count fromDec, 1st

approximateweek 51

estimate

Problem 1: Reading the Data

What is the exact value on Christmas day 2007?

020

4060

80100

coun

t fro

mD

ec, 3

1st

coun

t fro

mD

ec, 1

st

appr

oxim

ate

wee

k 51

estim

ate

Groove Multiscale

Problem 2: Reading Beyond the Data

From which gastronomic business do the data stem?0 20 40 60 80 100

weekly sale pattern

circadian sale pattern

annual sale pattern

weekly opening hours

daily opening hours

turnover.

0

1

2

3

4

5

wrong solution no solution correct solution

Conclusions

Problem solving strategies can be identified with little effort.

Problem solving strategies are highly situated.

For ill-defined problems different information sources are used, both types of problems allow for multiple strategies.

Problem solving strategies are related to the solution quality.

Analyzing problem solving strategies provides suggestions how to improve a tool.

Postulations for Discussion

The black box of the „exploratory mind“ is still in the dark for a great extent. Analysing problem solving strategies can shed light on it.

Problem solving strategies are related to insights, time and errors.

A „good“ visual analytics tool allows for multiple ways to Rome. Insights, time or errors alone cannot unveal this fact.

Thanks …

… to our expert users for participating

… to the Austrian research foundation (FFG) for funding

… to the reviewers for re-directing the focus of our paper

… to you for your interest