Where to go with your subject?!

Anne Everars, Greet Robijns en Ward Cools

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

ContentIntroduction

What? Why? How?Design choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

What to visualize?

Difference between LAK and EDM data

Localization of the subjects

Differences between participating universities (number of written papers)

woensdag 22 mei 13

Why this?

Interesting to know where people are writing about a certain subject

LAK and EDM have a comparable research domain➠ visualize the differences

Quantity is also visualized, to see where a lot of research is done about a subject

woensdag 22 mei 13

How did we do this?

Beginning

Simple map with markerfor the associations

map with EDM versus LAK data

woensdag 22 mei 13

How did we do this?

Rapid prototyping

Paper prototype

First digital version

Expert evaluation

Second digital version

Evaluation digital version

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Design choices

Conflict:

Visualize the quantity of papers e.g. in the US more publications than in Guatemala

Visualize distribution between LAK and EDM

woensdag 22 mei 13

Design choices

Continue working with bar charts

Markers are too close together

Bar can get really long

Not clear to which association it belongs

woensdag 22 mei 13

Design choices

Pie chart

Located at the center of the association

Unreadable when zoomed out or many associations close together

Hard to compare associations (number of papers not clear)

woensdag 22 mei 13

Design choicesPop-ups

Clear to which association it belongs

Map not flooded with - potentially unwanted - information

Small markers on the map itself

Hover over association to see the name

Colored countries

woensdag 22 mei 13

Design choices

woensdag 22 mei 13

Pop-ups?

Visualize information about one association

Visualize differences between two associations

2 options were evaluated by use of paper prototype

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototype

woensdag 22 mei 13

Paper prototypethe compare issue

woensdag 22 mei 13

EvaluationSome remarks during user test

‘Compare’ and ‘Search’ button are placed too close together.

Dots in the map might be mistaken for capital cities

Axis should be calibrated on the pop-ups

Can you only push the ‘Compare’ button if (more than) one association is selected?

Compare more than two associations?woensdag 22 mei 13

EvaluationSUS-questionnaire➠ express the quality with a number➠ get a view of the usability of the application

SUS-score = 74

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Changes

Scale : no continuous colors, but discrete➠ beter visualize the differences

Location of search and compare button are (hopefully) better

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Digital prototype

woensdag 22 mei 13

Remarks from class

0 papers ⇒ graph not clear

Color scale not clear➠ continuous scale is better than 5 colors

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Expert evaluation

Transparency adds too much complexity to the overview map➠ chose what to visualize (switched view?)

Small markers visible at a higher level?

Keep an overview of the entire map while zoomed in

Graph in compare view is confusing

Evaluation over time?

woensdag 22 mei 13

Changes

Added radiobuttons

Two levels : - quantity - conference

No more transparency

Overview map

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Evaluation - remarks

Radio buttons difficult to see

Hard to click the ‘compare city’ button➠ caused by the computer

Graphs : unclear x-axis

Interesting to look at multiple cities,since there is mostly only one paper about a subject

woensdag 22 mei 13

EvaluationSUS-score = 65.6

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

What we learnedSome associations have a strong preference for one of the conferences

‘learning’ gives a divided image

Learning analytics and machine learning both concern learning

Visualize both conferences

Social network analysis

mainly LAK

only popular in certain countrieswoensdag 22 mei 13

What we learnedSome associations have a strong preference for one of the conferences

‘learning’ gives a divided image

Learning analytics and machine learning both concern learning

Visualize both conferences

Social network analysis

mainly LAK

only popular in certain countrieswoensdag 22 mei 13

What we learned

Important to get an idea about the data

Important to get an idea about what what people want to know about the data

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Teamwork?

First meeting to look at what we wanted and how we wanted to do visualize it

Divided the tasks

Everyone did their part

Greet did evaluation, Anne and Ward worked on the changes

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Technical issues?

Clash between markers and pop-ups

Location of universities

Naming of universitye.g. Katholieke Universiteit Leuven vs. K.U.Leuven

Coloring countries

woensdag 22 mei 13

ContentIntroductionDesign choicesPaper prototypeDigital prototypeExpert evaluationEvaluation digital prototypeWhat we learnedTeamworkTechnical issuesFuture work

woensdag 22 mei 13

Future work

White-space in compare boxes

More information about a paper or university

Evaluation over time

Search option when selected “# papers”

woensdag 22 mei 13

DEMO

woensdag 22 mei 13

woensdag 22 mei 13

?Questions?

woensdag 22 mei 13