user testing: the agile way efsd
TRANSCRIPT
User testing: the agile wayAnna, Andre, Esther en Matthijs
We are Angi Studio
In 13 years, 350+ successful online projects
userchecks
research
concept:
functional testing and automated tests
implementation:analyticsmonitoring:
A/B or multivariate testing
improvement:
1
2
34
5
The next hour…Why test your assumptions?
Choosing the right method
The advantages of user checks
Maximising your impact
DIY usercheck!
Choosing the right method
userchecks
research
concept:
functional testing and automated tests
implementation:analyticsmonitoring:
A/B or multivariate testing
improvement:
1
2
34
5
The advantages
Connect better with end-users› Observing behaviour
› Understanding underlying reasoning
› Taking away impediments
1
Manage risks› Design decisions based on findings, not
suspicions
› Eliminate mistakes early in the process
› Save time and money
› Playground for new ideas
2
Fast & flexible› Designer involved with the test
› Change design in-between tests
› No unnecessary documentation3
Maximising your impact
Who plays which part?
PARTICIPANT
TEST LEADER
NOTE TAKER
CLIENT
www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
It’s better to have 1 participant in the beginning of the process than 50 at the end
Test copy, proposition and recognisability. Not ‘just’ usability!
Usercheck process› Introduction
› Introductory interview
› Go through scenarios with prototype
› Exit interview
Afterwards: discuss findings and draw conclusions
USER CHECK PARTICIPANT
“My son always helps me with internet things”
USER CHECK PARTICIPANT
“I recently gave my mother a subscription for her birthday”
USER CHECK PARTICIPANT
“I disagree with these procedures”
Usercheck process› Introduction
› Introductory interview
› Go through scenarios with prototype
› Exit interview
Afterwards: discuss findings and draw conclusions
EXAMPLE SCENARIO
“You received the Skipr newsletter today in your email. You want to read one of the articles.”
Usercheck process› Introduction
› Introductory interview
› Go through scenarios with prototype
› Exit interview
Afterwards: discuss findings and draw conclusions
ResultsUsers experience it as ‘restless’, much information and ads
Buildup of news-feed is very good: a fast view on the latest news. No need to go back to the email-newsletter
Autoscrolling to the next article was declared very useful and pleasant
“ Wow, there’s other messages that are relevant, I just saw it. I don’t have to keep switching back to the overview list” (in the newsletter)
DIY usercheck
PARTICIPANT
“I need to fill in a form here, but it would be much easier to have a mobile app”
PARTICIPANT
“I really like the design”
PARTICIPANT
“This is not very helpful for myself, but my daughters would really like this feature”
Let’s get going!Make groups of 5 people + 1 laptop
Any questions? You can always contact [email protected] or call +316 48 933 107