Download - An Introduction to Usability Testing
![Page 1: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/1.jpg)
An Introduction to Usability Testing.
Lennart Overkamp February 6th, 2017
University of Twente.
![Page 2: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/2.jpg)
Three Phases: 1. Preparation 2. Moderation 3. Analysis
![Page 3: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/3.jpg)
Phase #1: Preparation.
![Page 4: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/4.jpg)
“ ”
The primary goal of the usability test is to improve the usability
of the product that is being used.
Source: A Practical Guide to Usability Testing (Dumash & Redish, 1999)
Step #1.1: Define the goal.
![Page 5: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/5.jpg)
![Page 6: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/6.jpg)
Step #1.2: Define the users.
Users = ?
All customers
![Page 7: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/7.jpg)
Step #1.2: Define the users.
Users = frequent business flyers
All customers
![Page 8: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/8.jpg)
Step #1.2: Define the users.
Users = frequent business flyers (the population)
All customers
![Page 9: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/9.jpg)
Step #1.3: Recruit users.
Users = frequent business flyers (the population)
All customers
Participants (the sample)
![Page 10: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/10.jpg)
Step #1.4: Define the measures.
Performance measures (e.g. time-on-task,
errors)
Preference measures (e.g. desirability,
perceived usability)
![Page 11: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/11.jpg)
Step #1.5: Prepare the procedure.
Which materials?
How?
When?
Where?
How long?
With whom?
![Page 12: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/12.jpg)
![Page 13: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/13.jpg)
Step #1.6: Prepare the script.Scenario (example): Imagine that you have to travel for your job from Amsterdam to New York on Monday the 9th of January. You will need to stay there for a full workweek, but you want to be back before Saturday to enjoy your weekend with family.
Tasks (examples):
1. Find out which round trips are available from Amsterdam to New York that fit your work schedule for this week. 2. Book the cheapest flight that you can find.
![Page 14: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/14.jpg)
Step #1.7: Prepare the prototype.(If you have one)
Example: https://invis.io/9PAACX46R
![Page 15: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/15.jpg)
Step #1.8: Prepare the consent form.
![Page 16: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/16.jpg)
EVALUATION FLIGHT-BOOKING TOOL Goal The goal of this evaluation is to test the usability of a flight-booking tool prototype, in order to improve this tool in terms of user-friendliness. Procedure You will carry out tasks with the prototype, which will be provided by the facilitator. While carrying out the tasks, you are asked to think aloud. After completing the tasks, you will fill in a short questionnaire and the facilitator will ask you some questions. The evaluation will take around 45 minutes. You may stop, take a break, or ask questions at any moment. Recording To facilitate the analysis of the test results, we ask for your permission to record the evaluation. The recording will only be used by the design team to improve the prototype, and will not be shared with anyone outside the team. Participation does not have any risks or consequences for you. • Your answers and details will be processed anonymously. • We judge the quality of the prototype, not your performances. Informed consent By signing this form, you acknowledge to have read and understood the information in this document, and to agree with this information. Name: Date: Signature:
Do you agree with recording? ☐ Yes, video- and sound recording. ☐ Yes, only sound recording. ☐ No, rather not.
Step #1.8: Prepare the consent form.Contents: • Goal • Procedure • Duration • Participant’s rights
![Page 17: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/17.jpg)
EVALUATION FLIGHT-BOOKING TOOL Goal The goal of this evaluation is to test the usability of a flight-booking tool prototype, in order to improve this tool in terms of user-friendliness. Procedure You will carry out tasks with the prototype, which will be provided by the facilitator. While carrying out the tasks, you are asked to think aloud. After completing the tasks, you will fill in a short questionnaire and the facilitator will ask you some questions. The evaluation will take around 45 minutes. You may stop, take a break, or ask questions at any moment. Recording To facilitate the analysis of the test results, we ask for your permission to record the evaluation. The recording will only be used by the design team to improve the prototype, and will not be shared with anyone outside the team. Participation does not have any risks or consequences for you. • Your answers and details will be processed anonymously. • We judge the quality of the prototype, not your performances. Informed consent By signing this form, you acknowledge to have read and understood the information in this document, and to agree with this information. Name: Date: Signature:
Do you agree with recording? ☐ Yes, video- and sound recording. ☐ Yes, only sound recording. ☐ No, rather not.
Step #1.8: Prepare the consent form.Contents: • Recording explanation • Consequences • Signature • Recording consent
![Page 18: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/18.jpg)
Step #1.9: Test your test.
![Page 19: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/19.jpg)
Phase #2: Moderation.
![Page 20: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/20.jpg)
Step #2.1: Welcome your participant.Coffee?
![Page 21: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/21.jpg)
Step #2.2: Introduce the test.Introduce yourself.
Explain your role.
Explain what is expected of the participant.
Mention the duration of the test.
Provide reassurance: you are not testing the participant.
Explain the purpose of the test.
![Page 22: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/22.jpg)
Step #2.3: Obtain informed consent.Sign two copies!
![Page 23: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/23.jpg)
Step #2.4: Explain the think-aloud protocol.
“ ”
In a thinking aloud test, you ask test participants to use the system while continuously thinking out loud — that is, simply verbalizing their thoughts
as they move through the user interface.
Source: Jakob Nielsen (www.nngroup.com)
![Page 24: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/24.jpg)
Step #2.4: Explain the think-aloud protocol.
Example: https://www.youtube.com/watch?v=g34tOmyKaMM
![Page 25: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/25.jpg)
Step #2.5: Start recording.
![Page 26: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/26.jpg)
![Page 27: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/27.jpg)
![Page 28: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/28.jpg)
![Page 29: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/29.jpg)
Step #2.6: Participant performs tasks.Explain the scenarios & tasks.
Let the participant do the talking!
Remind participant to think aloud, when necessary.
Keep questions and distractions to a minimum.
When a scenario/task is finished, explain the next one.
![Page 30: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/30.jpg)
Step #2.7: Post-questionnaire.(Optional, depending on goal/measures)
Example #2: Microsoft Reaction
Card Method
Measures product desirability.
Example #1: System Usability
Scale (SUS)
Measures perceived usability.
![Page 31: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/31.jpg)
Step #2.8: Post-interview.Ask for a general summary.
Elaborate on interesting observations/comments.
Ask any remaining questions you prepared beforehand.
![Page 32: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/32.jpg)
Step #2.9: Debriefing.Explain (again) the purpose of the test.
Answer any remaining questions from the participant.
Explain (again) what you will do with the results.
Give the participant a reward!
![Page 33: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/33.jpg)
Phase #3: Analysis.
![Page 34: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/34.jpg)
Quantitative data (SUS scores, errors, Reaction Cards, time-on-task)
Qualitative data (comments,
explanations, responses)
Step #3.1: Process your data.
![Page 35: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/35.jpg)
Step #3.2: Prioritise the usability problems.Problem #1
Problem #2
Problem #3
Problem #4
Problem #5
![Page 36: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/36.jpg)
Step #3.3: Communicate your results.
Type #2: Presentation slides
Summarised, easily shared or presented
Type #1: Full report
Detailed, useful as a reference.
Type #3: Infographic
Highly visual, useful as a persuasion tool
![Page 37: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/37.jpg)
![Page 38: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/38.jpg)
#Conclusion.Advantages:
Solid, well-researched Tests many aspects of product
Both qualitative & quantitative
Disadvantages: Costly in terms of time, money
and (human) resources
![Page 39: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/39.jpg)
Recommended resources - Books
![Page 40: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/40.jpg)
Recommended resources - Online
smashingmagazine.com
nngroup.com
![Page 41: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/41.jpg)
Recommended resources - Prototyping & Testing
InVisionSketch
![Page 42: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/42.jpg)
Recommended resources - Analysing
ExcelRStudio
![Page 43: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/43.jpg)
Recommended resources - Communicating results
SketchKeynoteWord
![Page 44: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/44.jpg)
Neuro Usability Test.Bonus:
![Page 45: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/45.jpg)
![Page 46: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/46.jpg)
Aspect #1: Eye Tracking
Reference of users’ focus. Input for heatmaps.
Aspect #2: EEG
Captures brain activity to pinpoint affects.
Aspect #3: Neuro Feedback
Users comment on significant EEG findings.
Aspect #4: Questionnaire
Users are interviewed and fill in a questionnaire.
![Page 47: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/47.jpg)
How does Psychology fit in all this?
![Page 48: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/48.jpg)
Knowledge.Cognitive Psychology: knowledge of attention, working memory limits, etc.
Social Psychology: knowledge of group dynamics, persuasion, etc.
![Page 49: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/49.jpg)
Methods & Skills.Research skills, both quantitative & qualitative.
Analytical approach to problems.
Observation techniques.
Running experiments.
Developing questionnaires, interviews & experiments.
Interview techniques.
![Page 50: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/50.jpg)
Soft skills.Giving feedback.
Asking the right questions.
Active, empathic listening.
![Page 51: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/51.jpg)
Psychology is invaluable to any design team.
![Page 52: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/52.jpg)
Thank you.
![Page 53: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/53.jpg)
Lennart Overkamp Rémon van den BerghInteraction Designer
[email protected] Insights & Sr. UX Researcher
![Page 54: An Introduction to Usability Testing](https://reader034.vdocument.in/reader034/viewer/2022042722/58a3e3471a28ab7f0b8b65f3/html5/thumbnails/54.jpg)