post-test feedback mechanisms
DESCRIPTION
Presentation at 14th ErgoDesign conference, Brazil. Reviews my two favorite tools for feedback after usability testing.TRANSCRIPT
Post-test feedback mechanisms
Assessing user experiences in 2 ways
Presented by Carol Barnum, Ph.D.UX Firm, LLC
SUS
PRC
System Usability Scale StronglyDisagree
StronglyAgree
1. I think that I would like to use this website frequently.
2. I found this website unnecessarily complex.
3. I thought this website was easy to use.
4. I think that I would need assistance to be able to use this website.
5. I found the various functions in this website were well integrated.
6. I thought there was too much inconsistency in this website.
7. I would imagine that most people would learn to use this website very quickly.
8. I found this website very cumbersome/awkward to use.
9. I felt very confident using this website.
10. I needed to learn a lot of things before I could get going with this website.
This questionnaire is based on the System Usability Scale (SUS), which was developed by John Brooke while working at Digital Equipment Corporation. © Digital Equipment Corporation, 1986.
Average score
68
International hotel group“green” initiative
Round 1 54
Round 273
SUS scores for 1st and 2nd test
SUS scores for 3rd test
Round 1 54
Round 2 73
Round 3
94!!!!!!
Microsoft creates desirability toolkit
1. Faces Questionnaire
2. Product Reaction Cards
118 Cards
6 Faces
What’s in the cards?
In person Spread them out on table Instruct user to
◦ walk along the table and pick up cards that express the user’s experience◦ Share the meaning of the cards◦ User’s story emerges
In remote testing Provide a Word table or Excel spreadsheet
◦ User highlights selections ◦ Explains choices
In analysis Count the total number of cards selected Collate the results in clusters of similar/same cards Present the results in a word cloud or other visual display
How to use the cards
Magic happens!
Several examples
14
3 TV weather websites
PositiveNegative
PositiveNegative
PositiveNegative
Station AStation B
Station C
0
5
10
15
20
25
30
35
40
26/13 39/5 24/17
Repeated positive card selections focused on ease of use, relevance, and speed
Easy-to-useHelpfulStraightforward
FastRelevantReliableUseful
International “green” initiativeRound 1= SUS = 5242% PRC positive
Round 2= SUS = 7382% PRC positive
Round 3 = SUS = 96100% PRC positive
The 1-2 punch. Use both!
