what they don't teach you about usability testing (english version)
DESCRIPTION
This presentation is given in 2010 UiGathering Taiwan to share my pratical experience (or tips) on using usaiblity testing method to evaluate mobile devices.TRANSCRIPT
What They Don’t Teach You About Usability Testing
Jen Wang
Usable
Usable
Useful
Usable
Useful
Satisfied
Expert
User
Usability Testing
PlanningRecruiting
Testing
Analyzing
Reporting
ideal vs. reality
ideal vs. reality
Test Settings
Data Log
Source of Users
Task Design
Thinking Aloud
Test Settings
Lab Boardroom
Car Simulation
Does real context impact the testing results?
Kaikkonen,A., Kekäläinen,A., Cankar,M., Kallio,T., and Kankainen, A., Usability Testing of Mobile Applications: A Comparison between Laboratory and Field Testing, Journal of Usability Studies, Issue 1, Volume 1, November 2005, pp. 4-17
Lab Field
Data Log
Machine Memory
When memory low, how to increase the ability taking
notes?
Completion time
Task description
Quick Script
Success criteriaSuccess/Failed
Failed reasons
Quick Script
Path A for completing this task
Path B for completing this task
Quick Script
Food for Increasing Brain Power!
Source of Users
From Agency Friends & Family
10 x 5,000 = 50,000
Per usability testing, in-house recruiting saved NT$50000 than outsourcing at least.
10 x 5,000 x 12 = 600,000
Recruiting users by snowballing is cheaper, but…
In-house recruitment is quite time consuming…
User Database
Task Design
New Feature
Voice Command
New + Main
Voice Command
Call HandlingRouting
x 10 = 10 users
Except for new feature, main features are tested in each usability testing, so that plenty of user data can be collected through several testings.
x 10 x 12 = 120 users
How to determine the main functions for our products?
Nothing changed.
Become another product.
Thinking Aloud
Explanation Demonstration
How to make Taiwan users comfortable with thinking
aloud?
Easy-going Practice (math pratice)
ideal vs. reality
ideal vs. reality
Thank You
