what they don't teach you about usability testing (english version)

What They Don’t Teach You About Usability Testing

Jen Wang 

Usable

Usable

Useful

Usable

Useful

Satisfied

Expert

User

Usability Testing

PlanningRecruiting

Testing

Analyzing

Reporting

ideal vs. reality

ideal vs. reality

Test Settings

Data Log

Source of Users

Task Design

Thinking Aloud

Test Settings

Lab Boardroom

Car Simulation

Does real context impact the testing results?

Kaikkonen,A., Kekäläinen,A., Cankar,M., Kallio,T., and Kankainen, A., Usability Testing of Mobile Applications: A Comparison between Laboratory and Field Testing, Journal of Usability Studies, Issue 1, Volume 1, November 2005, pp. 4-17

Lab Field

Data Log

Machine Memory

When memory low, how to increase the ability taking

notes?

Completion time

Task description

Quick Script

Success criteriaSuccess/Failed

Failed reasons

Quick Script

Path A for completing this task

Path B for completing this task

Quick Script

Food for Increasing Brain Power!

Source of Users

From Agency Friends & Family

10 x 5,000 = 50,000

Per usability testing, in-house recruiting saved NT$50000 than outsourcing at least.

10 x 5,000 x 12 = 600,000

Recruiting users by snowballing is cheaper, but…

In-house recruitment is quite time consuming…

User Database

Task Design

New Feature

Voice Command

New + Main

Voice Command

Call HandlingRouting

x 10 = 10 users

Except for new feature, main features are tested in each usability testing, so that plenty of user data can be collected through several testings.

x 10 x 12 = 120 users

How to determine the main functions for our products?

Nothing changed.

Become another product.

Thinking Aloud

Explanation Demonstration

How to make Taiwan users comfortable with thinking

aloud?

Easy-going Practice (math pratice)

ideal vs. reality

ideal vs. reality

Thank You

Jen.wang.ux@gmail.com