usability testing

12
Usability testing

Upload: ira

Post on 24-Feb-2016

55 views

Category:

Documents


0 download

DESCRIPTION

Usability testing . Usability testing . Goals & questions focus on how well users perform tasks with the product. typical users doing typical tasks. Comparison of products or prototypes common Old version vs. new version Previous system vs. new system Focus is on time to complete task - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Usability testing

Usability testing

Page 2: Usability testing

Usability testing • Goals & questions focus on how well users perform tasks with the

product.– typical users– doing typical tasks.

• Comparison of products or prototypes common– Old version vs. new version– Previous system vs. new system

• Focus is on – time to complete task – number & type of errors

• Data collected by video and interaction logging is used to– calculate performance times– to identify & explain errors

• User satisfaction questionnaires & interviews provide data about users’ opinions.

• Field observations may be used to provide contextual understanding.

Page 3: Usability testing

Project Step 6: Summative Evaluation / Usability Testing

• Review your Requirements Analysis and your Design claims analysis, and generate from that a usability specification containing benchmark tasks and outcomes expected.

• Be sure to include a good variety of benchmark tasks for usability testing, including some easy tasks and some difficult tasks.

• Then, run usability tests on your prototype with at least 3 subjects using the think-aloud protocol.

• Subjects should be from your targeted subject pool if possible.

Page 4: Usability testing

Benchmarks center on the basic usability study measurements:

• Success/Failure within a time threshold• Time on task• # of errors before completion

Page 5: Usability testing

Usability testing vs. researchUsability testing

• Improve products• Few participants• Results inform design• Usually not completely

replicable• Conditions controlled as much

as possible• Procedure planned• Results reported to developers

Experiments for research

• Discover knowledge• Many participants• Results validated

statistically • Must be replicable• Strongly controlled

conditions• Experimental design• Scientific reported to

scientific community

Page 6: Usability testing

Usability lab with observers watching a user & assistant

Page 7: Usability testing

Portable equipment for use in the field

Page 8: Usability testing
Page 9: Usability testing

Some type of data· Time to complete a task.· Time to complete a task after a specified time away

from the product.· Number and type of errors per task.· Number of errors per unit of time.· Number of navigations to online help or manuals.· Number of users making a particular error.· Number of users completing task successfully.

Page 10: Usability testing

Usability engineering orientation

· Aim is improvement with each version.· Current level of performance. · Minimum acceptable level of performance.· Target level of performance.

Page 11: Usability testing

Time testsusability of smart phones

http://www.youtube.com/watch?v=5UUvqsTKkjQ&feature=channel

http://www.youtube.com/watch?v=5Bumpt7Zh7I&feature=channel

Page 12: Usability testing

How many participants is enough for user testing?

• The number is a practical issue.• Depends on:– schedule for testing;– availability of participants;– cost of running tests.

• Typically 5-10 participants. • Some experts argue that testing should

continue until no new insights are gained.