1

540-310 Human Factors in Information Seeking and Use

Wooseob Jeong

2

Usability Test Assignment (1)

Part I: Select Target Product Decide your target device. Anything can be

your subject: paper manuals, electronic devices, tools, web sites, software, hardware, but the list should not be limited.

Pick one device, and describe what's the thing for: what's the expected function, utility, and advantage? who use it?

200 words – No more than 1 page! Plus, “informed consent form” Due on 3/17 (5%)

3

Usability Test Assignment (2)

Part II: Usability Test & Report Identify any usability problems by testing at

least three subjects, who should be available easily like your room mates or family members.

Before testing, you should carefully develop appropriate tasks. The problems should be addressed in terms of usability perspective, especially time, effort, and error.

Based on your findings, you should suggest any modification for the improvement of usability.

500-1000 words – tables & figures - 15%  Due on 4/7

4

Logical User-Centered Interactive Design Methodology

1. Develop product concept2. Performance research and needs

analysis3. Design concepts and key-screen

prototype4. Do iterative design and refinement5. Implement software6. Provide rollout support

5

Three principles of a user-centered design

1. An early focus on users and tasks.

2. Empirical measurement of product usage.

3. Iterative design whereby a product is designed, modified, and tested repeatedly.

6

User-centered design techniques

Participatory designFocus group researchSurveysDesign (structured) walk-throughPaper-and-pencil evaluationsExpert evaluationsUsability auditUsability testingField studiesFollow-up studies

7

Participatory Design

One or more representative users on the design team itself.Typically used for the development of in-house systems.The representative users can become too close to the design team.

8

Focus Group Research

The very early stages of a project in order to evaluate preliminary concepts using representative users. Simultaneous involvement of more than one participant. To explore a few people’s judgments and feelings in great depth, and in so doing learn how end users think and feel.Structured monitoring

9

Surveys

To understand the preferences of a broad base of users about an existing or potential product.It can use larger samples to generalize to an entire population. Any time in the life cycle, but early stages are better.Languages must be crystal clear and understood in the same way by all readers.

10

Design (structured) walk-throughs

First developed by IBMTo explore how a user might fare with a product by envisioning the user’s route through an early concept or prototype of the product. Guide & monitoring

11

Paper-and-pencil Evaluation

Users are shown an aspect of a product on paper and asked questions about it. Critical information can be collected quickly and inexpensively. Ex) Menu system, table of contents in HELP. Repeated conducts without big expense

12

Expert Evaluation

A review of a product or system, usually by a usability specialist who has no involvement in the project. “Double” specialist (usability and the area) is more effective than a usability expert.

13

Usability Audit/Testing

Usability Audit Comparing the design of a product

against checklists of standards.

Usability Testing Employs an iterative cycle of tests

intended to expose usability deficiencies and gradually shape or mold the product in question.

14

Field Study

Review of a product that has been placed in its natural setting, such as an office or home, just prior to release. Advantage: the exposure of the product to actual working conditionsDisadvantage: the loss of control over the data collection – minimize the effectiveness by “let us know what you think”

15

Follow-up Studies

Conducted after formal release of a productCollect data for the next release, using surveys, interviews, and observations. Unfortunately, rare!

16

Goals of Usability Testing (1)

Of course, to ensure the creation of products that: Are easy to learn and to use Are satisfying to use Provide utility and functionality that

are highly valued by the target population

Specifically, …

17

Goals of Usability Testing (2)

Creating a historical record of usability benchmarks for future releases.Minimizing the cost of service and hotline calls. Increasing sales and the probability of repeat sales.Acquiring a competitive edge since usability has become a market separator for products.Minimizing risk.

18

Five Usability Attributes (1)

Learnability The system should be easy to learn so that the

user can rapidly start getting some work done with the system.

Efficiency The system should be efficient to use, so that

once the user has learned the system, a high level of productivity is possible.

Memorability The system should be easy to remember, so that

the casual user is able to return to the system after some period of not having used it, without having to learn everything all over again.

19

Five Usability Attributes (2)

Errors The system should have a low error rate, so

that users make few errors during the use of the system, and so that if they do make errors they can easily recover from them. Further, catastrophic errors must not occur.

Satisfaction The system should be pleasant to use, so

that users are subjectively satisfied when using it; they like it.

20

Limitations of Usability Testing

Testing is always an artificial situation.Test results do not prove that a product works.Participants are rarely full representative of the target population.Testing is not always the best technique to use.

21

Usability Lab Tours

http://www.sois.uwm.edu/Jeong/540310/usability_tour.htmIn-class demo!Career Development

Rubin, Jeffrey (1994) Handbook of Usability Testing, Wiley. 0-471-59403-2

22

Four Types of Usability Tests

Exploratory Test Preliminary stage; skeleton

Assessment Test Middle stage; most typical; body

Validation Test Late stage; verification, just before release

Comparison Test Different interfaces in the same product;

with competitors’ products

23

Informed Consent Form

Participants should always be treated with respect and should be informed that it is not they who are being tested; rather, it is the software and user interface that are under study. They should be told about what they will be doing and how long they will be expected to stay. Participation should always be voluntary, and informed consent should be obtained.

24

Example of Informed Consent Form

http://www.sois.uwm.edu/jeong/540310/consent.htm“I have freely volunteered to participate in this experiment.”“I have been informed in advance what my task(s) will be and what procedures will be followed.”“I have been given the opportunity to ask questions and have had my questions answered to my satisfaction.”IRB approval waived in classroom.

25

Typical Test Routine

Introduction Make participants comfortable

Pre-questionnaire Background info like age, sex, experience

Main Test Talk Aloud

Post-questionnaire Confirmation of test results

Debriefing Wrap-up conversation

26

Task Component and Description

Task Load paper into the copier.

Machine State Copier with four labels attached and an

empty cassette tray.Successful Completion Criteria Test subject loads paper into cassette after

first fanning the stack of paper.Benchmark Load correctly within one minute.