1

540-310 Human Factors in Information Seeking and Use

Wooseob Jeong

2

Notice

Midterm Exam on April 7th. Question Pool is available at

http://www.sois.uwm.edu/jeong/540310/midterm.htm

Only 10%

Usability Test I & II = 20%Read Nielson’s book.

3

Usability Test Assignment

Part II: Usability Test & Report Identify any usability problems by testing at

least three subjects, who should be available easily like your room mates or family members.

Before testing, you should carefully develop appropriate tasks. The problems should be addressed in terms of usability perspective, especially time, effort, and error.

Based on your findings, you should suggest any modification for the improvement of usability.

500-1000 words – tables & figures - 15%  Due on 4/17

4

Goals of Usability Testing (1)

Of course, to ensure the creation of products that: Are easy to learn and to use Are satisfying to use Provide utility and functionality that

are highly valued by the target population

Specifically, …

5

Goals of Usability Testing (2)

Creating a historical record of usability benchmarks for future releases.Minimizing the cost of service and hotline calls. Increasing sales and the probability of repeat sales.Acquiring a competitive edge since usability has become a market separator for products.Minimizing risk.

6

Limitations of Usability Testing

Testing is always an artificial situation.Test results do not prove that a product works.Participants are rarely full representative of the target population.Testing is not always the best technique to use.

7

Four Types of Usability Tests

Exploratory Test Preliminary stage; skeleton

Assessment Test Middle stage; most typical; body

Validation Test Late stage; verification, just before release

Comparison Test Different interfaces in the same product;

with competitors’ products

8

Task Component and Description

Task Load paper into the copier.

Machine State Copier with four labels attached and an

empty cassette tray.Successful Completion Criteria Test subject loads paper into cassette after

first fanning the stack of paper.Benchmark Load correctly within one minute.

9

Task Development Exercise

Tasks should be simple and specified. Required Machine State should be comprehensive to avoid unexpected problems. Successful Completion Criteria should be clear and specified. Benchmark should be estimated reasonably.Pilot test is required!

10

Useful Links for Usability Testing

List of Usability Evaluation Methods and TechniquesDesigning for Usability Using Paper PrototypesThe Usability Methods ToolboxUsability FirstUsability Is Good BusinessUsability Professionals' Association

11

Typical Test Routine

Introduction Make participants comfortable

Pre-questionnaire Background info like age, sex, experience

Main Test Talk Aloud

Post-questionnaire Confirmation of test results

Debriefing Wrap-up conversation

12

Different Testing Roles

Test monitor/administratorData loggerTimersVideo recording operatorProduct/technical expertsAdditional testing rolesTest observers

13

Role of the test monitor

During the test, the monitor is responsible for all aspects of administration including greeting the participant, collecting data, assisting and probing, and debriefing the participant. After the test, he or she needs to collate the day’s data collection, meet with and debrief other team members, and ensure that the testing is tracking with the test objectives.Demo video! http://www.sois.uwm.edu/jeong/540310/

video_monitorinteraction_highres.ram

14

Good test monitorGrounding in the basics of usability engineeringQuick learnerInstant rapport with participantsExcellent memoryGood listenerComfortable with ambiguityFlexibilityLong attention spanEmpathic “people person”“Big picture” thinkerGood communicatorGood organizer and coordinator

15

Typical Test Monitor Problems

Leading rather than enablingToo involved with the act of data collectionActing too knowledgeableToo rigid with the test planNot relating well to each participantJumping to conclusions

16

Handling frustrationGive up vs. Keep trying?Getting valuable information from frustration by letting them keep trying.How? - Empathize with the participant (smile!) “I can sense you’re getting frustrated, but

this is a particularly crucial part of the software/ documentation, would you please try a little bit longer?”

“I see you’re having a difficult time with this. This isn’t the first time that I’ve seen someone experience some difficulty here. Would you please continue on for five more minutes?”

17

Improve test monitoring skill

Learn the basic principles of human factor ergonomicsLearn from watching othersWatch yourself on tapeWork with a mentorPractice monitoringLearn to meditatePractice “bare attention”