chapter 14: usability testing and field studies question 1 right – how to observe the real effects...
TRANSCRIPT
![Page 1: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/1.jpg)
Chapter 14: Usability testing and field
studies
Question 1
Right – How to observe the real effects of your fishing equipment on the fish! From http://www.alistapart.com/articles/usability-testing-demystified/.
![Page 2: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/2.jpg)
Usability Testing
• Emphasizes the property of being usable• Key Components
– User Pre-Test– User Test– User Satisfaction Questionnaire
• User Action is recorded
Question 2
![Page 3: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/3.jpg)
Some type of data Time to complete a task. Number and type of errors per task. Number of errors per unit of time. Number of navigations to online help or manuals. Number of users making a particular error. Number of users completing task successfully.
Question 3
![Page 4: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/4.jpg)
Qualitative Data
• Likert Scale: A typical question using a Likert Scale might pose a statement and ask the respondent whether they Strongly Agree - Agree - Undecided - Disagree or Strongly Disagree.
• Example:We have a lot of work to do in 371
Strongly Agree - Agree - Undecided - Disagree or Strongly Disagree.
Question 4
![Page 5: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/5.jpg)
Testing conditions• Usability lab or other controlled space.• Emphasis on:
– selecting representative users;– developing representative tasks.
• Tasks usually last no more than 30 minutes.• The test conditions should be the same for every participant.• Informed consent form explains procedures and deals with ethical
issues.
![Page 6: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/6.jpg)
How many participants is enough for user testing?
• The number is a practical issue.• Depends on:
– schedule for testing;– availability of participants;– cost of running tests.
• Typically 5-10 participants. • Some experts argue that testing should continue until no new
insights are gained.
![Page 7: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/7.jpg)
Usability lab with observers watching a user & assistant
![Page 8: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/8.jpg)
Portable equipment for use in the field
![Page 9: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/9.jpg)
![Page 10: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/10.jpg)
How do we do this?
• Goals and Questions• Select the Participants
– Age– Gender– Computer Expertise– Domain Expertise
• Develop Tasks• Develop Pre/Post Test Questionnaires• Develop a test procedure
– Greet, Explain, Exploration task, Direct behavior
• Test [Think Aloud Protocol]• Post Test Debriefing
Question 5
![Page 11: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/11.jpg)
MedlinePlus.com
![Page 12: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/12.jpg)
Experiments & usability testing
• Experiments test hypotheses to discover new knowledge by investigating the relationship between two or more things – i.e., variables.
– Null Hypothesis– Alternate Hypothesis
![Page 13: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/13.jpg)
Experiments• Predict the relationship between two or more variables.• Independent variable is manipulated by the researcher.• Dependent variable depends on the independent variable.• Typical experimental designs have one or two independent
variables.
Question 6
![Page 14: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/14.jpg)
Experimental designs• Different participants - single group of participants is allocated
randomly to the experimental conditions.• Same participants - all participants appear in both conditions.• Matched participants - participants are matched in pairs, e.g.,
based on expertise, gender, etc.
![Page 15: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/15.jpg)
Different, same, matched participant design
![Page 16: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/16.jpg)
How do you conclude?
• Use statistical tests like t-Tests that compare the difference between the conditions to reveal if they are significant.
![Page 17: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/17.jpg)
Field studies• Field studies are done in natural settings.• The aim is to understand what users do naturally and how
technology impacts them.• Field studies can be used in product design to:
- identify opportunities for new technology;- determine design requirements; - decide how best to introduce new technology;- evaluate technology in use.
![Page 18: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/18.jpg)
Data collection & analysis
• Observation & interviews– Notes, pictures, recordings– Video– Logging
• Analyzes– Narrative– Categories can be provided by theory
• Grounded theory• Activity theory
![Page 19: Chapter 14: Usability testing and field studies Question 1 Right – How to observe the real effects of your fishing equipment on the fish! From](https://reader031.vdocument.in/reader031/viewer/2022032710/56649e0c5503460f94af48d4/html5/thumbnails/19.jpg)
Question 7