![Page 1: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/1.jpg)
User TestingTips on how to run test sessions and interpret results.
1
Drupal Camp NJ 2018
![Page 2: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/2.jpg)
About Me
2
Tonya Enos Gibson
Web Project Manager
Web Development Services (WDS)Princeton University
Twitter: @tenosLinkedIn: tonyaenosgibson
![Page 3: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/3.jpg)
AgendaWHAT is user testing?WHY should we test?
WHO is testing your product?WHO should facilitating test sessions?
WHEN should you test?How much does testing COST?
Case Study and DemoRunning Test Sessions
Interpreting the Results3
![Page 4: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/4.jpg)
WHAT is user testing?
4
![Page 5: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/5.jpg)
What’s the difference?
5
User Testing
Usability Testing
UX Testing
User Experience Testing
![Page 6: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/6.jpg)
Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users.
Usability testing focuses on measuring a human-made product's capacity to meet its intended purpose.
6
Definition
![Page 7: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/7.jpg)
Products that commonly benefit from usability testing are foods, consumer products, websites or web applications, computer interfaces, documents, and devices.
Usability testing measures the usabilityor ease of use.
7
Examples
![Page 8: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/8.jpg)
WHY should we test?
8
![Page 9: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/9.jpg)
Cost & Time Savings
9
It is easier and quicker to make changes to a prototype….
![Page 10: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/10.jpg)
Cost & Time Savings
10
...than it is to make changes after the building is complete!
![Page 11: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/11.jpg)
Ensure User Needs Are Met
11
How Projects Really Work - http://www.projectcartoon.com
![Page 12: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/12.jpg)
WHO is testing your product?
12
![Page 13: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/13.jpg)
13
Dilbert.com © 2012 Scott Adams, Inc
Thoughts on User Testing
![Page 14: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/14.jpg)
YOU ARE NOT YOUR USER!
14
![Page 15: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/15.jpg)
Target Audience / Test Users
15
● Identify your target audience (i.e. User Personas)
● Recruit representative users
● Ask them to perform tasks on your design/prototype
● Let the users do the talking!
![Page 16: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/16.jpg)
Number of Test Users
16
Credit: Nielson Norman Group: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
80-90% of issues found with only a handful of people.
![Page 17: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/17.jpg)
WHO should facilitate the test sessions?
17
![Page 18: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/18.jpg)
18
“I believe strongly that everyone…can…and should — be doing their own testing”
— Steve Krug, author of “Don’t Make Me Think”
![Page 19: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/19.jpg)
Facilitators
● Professional UX researchers
● Content Strategists
● Designers
● Anyone on the project team
“Anyone can take notes, anyone can listen.”
19
![Page 20: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/20.jpg)
Tips for the Facilitator
Before facilitating your first test:
● Watch an experienced usability expert run a sample session with a pilot user.
During the test:
● Keep quiet and let users do the talking!!!!!● Do not “lead” or guide the users.● Try to avoid answering questions. You can say: “You can do anything
you normally would at home/office.”
20
![Page 21: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/21.jpg)
WHEN should you perform tests?
21
![Page 22: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/22.jpg)
NOW!
22
![Page 23: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/23.jpg)
Frequency
23
● Test Before
● Test During - “Early and Often”
● Test After
![Page 24: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/24.jpg)
24
Lean UX
![Page 25: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/25.jpg)
How much does testing cost?
25
![Page 26: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/26.jpg)
26
Testing Costs: Planned
![Page 27: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/27.jpg)
27
Testing Cost: Reality
![Page 28: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/28.jpg)
1. Usability Lab
2. UserTesting.com
3. Friends & Family
28
Testing Options
![Page 29: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/29.jpg)
A Case Study In User Testing
Princeton University
Office of the Dean of Faculty Website
29
![Page 30: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/30.jpg)
30
Overview
● Overall Project Goals
● Usability Test Approach
● Use of a Prototype
● Findings and Actions Taken
● Results
![Page 31: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/31.jpg)
31
Before
![Page 32: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/32.jpg)
Problems To Solve● Users found it difficult to find
the information.
● Content was not organized in an intuitive manner.
● Navigation was confusing.
● Information was buried.
32
![Page 33: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/33.jpg)
33
Confusing Navigation
![Page 34: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/34.jpg)
34
Role Based vs. Action Based IA
● Information architecture was designed based on “User Role” as opposed to “User Action/Task”.
● Users did not know what group they belonged to therefore found it confusing to find information that was relevant to them.
Original Main Menu
![Page 35: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/35.jpg)
Running Test Sessions
35
![Page 36: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/36.jpg)
36
Usability Test Approach
1. Identified target audience groups
2. Found volunteers from sample test group
3. Developed the scope of the first test session
4. Created a working prototype based on the new architecture
5. Identified key user tasks, created test scenarios
6. Observed the user’s experience executing the tasks
7. Ask testers to talk through their actions and thought process
8. Gathered and analyzed results
![Page 37: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/37.jpg)
37
Target Audience
Primary:
● Department Manager● Department Chair● Faculty Assistant● Internal DOF Staff Member● Faculty Member● Search Officer● Librarian● Postdoctoral Research
Associate
Secondary:
● Prospective Job Applicant● Visiting Faculty Member● Visiting Lecturer● Director for Institutional Equity and
EEO● Former Faculty Member● Former Lecturer● Peer Institution Dean of the Faculty● Higher Education Researcher
![Page 38: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/38.jpg)
Finding Test Volunteers
● Look for a sample set of target audience
● Ask people you know
● Recruit via email blast
● Set up a recruitment table in a high traffic area
● Offer incentive
38
![Page 39: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/39.jpg)
Scope of First Test Session
39
Original Main Menu
Prototype #1: Main Menu
![Page 40: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/40.jpg)
Test Scenarios
40
![Page 41: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/41.jpg)
The Test Lab
41
● Simple
● Seat for tester and seat for facilitator
● Offer the choice of Windows or Mac computer
● Minimize distractions
Example
![Page 42: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/42.jpg)
Prep The User
● Welcome the user
● Ask user to sign-in and self Identify based on list of target audience roles.
● Allow user to choose their OS/web browser preference (if applicable)
● Encourage user to think out loud!
● Inform user of the purpose of the test:
Example: The purpose of these tests are to help us determine how our content should be organized, so we can make our website easier to use.This is not a test of you! You are testing the site. There is no right or wrong answer.
42
![Page 43: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/43.jpg)
Wireframes and mockups by WDS Designer
Joanne Tunney
43
Prototype Demo
![Page 44: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/44.jpg)
You Tested. Now What.
44
![Page 45: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/45.jpg)
Gather Data / Interpret Results
● Collect Data
● Organize Data
● Review
● Prioritize
● Generate Solutions
● Revise Prototypes
● Retest
45
![Page 46: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/46.jpg)
46
Key Findings
19 testers = way too many
80-90% of issues found with only a handful of people
![Page 47: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/47.jpg)
Prototype #2: Menu Design Revised
47
Prototype #1: Menu Design
Prototype #2: Menu Design
We were able to make corrections to our assumptions quickly before getting deep into website development.
![Page 48: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/48.jpg)
48
After dof.princeton.edu
![Page 49: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/49.jpg)
49
Conclusion
● Test before, during and after
● Test early and often
● Use the Lean UX approach: Think, Make, Check
● 80-90% of issues found with only a handful of people.
![Page 50: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/50.jpg)
YOU ARE NOT YOUR USER!
50
![Page 51: User Testing - DrupalCampNJ...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. Usability testing focuses on measuring](https://reader034.vdocument.in/reader034/viewer/2022042914/5f4d5f9786f3570c212b186d/html5/thumbnails/51.jpg)
Questions
51