Download - Guerrilla tactics in usability testing
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla tactics in usability testing When time and money are against you
@thedxw www.dxw.com @lily_dart @rosebotanic
dxw is an agency specialising in agile, user-focused digital services for the public sector.
We like making users happy.
@thedxw www.dxw.com @lily_dart @rosebotanic
the art of pouncing on lone people in cafes and public spaces, [then] quickly filming them whilst they use a website for a couple of minutes”
“@MartinBelam
@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
→ If users can understand the purpose of the site
@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
→ If users can understand the purpose of the site
→ If users can navigate to the content they want
@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
→ If users can understand the purpose of the site
→ If users can navigate to the content they want
→ If users understand the language you’re using
@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
→ If users can understand the purpose of the site
→ If users can navigate to the content they want
→ If users understand the language you’re using
→ If users are satisfied with what they find
@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla considerations
Consider:
→ Environment
→ Incentives
@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla considerations
Consider:
→ Environment
→ Incentives
→ Understanding who you’re speaking to
@thedxw www.dxw.com @lily_dart @rosebotanic
Today
We will cover:
→ How to prepare a session
→ Practice running a session
→ Analyse findings
More info: http://bit.ly/dxw-guerrilla-survival-guide
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Groups
→ Break into groups
→ Introduce yourself
→ Select a product owner
→ Working on, or familiar with a website or service
→ Find a device to test the website on
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Decide what to test
→ Product owner has 1 minute to explain the service:
→ Who is using the service?
→ Why are they using the service?
→ What does the service allow them to do?
→ Pick one thing that is high priority on that service, either:
→ A piece of content
→ Or, a transaction
→ Fill in the story sheet
@thedxw www.dxw.com @lily_dart @rosebotanic
Scenarios
We prefer scenarios over tasks:
→ To give participants context
@thedxw www.dxw.com @lily_dart @rosebotanic
Scenarios
We prefer scenarios over tasks:
→ To give participants context
→ To allow for more natural behaviour
@thedxw www.dxw.com @lily_dart @rosebotanic
Scenarios
We prefer scenarios over tasks:
→ To give participants context
→ To allow for more natural behaviour
→ To avoid pattern matching
@thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are about to sign the employment contract.
The contract says that you only get 5 days of paid holiday per year. You aren’t sure if, legally, that’s enough. Where do you go to check?
Example scenario
@thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are about to sign the employment contract.
The contract says that you only get 5 days of paid holiday per year. You aren’t sure if, legally, that’s enough. Where do you go to check?
Example scenario
@thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are about to sign the employment contract.
The contract says that you only get 5 days of paid holiday per year. You aren’t sure if, legally, that’s enough. Where do you go to check?
Example scenario
@thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are about to sign the employment contract.
The contract says that you only get 5 days of paid holiday per year. You aren’t sure if, legally, that’s enough. Where do you go to check?
Example scenario
@thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are about to sign the employment contract.
The contract says that you only get 5 days of paid holiday per year. You aren’t sure if, legally, that’s enough. Where do you go to check?
Example scenario
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Scenario
Write a scenario:
→ Look back at your story sheet
→ Think about what circumstance might create that need
→ Write a scenario for your participants, considering:
→ How much detail is needed
→ How relatable the situation is
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Break
5 minutes
@thedxw www.dxw.com @lily_dart @rosebotanic
Recording findings
Focus on insights, over conclusions:
→ Participant quotes
@thedxw www.dxw.com @lily_dart @rosebotanic
Recording findings
Focus on insights, over conclusions:
→ Participant quotes
→ Participant actions
@thedxw www.dxw.com @lily_dart @rosebotanic
Recording findings
Focus on insights, over conclusions:
→ Participant quotes
→ Participant actions
→ Positive findings as well as negative ones
@thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
@thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
→ Ask participants to speak their thoughts aloud
@thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
→ Ask participants to speak their thoughts aloud
→ Use non-leading prompts if they go quiet
@thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
→ Ask participants to speak their thoughts aloud
→ Use non-leading prompts if they go quiet
→ Let participants come to their own conclusions
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Testing the website
Test your session out:
→ Product owner will move to the next group
→ Lead researcher runs guerrilla usability session
→ Other researchers write insights on post-it notes:
→ Participant quotes
→ Participant actions
@thedxw www.dxw.com @lily_dart @rosebotanic
Analysing findings
Create findings out of insights:
→ Focus on understanding user needs and behaviour
@thedxw www.dxw.com @lily_dart @rosebotanic
Analysing findings
Create findings out of insights:
→ Focus on understanding user needs and behaviour
→ Avoid designing solutions
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Analyse
Analyse your findings with your group:
→ Discuss your post-it notes
→ Group similar quotes and actions together
→ Agree 3 findings to discuss
@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Your findings
@thedxw www.dxw.com @lily_dart @rosebotanic
Today
We practised:
→ How to prepare a script using scenarios
→ How to interview participants without leading them
→ How to collect and analyse findings collaboratively
@thedxw www.dxw.com @lily_dart @rosebotanic
Next steps
Learn more about:
→ Environment
→ Incentives
→ Screening participants
→ Interview technique
More info at http://bit.ly/dxw-guerrilla-survival-guide