whoa! did you see that? collaborative data collection and analysis

Collaborative Data Collection And Analysis

#UXPABOS15@KyleSoucy

UsableInterface.com

Whoa !Did you see that?

you don’t own the data

The team does

what’s at Risk?

Incomplete Data

Rashomon effect: Contradictory interpretations of the same event by different people.

Not everyone can attend every session

Image source: http://www.kramerelectronics.com/images/news/sap_labsimage1.jpg

1. Share Observations

2. Prioritize issues

observer debrief Goals

benefits

No massive generalizations

Immediate insights list

Usability  Tes,ng  

Report

Note taking

give assignments

"Usability testing is like getting a drink from a fire hydrant…" - Carolyn Snyder

observation, inference,

and opinion

Observation

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

"The participant typed, ‘science fiction’

in the search box.”

Inference

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

"The participant doesn’t like to use

the navigation.”

Opinion

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

"The navigation is not noticeable.”

Ways to Take NotesEveryo

ne should

use the same tool

&/or method.

Notes Grid

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Why? Because this doesn’t work...

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

And neither does this...

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Theme Analysis grid

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Or, rainbow spreadsheet

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: http://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/

Pick List

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

sticky notes

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Live Shared

Note Taking

debriefing

when to debrief?

After every 3-6 sessions.

Don’t wait ‘til the end.

Prepare

Ways to debrief

round-robin or lead + additions

It’s not just about the findings...

implications matter

Wish for, how to, what if

H2 make these box entry areas clearer; H2 make it obvious they’re exclusive; Wif we only allowed one way to search for repair info?

Observation: The user didn’t realize they were notlogged in and couldn’t access documents they wanted.

Implications:

- “W4 a way the user can access documents without logging in.”

- “H2 make the log in link more visible.”

- “Wif we didn’t force the user to log in?”

Example

Blue sky thinking

“If we can really understand the problem, the answer will come out of it, because the answer is not separate from the problem.”

- Jiddu Krishnamurti

Affinity Diagraming

Affinity Diagraming

1. Put observations on post-its

2. Put post-its on the wall

3. Group similar items

4. Name each group

5. Vote on most important groups

Image source: http://www.dailymail.co.uk/femail/article-2344654/Carrie-Bradshaw-jealous-Man-uses-8-000-Post-notes-spring-surprise-wedding-proposal-girlfriend.html

“There is a good way to break up with someone, and it doesn’t involve a post-it!” - Carrie Bradshaw

observe

Kyle Soucy

So... can you believe that last person couldn’t find the ‘submit’ link.

Informal Discussion

key to complete

data collection and analysis...

Collaboration

Learn more...Book:

Paper Prototypingby Carolyn Snyder

Yes, really.

There’s an

amazing chapt

er

on analysis

!

Articles:

Making it easy to collect the data you want to collecthttp://usabilitytestinghowto.blogspot.com/2008/07/making-it-easy-to-collect-data-you-want.html

by Dana Chisnell

Making sense of the data: Collaborative data analysishttp://usabilitytestinghowto.blogspot.com/2010/04/making-sense-of-data-collaborative-data.html

by Dana Chisnell

Engaging Study Observers: An Overlooked Step in User Researchhttp://uxpamagazine.org/engaging-study-observers/

by Stephanie R. Fishel-Brown, Emily J. Schroeder

A Collaborative Lean UX Research Toolhttp://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/

by Tomer Sharon

The Road To Recommendationhttp://www.uie.com/articles/recommendation/

by Jared Spool

www.usableinterface.com

@kylesoucy

Thank you.

/usableinterface