leanux: is bad research better than no research
DESCRIPTION
(watch the presentation video here: http://leanuxnyc.co/nyc/is-bad-research-better-than-no-research-w-deidre-kolarick/) One of the core principles of Lean UX is to do research often with the entire team’s involvement. Collaboration is essential, but doing effective research is a skill that takes practice and training. More importantly, doing research badly can lead to misleading conclusions, false confidence, and a missed opportunity for insight. In this talk, I’ll discuss how to balance the benefits of getting everyone involved in research with the need for sound methodology when conducting UX research. Deidre Kolarick Deidre is Director of Research & Insights at Catalyst Group in New York City, where she is actively involved in developing new methods for conducting user research. She holds a PhD. in cognitive psychology from Yale University. She is also an adjunct professor of psychology at New York University, a tennis addict, and triathlete.TRANSCRIPT
![Page 1: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/1.jpg)
345 Seventh Avenue 11th Floor New York, NY
Is bad research better than no research? Deidre Kolarick Director of Research & Insights Catalyst Group
January 14, 2014
![Page 2: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/2.jpg)
Lean Research
• Why GOOB is awesome
• Why GOOB is sometimes not that awesome
• The perils of bad research and lean-specific issues
![Page 3: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/3.jpg)
So is bad research better than no research?
![Page 4: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/4.jpg)
1. Don’t test your own designs.
![Page 5: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/5.jpg)
16
The case for someone else doing it
• IRBs and conflicts of interest
(Turner & Spilich, 2006)
Smoking improves cognitive function
![Page 6: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/6.jpg)
16
The case for someone else doing it
• Confirmation bias
• Biases are automatic and unconscious
• The role of emotion • Awareness isn’t enough (Dasgupta, 2009)
![Page 7: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/7.jpg)
17
2. Make a plan - and stick to it.
• Sample size and procedures
• Write out a script • Monitor and share results in real-time
• Review, discuss, rinse, repeat
![Page 8: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/8.jpg)
18
3. Observe and be observed.
• Easier to recognize bias in others
• De-stigmatize bias – talk about it
• Listen to each other and give feedback (and accept it!)
![Page 9: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/9.jpg)
19
4. Treat research as a skill to be developed.
• Study the craft
• Think about the questions you’re asking
• Dunning-Kruger effect
• Consider hiring a pro
![Page 10: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/10.jpg)
Things to watch out for
• Explaining intent / correcting users
• Question types • Do you like it? • What if I changed ________? • Would you…. (share it, come back, etc.)?
• Don’t ask – let them tell you
• If you can – GOOW!
![Page 11: LeanUX: Is Bad Research Better than No Research](https://reader033.vdocument.in/reader033/viewer/2022052906/558cdec9d8b42afb598b4647/html5/thumbnails/11.jpg)
37
Thank you!
Catalyst Group
345 7th Avenue (11th Floor), New York, NY 10001 (212) 243 7777 [email protected] Link to materials used in this workshop