![Page 1: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/1.jpg)
The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research
UX Australia 2016, MelbourneRuth Ellison, Principal User Researcher, PwC’s Experience Centre
![Page 2: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/2.jpg)
@RuthEllison from PwC’s Digital Services
![Page 3: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/3.jpg)
@RuthEllison from PwC’s Digital Services
$7$3 $6.50
![Page 4: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/4.jpg)
@RuthEllison from PwC’s Digital Services
$7$3
![Page 5: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/5.jpg)
@RuthEllison from PwC’s Digital Services
$7$3 $6.50
![Page 6: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/6.jpg)
@RuthEllison from PwC’s Digital Services
![Page 7: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/7.jpg)
@RuthEllison from PwC’s Digital Services
The Decoy Effect is a Cognitive Bias
![Page 8: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/8.jpg)
@RuthEllison from PwC’s Digital Services
What is a cognitive bias?Mental shortcut
![Page 9: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/9.jpg)
@RuthEllison from PwC’s Digital Services
We are all human
![Page 10: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/10.jpg)
@RuthEllison from PwC’s Digital Services Image source: http://www.businessinsider.com.au/what-new-coke-looked-like-in-1985-2013-3
![Page 11: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/11.jpg)
@RuthEllison from PwC’s Digital Services
Applying it to design research
PreparingRunning
Analysing
![Page 12: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/12.jpg)
@RuthEllison from PwC’s Digital Services
Preparing for research
![Page 13: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/13.jpg)
@RuthEllison from PwC’s Digital Services
![Page 14: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/14.jpg)
@RuthEllison from PwC’s Digital Services
Selection bias
![Page 15: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/15.jpg)
@RuthEllison from PwC’s Digital Services 15
![Page 16: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/16.jpg)
@RuthEllison from PwC’s Digital Services
Multiple channels - mix of recruitment companies, social media, trusted networksAvoid professional respondentsCareful screenersBehavioural based recruitment
Dealing with
it….
![Page 17: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/17.jpg)
@RuthEllison from PwC’s Digital Services
Running research sessions
Photo available under a CC by 2.0 licence: https://www.flickr.com/photos/gdsteam/20649386153
![Page 18: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/18.jpg)
@RuthEllison from PwC’s Digital Services
Observer-Expectancy effect
![Page 19: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/19.jpg)
@RuthEllison from PwC’s Digital Services
The way we frame our questions matter
![Page 20: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/20.jpg)
@RuthEllison from PwC’s Digital Services
Loftus, E. F., & Palmer, J. C. Reconstruction of automobile destruction: An example of the interaction between language and memory. Journal of Verbal Learning and Verbal Behavior, 1974, 13, 585-589.
McLeod, S. A. (2014). Loftus and Palmer. Retrieved from www.simplypsychology.org/loftus-palmer.html
About how fast were the cars going when they smashed into
each other?
![Page 21: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/21.jpg)
@RuthEllison from PwC’s Digital Services
About how fast were the cars going when they collided into each other?
About how fast were the cars going when they bumped into each other?
About how fast were the cars going when they contacted into each other?
![Page 22: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/22.jpg)
@RuthEllison from PwC’s Digital Services
Triangulate researchUse observational methodsKeeping positive-neutral body language, watch the tone of your voiceAvoid leading questions
Dealing with
it….
![Page 23: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/23.jpg)
@RuthEllison from PwC’s Digital Services 23
I need a volunteer please
![Page 24: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/24.jpg)
24
248
![Page 25: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/25.jpg)
PwC’s Digital Services
What’s going on?
![Page 26: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/26.jpg)
@RuthEllison from PwC’s Digital Services
Confirmation bias
![Page 27: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/27.jpg)
Take the opposing view
![Page 28: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/28.jpg)
Don’t just confirm your hypothesis, see if you can prove it wrong
Analysis of Competing Hypotheses (ACH)
![Page 29: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/29.jpg)
Use open ended questions
Some people think that soft drinks are bad for you. What do you think?
What’s your opinion about soft drinks?
![Page 30: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/30.jpg)
@RuthEllison from PwC’s Digital Services
List assumptionsBe skeptical, especially if everyone agrees with youRemain open Consider all evidence equallyMultiple user researchersLeave your ego by the door.
Dealing with
it….
@RuthEllison from PwC’s Digital Services
![Page 31: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/31.jpg)
@RuthEllison from PwC’s Digital Services
Groupthink & the Bandwagon effect
![Page 32: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/32.jpg)
@RuthEllison from PwC’s Digital Services 32
https://youtu.be/MDD4IkVZWTM?t=52s
![Page 33: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/33.jpg)
@RuthEllison from PwC’s Digital Services
Triangulate with other research methods (e.g. observational)Use a mixture of individual and group exercisesAvoid stating preferences and expectations at startGive someone the devil’s advocate role to question assumptions
Dealing with
it….
![Page 34: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/34.jpg)
@RuthEllison from PwC’s Digital Services
Anchoring bias
![Page 35: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/35.jpg)
@RuthEllison from PwC’s Digital Services 35
![Page 36: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/36.jpg)
https://www.flickr.com/photos/naotakem/17105160150/
![Page 37: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/37.jpg)
@RuthEllison from PwC’s Digital Services
Consider the order of questions and designs carefullyOpen ended questions Alternate order in which participants are shown concept or design versions
Show version A first1 3 5
2 4 6
Show version B first
Dealing with
it….
![Page 38: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/38.jpg)
@RuthEllison from PwC’s Digital Services
Analysing
![Page 39: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/39.jpg)
@RuthEllison from PwC’s Digital Services 39
![Page 40: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/40.jpg)
@RuthEllison from PwC’s Digital Services 40
Apophenia
Source: https://au.pinterest.com/pin/249738741807276910/
![Page 41: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/41.jpg)
@RuthEllison from PwC’s Digital Services
Clustering illusion & reporting bias
![Page 42: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/42.jpg)
@RuthEllison from PwC’s Digital Services
Breadcrumbs
![Page 43: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/43.jpg)
@RuthEllison from PwC’s Digital Services
Sample sizes – it’s about the WHYConsider evidence equally – not just the ones that confirm your belief/assumptionCollaborative analysis sessionsStrive for objectivity
Dealing with
it….
![Page 44: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/44.jpg)
@RuthEllison from PwC’s Digital Services 44
How vulnerable are you to these biases?
![Page 45: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/45.jpg)
@RuthEllison from PwC’s Digital Services
What percentage of the population will be more biased than the average
person?
![Page 46: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/46.jpg)
@RuthEllison from PwC’s Digital Services
Are you more biased than the average person?
![Page 47: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/47.jpg)
@RuthEllison from PwC’s Digital Services
Blind spot bias
![Page 48: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/48.jpg)
48@RuthEllison from PwC’s Digital Services
Listen with an open mind
Become more rational, but less rationalising
Continuous learning
Always assess your method, your analysis and yourself
for bias
![Page 49: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/49.jpg)
@RuthEllison from PwC’s Digital Services 49
We are all human
![Page 50: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/50.jpg)
@RuthEllison from PwC’s Digital ServicesImage source: https://en.wikipedia.org/wiki/Twenty_Questions#/media/File:20_questions_1954.JPG
![Page 51: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/51.jpg)
Thank you:)
Say hello @RuthEllison
![Page 52: The researcher’s blind spot: 6 cognitive biases we shouldn’t ignore in research](https://reader035.vdocument.in/reader035/viewer/2022070602/5873e9011a28abd72e8b7b1f/html5/thumbnails/52.jpg)
@RuthEllison from PwC’s Digital Services 52
Further reading
List of cognitive biasesYou are not so smart: a celebration of self delusion9 Biases In Usability Testing