3.the future of ux research and how to stop it...why the future of ux research is automated quick to...
TRANSCRIPT
![Page 1: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/1.jpg)
![Page 2: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/2.jpg)
![Page 3: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/3.jpg)
![Page 4: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/4.jpg)
The traditional role of user researcher was killed off by new technologies like usability test automation, remote data collection and machine learning. These days, we have minute-by-minute breakdowns of aggregate user behaviour that we can splice and dice in anyway we want. Want to see what tech-averse millennials in the South West of England are up to? Click this button. Ethnographic research—and researchers—became marginalised by new forms of automated data and insight generation, compiled via remote sensing and delivered to designers through technologies like virtual reality. To go out on a field visit these days I sit at my desk and slip on my 3-D headset.
![Page 5: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/5.jpg)
Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated research
![Page 6: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/6.jpg)
2003 Motorola i95cl
![Page 7: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/7.jpg)
Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated researchSurveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability testing
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability 2003
![Page 8: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/8.jpg)
Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated researchSurveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability 2003
![Page 9: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/9.jpg)
2003 2019
![Page 10: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/10.jpg)
Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated researchSurveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability testing
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability 2003
![Page 11: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/11.jpg)
2019Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated researchSurveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability testing
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability
Eye tracking
Moderated remote usability studies
Clickstream analysis
A/B testing 5-second tests
![Page 12: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/12.jpg)
2019Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated research
Surveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability testing
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability
Eye tracking
Moderated remote usability studies
Clickstream analysis
A/B testing 5-second tests
![Page 13: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/13.jpg)
Why the future of UX Research is automated
Quick to set up
Cheap to commission
Generates skinny data
Don’t have to speak with users
Easy to recruit
![Page 14: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/14.jpg)
Automated research blocks
your view
![Page 15: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/15.jpg)
Behaviour
Design
![Page 16: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/16.jpg)
Behaviour
Design
![Page 17: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/17.jpg)
![Page 18: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/18.jpg)
Report date: 20th Sept 2006. Test date: 11th-15th Sept 2006.
+ Several quick search options are provided Sample size: 17
+ Landing pages are clear and usable 59% Male, 41% Female
+ Homepage search provides helpful quick links 47% 18-35, 47% 36+
+ Breadcrumbs show user journey Mobile providers
- List of phone features is limited
- Accessory purchase is very problematic T-Mobile
- Users don't notice the price change on 12-month contracts Vodafone
- Users do not see the “order now” call to action O2
Desirability
Detailed TCR Detailed SOU
Speed of use (SOU)
Detailed Desirability
Private and Confidential • For more details about the data in this report, contact David Travis • [email protected] • Design © Userfocus 2006
Web site is equal to best competitor
TCR: Competitors SOU: Competitors Desirability: Competitors
StatusStrengths & Weaknesses Demographics
Competitor benchmarks
29%
Web Usability Dashboard This report compares the usability of vodafone.co.uk with three competitors
Margin of error: ±8.9%
Task completion (TCR)
64.1% 54.4% 61.4%Overall Benchmark
60.9%
PAYM
Orange
Buy a 3G phone, 12-month contract and Bluetooth headset
Buy the cheapest PAYG phone with internet and MP3
24%
24%
24%
PAYG
59%
69%
0% 25% 50% 75% 100%
PAY
MPA
YG
52%
40%
59%61%
0%
25%
50%
75%
100%
Voda Or O2 T-M
64%54%
65%
43%
0%
25%
50%
75%
100%
Voda Or O2 T-M
54%
40%
54%
39%
0%
25%
50%
75%
100%
Voda Or O2 T-M
61%
73%
40%
26%
0%
25%
50%
75%
100%
Voda Or O2 T-M
81%
39%
0% 25% 50% 75% 100%
PAY
MPA
YG
0%
25%
50%
75%
100%
Q1 Q10
Report date: 20th Sept 2006. Test date: 11th-15th Sept 2006.
+ Several quick search options are provided Sample size: 17
+ Landing pages are clear and usable 59% Male, 41% Female
+ Homepage search provides helpful quick links 47% 18-35, 47% 36+
+ Breadcrumbs show user journey Mobile providers
- List of phone features is limited
- Accessory purchase is very problematic T-Mobile
- Users don't notice the price change on 12-month contracts Vodafone
- Users do not see the “order now” call to action O2
Desirability
Detailed TCR Detailed SOU
Speed of use (SOU)
Detailed Desirability
Private and Confidential • For more details about the data in this report, contact David Travis • [email protected] • Design © Userfocus 2006
Web site is equal to best competitor
TCR: Competitors SOU: Competitors Desirability: Competitors
StatusStrengths & Weaknesses Demographics
Competitor benchmarks
29%
Web Usability Dashboard This report compares the usability of vodafone.co.uk with three competitors
Margin of error: ±8.9%
Task completion (TCR)
64.1% 54.4% 61.4%Overall Benchmark
60.9%
PAYM
Orange
Buy a 3G phone, 12-month contract and Bluetooth headset
Buy the cheapest PAYG phone with internet and MP3
24%
24%
24%
PAYG
59%
69%
0% 25% 50% 75% 100%
PAY
MPA
YG
52%
40%
59%61%
0%
25%
50%
75%
100%
Voda Or O2 T-M
64%54%
65%
43%
0%
25%
50%
75%
100%
Voda Or O2 T-M
54%
40%
54%
39%
0%
25%
50%
75%
100%
Voda Or O2 T-M
61%
73%
40%
26%
0%
25%
50%
75%
100%
Voda Or O2 T-M
81%
39%
0% 25% 50% 75% 100%
PAY
MPA
YG
0%
25%
50%
75%
100%
Q1 Q10
![Page 19: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/19.jpg)
— Paul Brodeur
“Statistics are human beings with the tears wiped away.”
![Page 20: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/20.jpg)
Formative usability testing
Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated research
Surveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability testing
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability
Eye tracking
Moderated remote usability studies
Clickstream analysis
A/B testing 5-second tests
These research methods drive
empathy
![Page 21: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/21.jpg)
Formative usability testing
Fat data
Skinny data
Res
earc
h m
edia
ted
by a
UX
rese
arch
erAutom
ated research
Surveys
Diary studies
Card sorting
Telephone interviews
Web analytics
Formative usability testing
Ethnographic field
Face-to-face interviews Pop-up research
Summative usability
Eye tracking
Moderated remote usability studies
Clickstream analysis
A/B testing 5-second testsAutomated
research methods do not drive
empathy
![Page 22: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/22.jpg)
Good quality UX research is not about: - Collecting numbers- Statistical significance- Sample sizeGood quality UX research is research that provides actionable and testable insights into users’ needs.
![Page 23: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/23.jpg)
![Page 24: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/24.jpg)
![Page 25: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/25.jpg)
![Page 26: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/26.jpg)
The local maxima problem in UX research
Metrics-Driven Design SXSWThe grass is always greener on other mountainsides.
Imagine that your design is a mountain...
Saturday, March 12, 2011
Image credit: https://www.slideshare.net/andrew_null/metrics-driven-design-by-joshua-porter
Design 1
Design 1 - Optimised
Design 2 - Unexplored
Small difference
Big difference
![Page 27: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/27.jpg)
A successful design process doesn’t start with Build.
It starts with Learn.
![Page 28: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/28.jpg)
![Page 29: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/29.jpg)
The pleasures of cystoscopy
Me
A sensitive part of my anatomy
![Page 30: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/30.jpg)
— Response scale from 0 - 10
“How likely is it that you would recommend the Urology Department of this hospital to a friend or colleague?”
![Page 31: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/31.jpg)
You are not the user.
![Page 32: 3.The Future of UX Research and How to Stop it...Why the future of UX Research is automated Quick to set up Cheap to commission Generates skinny data Don’t have to speak with users](https://reader035.vdocument.in/reader035/viewer/2022062402/5ede2d49ad6a402d66697aed/html5/thumbnails/32.jpg)
In summary Unless you take action, UX research will become increasingly automated.Automated research blocks your team’s view of the user.Encourage your development team to triangulate automated research with methods that create empathy.