pur – general topics & research methods filetechnique used to explain variability among...
TRANSCRIPT
![Page 1: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/1.jpg)
PUR – General Topics & Research Methods 3rd lecture
![Page 2: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/2.jpg)
PUR - 2
(2)
Big Picture
Practice
User research
User Research Project
User
Studies Facilitation
General Topics
Methods of data
collection I
Personas
Lecture
Methods of data
collection II
Current Trends
2 3 4 5 6 7
Selected topics - mostly cognitive psychology
![Page 3: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/3.jpg)
General Topics Finalisation
Sampling Research Biases Research Ethics Statistics Then we will finally start collect data!
PUR - 3
![Page 4: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/4.jpg)
PUR - 2
Sampling
Credit: bestchoiceuniform.com
![Page 5: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/5.jpg)
PUR - 2
Research Sample
Population – sampling frame - sampling – sample Issue of data generalization 2 parameters Size (diversity of users) Representativeness (validity)
![Page 6: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/6.jpg)
PUR - 2
Sampling Strategies
Random Simple (lot) Systematic
Non-random Quota – screening process, screener Snow ball Self–selection
![Page 7: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/7.jpg)
PUR - 2
Screener Questionnaire – An Example
1. Experienced in Java For how many years have you been developing in Java?
(Target: >3 years) Do you currently develop in Java?
(Target: Yes) 2. User of NetBeans / other IDEs What IDE do you primarily use? Target: 4 NetBeans users / 2 Eclipse users / 2 IDEA users
![Page 8: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/8.jpg)
PUR - 2
Sampling Bias
Difference in distribution of surveyed variables between population and sample
Certain subgroups or views overrepresented or shortchanged
Screening candidates Non-responder bias Timing bias Invitation bias
![Page 9: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/9.jpg)
PUR - 2
Timing Bias - An Example From E-Comm
![Page 10: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/10.jpg)
PUR - 2
Biases
! Highly important to consider them when interpreting data !
Researcher bias Respondents' expectations External influences (even social) Duration bias Instrument bias Hawthorn effect vs. Double blind
![Page 11: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/11.jpg)
PUR - 2
Sample Size
Assumed normal distribution, confidence 95% Population Sample
1 000 150 10 000 300 100 000 800
![Page 12: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/12.jpg)
PUR - 2
Controlled Experimental Design
Independent variable
Dependent variable
Experimental group
X ?
Control group
- ?
![Page 13: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/13.jpg)
PUR - 2
Ethical Issues in Data Collection
Briefing Contract Debriefing Principles: Non-maleficency (no harm done to the participant) Beneficience (participants' benefit) Personal data protection / privacy
![Page 14: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/14.jpg)
PUR - 2
Statistics
Descriptive Frequency of occurence Central tendency – mean, median, mode Measures of dispersion – standard variation, range Shape of distribution - skew, kurtosis (truncation)
Inferential Hypothesis testing (Fischer test, Wilcoxon test, t-test, chi square test) Data correlation
Credits: videolife.tk
![Page 15: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/15.jpg)
PUR - 2
Statistics
Meta analysis Combination of quantitative results of several studies that address a set of related hypotheses
Factor analysis Technique used to explain variability among observed variables in terms of fewer unobserved variables called factors
![Page 16: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/16.jpg)
PUR - 3
Elementary Methods of Data Collection
Observation Interview Survey Content analysis Experiment
![Page 17: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/17.jpg)
PUR - 3
What Methods Will Be Covered Today?
Observation Ethnographic research Interview Usability testing Focus group Survey
![Page 18: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/18.jpg)
PUR - 3
Observation
Introspection (including Cognitive walkthrough) Extrospection
Credit: Chris D Rea
![Page 19: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/19.jpg)
PUR - 3
Ethnographic Research Customer visit, Contextual inquiry Monitoring day-to-day activities using observation and interviews or diaries Holistic (complex, elements, mutual relations)
Credits: uni-mainz.de
![Page 20: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/20.jpg)
PUR - 3
Common Settings
Home Work Educational Mobile and Ubiquitos systems Virtual Ethnography (Diary studies)
Credits: reelingreviews.com
![Page 21: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/21.jpg)
PUR - 3
Ethnographic Research
Requires 'long-term' stay in the field Flexible strategy Recording (notes, sketches, photos, audio and video recordings, company artifacts)
Credits: yale.edu
![Page 22: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/22.jpg)
PUR - 3
Ethnographic Research
Ethnocentrism – using own values for evaluating other groups
![Page 23: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/23.jpg)
PUR - 3
Interview
Structured Semi-structured Free Cannot be used for hypothesis testing!
![Page 24: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/24.jpg)
PUR - 3
Interview - Evaluation
Advantages High response rate Allows researcher to ask follow-up questions No self-selection Disadvantages No anonymity Bias of interviewer's presence Expensive
![Page 25: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/25.jpg)
PUR - 3
Interview Principles
Goal, maintain rapport, integrate knowledge gained during the interview Anonymity Length of interview (30 – 90 minutes)
![Page 26: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/26.jpg)
PUR - 3
Interview Principles
Behavioral approach - concentrate on immediate experience, not extrapolations
Credit: templates.com
![Page 27: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/27.jpg)
PUR - 3
Interview Principles
!Restate, but do not interpret! Stay non-judgmental! Never say the participant is wrong Be aware of your own expectations
![Page 28: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/28.jpg)
PUR - 3
Interview Principles
Words are not the only source of information
Credits: aolaswers.com
![Page 29: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/29.jpg)
Keep Questions Open-Ended
I keep six honest serving-men (They taught me all I knew); Their names are What and Why and When And How and Where and Who. Rudyard Kipling, Just So Stories, 1902
PUR - 3
![Page 30: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/30.jpg)
PUR - 3
Interview Questions
Do not force opinions No leading questions Avoid binary questions Focus on stories and emo Be curious!
![Page 31: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/31.jpg)
PUR - 3
Interview Questions
Projective questions “people's attitude” Technique of unfinished sentences Metaphors
Credits: stavangerphotobytanty.blogspot.com layoutparks.com
![Page 32: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/32.jpg)
PUR - 3
What Is Wrong?
Which of these 3 pictures do you like most? Is this the best car in its class? Is everyday autoupdate important for you? Will you use this product next year? This is cool, right? Do you find it cool too? Will people buy it?
![Page 33: PUR – General Topics & Research Methods fileTechnique used to explain variability among observed variables in terms of fewer unobserved variables called factors . PUR - 3 Elementary](https://reader030.vdocument.in/reader030/viewer/2022020319/5e05023f1ec8ef40131b75ec/html5/thumbnails/33.jpg)
PUR - 3
(33)
Wanna learn more?
Mike Kuniavsky: Observing The User Experience Lazar et al.: Research Methods in Human-Computer
Interaction http://www.userfocus.co.uk/articles/going-beyond-the-obvious.html
http://www.producttalk.org/2016/03/customer-interview-questions/
https://medium.com/@InVisionApp/dont-design-what-users-want-827d9ce9223d#.awesy0ftj
http://userfocus.co.uk/articles/ethnography.html
https://feedbackguru.com/articles/why-i-prefer-expert-reviews-over-usability-testing/
https://www.uxmatters.com/mt/archives/2018/09/the-role-of-observation-in-user-research.php
https://medium.com/designing-atlassian/three-tips-for-great-research-conversations-ecd08dcc0632