![Page 1: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/1.jpg)
Survey design
![Page 2: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/2.jpg)
What is a survey??
•Asking questions – questionnaires•Finding out things about people•Simple things – lots of people•What things?•What people?
![Page 3: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/3.jpg)
Why do a survey?
•Cheap (!)•Quick (!)•Need data on a ‘population’
![Page 4: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/4.jpg)
Surveys•What people think, feel and do and are.…
▫Self-reported beliefs, knowledge, opinions (questionnaire)
▫What they are like (field tests)•Quantitative methodology
▫numbers / statistics•Cross-sectional (a ‘snapshot’)
▫differences and relationships▫NOT causes
![Page 5: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/5.jpg)
Surveys can be:-
•Self-report questionnaires•Interviewer-administered questionnaires•Field tests
▫e.g. physical, psychological, behavioural
![Page 6: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/6.jpg)
Main requirements of surveys
•Representative sample ▫generalisability (to the population)▫sub-group analyses▫reduce sampling bias
•Meaningful results▫validity of questions, scales, tests▫accurate descriptions, differences and
relationships•High response rate
▫reduce response bias
![Page 7: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/7.jpg)
Surveys
•Find a few people…….•Ask a few questions…….•Get my tutor to do the statistics…..
NO!
![Page 8: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/8.jpg)
So you want to do a survey…?
•PROS▫quick results▫relatively cheap▫can use relatively simple measures▫high levels of statistical power▫can involve simple statistics
![Page 9: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/9.jpg)
So you want to do a survey…?
•CONS▫substantial planning needed▫sampling can get complicated▫time consuming data cleaning / entry▫need large numbers▫cannot identify cause and effect▫can involve complicated statistics▫complicated logistics
![Page 10: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/10.jpg)
Value for money
RigourRight research question(s)Right sizeInternal validityExternal validityReliabilityAppropriate design Competent team
FeasibilityTimePersonnelAccessEthics
Not too bigNot too smallData is NEEDEDCosts are justified
![Page 11: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/11.jpg)
So, let’s design a survey
![Page 12: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/12.jpg)
Survey planning
•State the research questions•Define your population•Define your main dependent variables (DV)•Define your independent variables (IV)•Choose questions, scales, tests and analyses •What will be your sample?•Design sampling methodology•Estimate sample size
![Page 13: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/13.jpg)
Research questions (permissible)
•What is the prevalence of….?•How tall / overweight / active / fit are..?•Is there a difference between….?•What factors are related to….?•What factors predict…?
![Page 14: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/14.jpg)
Research questions (not permissible)•What causes x…..?•What effect does x have…..?
![Page 15: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/15.jpg)
Establish your aimEstablish your research question(s)
![Page 16: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/16.jpg)
Data collection•Use questionnaire / data sheets that make
coding and data collection easy•Use simple questions•For field tests:-
▫Ensure test accuracy▫Calibrate equipment▫Standardise test administration
•Record data systematically and safely
![Page 17: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/17.jpg)
For each research question:What variables must you measure?How will you measure them? Hw will you analyze the data?
![Page 18: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/18.jpg)
Populations
•Do you need ‘population’ data•What is a ‘population’?
▫A group of people▫Carefully defined▫Inclusion / exclusion criteria
•What is your population?
![Page 19: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/19.jpg)
Considerations
•Access to population•Nature of the population (ethical
implications)•Existence of sampling frame
▫Lists, directories, addresses, tel. numbers•Access to sampling frame•Access to sample
![Page 20: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/20.jpg)
Define your population
![Page 21: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/21.jpg)
Sampling........
•A way of representing a large population through the study of a smaller number selected from that population
•Saves time and money ▫ BUT - introduces error
![Page 22: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/22.jpg)
•The sample must REPRESENT the population as closely as possible....…▫E.g. Age, sex, socio-demographic profile,
ethnicity, environment, ▫Need proportionate numbers of all sub-
groups
![Page 23: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/23.jpg)
Sampling
•Type of people?•Number of people?•Number of people within each type?
![Page 24: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/24.jpg)
Individuals
Population country, city, university, school
![Page 25: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/25.jpg)
•Simple random sampling▫Everyone in the target population has an
equal chance of being selected
![Page 26: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/26.jpg)
Population - country, city, university, school
Do you have a SAMPLING FRAME?
StrataagegenderSEP
![Page 27: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/27.jpg)
Population country, city, university, school
Clusterscities,suburbsdepartments,classes
![Page 28: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/28.jpg)
Population country, city, university, school
Clusterscitiessuburbsdepartmentsclasses
StrataagegenderSEP
Gets complicated…!!
![Page 29: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/29.jpg)
Sources of error
•Systematic error (bias)▫e.g. high non-response, interviewer or
instrument variation, incomplete sampling frame
•Response bias▫Subjects giving socially-desirable answers
(lying???!!!)•Random error
▫Because your tests are carried out on a sample, not the whole population
![Page 30: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/30.jpg)
Major tasks•Identify relevant ‘strata’ within the
population▫do they influence the DV?
•Locate the sampling frame•Does it contain strata information? •Calculate proportionate numbers to sample
within each stratum•Select the sample
![Page 31: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/31.jpg)
How will you choose your sample?
![Page 32: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/32.jpg)
How many subjects do I need...??
No. of subjects VARIES with:
No. of sub-groupsLevel of sampling errorVariability of outcome measuresTarget differences / relationshipsStatistical power requiredSignificance level
You need to also consider:
Multiple outcome measuresLogisticsCostUse of results
No. of subjects DOES NOT vary with: Size of population
![Page 33: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/33.jpg)
How many participants will you need?[Or – what is the largest number of participants you can cope with?]
![Page 34: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/34.jpg)
![Page 35: Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?](https://reader037.vdocument.in/reader037/viewer/2022110116/5515e092550346cf6f8b4cd4/html5/thumbnails/35.jpg)
• Response rate▫No. of respondents divided by number asked
to respond• Non-response bias
▫Sample potentially being biased because non-respondents are fundamentally different to respondents
• Non-participation study▫Finding out whether non-respondents ARE
fundamentally different from respondents