survey & sampling 2014
DESCRIPTION
Research MethodologyTRANSCRIPT
![Page 1: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/1.jpg)
Survey and Sampling
Assistant Professor: Ahmed S. Ishtiaque
ULAB
![Page 2: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/2.jpg)
What is a Survey?
• A systematic method of collecting information from a sample of people from a population about a set of questions for the purposes of describing some attributes of the population
2
![Page 3: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/3.jpg)
Features of a Survey
• Information is collected from a sample of population
• By asking questions using a standardized questionnaire
• Produce statistics (quantitative or numerical description about some aspects of the study population)
• Generalizable to the whole population
3
![Page 4: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/4.jpg)
4
Types of Survey (timeline based)• Cross sectional
– collect information on outcome of interest and population variables
– at one particular time
• Panel/ Cohort – repeated administration of a questionnaire to a
“panel‟ of households/ group of people sharing common experience/ characteristics
– variables are measured on the same units over time– can add extra module to answer a new RQ
![Page 5: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/5.jpg)
5
Types of Survey (content based)
• Descriptive Survey: Description of a population, certain behavior, life style, disease prevalence etc.
• Analytical Survey: Hypothesis driven charaterized by identifying association or linakage between/amongst the variables.
![Page 6: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/6.jpg)
6
1. Establish the goal of the project - What do you want to know
2. Select the sample - Whom will you interview
3. Choose interview methodology - How will you interview
4. Specify variables of interest – What information do you want
5. Create questionnaire (i.e. instrument) - What will you ask
Steps of survey
![Page 7: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/7.jpg)
7
6. Pre-test questionnaire – Are your questions clear, understandable and follow logical patterns
7. Conduct interviews - Ask the questions
8. Data editing and entry – Check for consistency
9. Data analysis – Answer research questions
Steps of survey (contd..)
![Page 8: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/8.jpg)
8
• Think of whether your survey aims at collecting information at the individual or at the household level
• Set up inclusion and exclusion criteria for sample
Sample Determination (Whom will you interview)
![Page 9: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/9.jpg)
9
Choose interview methodology – How will you interview?
Self-administered questionnaire
Face-to-face interviews
Preserves confidentiality – limits risk of providing expected answers
Interferes with confidentiality – higher risk of providing expected answers
Requires extremely simple & well-structured questions
Allows interviewer to work with interviewee on more complex questions
High probability of low response rate/missing values
Probable introduction of bias depending on how questions are phrased
Hybrid interview strategies: Phone, computer-assisted & email
![Page 10: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/10.jpg)
10
» Written Survey
• Oral Survey
– Electronic Survey
![Page 11: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/11.jpg)
11
Choose interview methodology (How will you interview)
Self-administered questionnaire or face-to-face interview?
Choice depends on:• Study question• Study setting
• Structure of questionnaire• Resources available
• Research team preference
![Page 12: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/12.jpg)
12
Specify variables of interest (What information do you want)
• Always write down list of variables of interest before drafting the questionnaire
• Check for balance and coherence between variables
• Develop a question or a set of questions for each variable in the list
![Page 13: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/13.jpg)
13
Specify variables of interest (contd..)(What information do you want )
Variables Questions
Age What is your age?
Profession What is your job?
Marital status What is your marital status?
This strategyalso facilitates
division ofquestionsin sections
![Page 14: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/14.jpg)
Strengths of a Survey
• Useful in describing characteristics of a large population
• Very large samples are feasible, making results statistically significant
• Standardized questions make measurement more precise by enforcing uniform definitions upon the participants.
• High reliability is easy to obtain14
![Page 15: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/15.jpg)
Weaknesses of a Survey
• Not a good method for research on sensitive topics
• Require the initial study design (the tool and administration of the tool) to remain unchanged throughout the data collection.
15
![Page 16: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/16.jpg)
Errors in Survey
16
Characteristics of Population
Sample of population members who
answer questions
Answers respondent give
Issue:How well answers
measure characteristics to
be described?
Issue:How closely sample responding mirrors
population?
Related to:Sampling
Related to:Questionnaire design & administration
![Page 17: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/17.jpg)
Why Sampling? • Often difficult or impossible to study total
population• Studying a part may provide dependable
information• Important to select a part or subgroup of the
population in a way that the information obtained is generalizable to the total population
17
![Page 18: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/18.jpg)
Sampling
18
• This part or subgroup is called sample and the process of selecting the sample is sampling
• Why sample?– Resources (time, money) and workload– Gives results with known accuracy that can be
calculated mathematically
![Page 19: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/19.jpg)
What Sampling?Population
Sample
Using data to say something (make an inference) with confidence, about a whole (population) based
on the study of a only a few (sample).
Sampling Frame
Sampling Process
What you want to talk
about
What you actually
observe in the data
Inference
19
![Page 20: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/20.jpg)
The Sampling Process
Define the Population
Determine the Sampling Frame
Select Sampling Technique(s)
Determine the Sample Size
Execute the Sampling Process
20
![Page 21: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/21.jpg)
Population• Sometimes referred as ‘Universe’
– The entirety. – All the members/elements within a specific
category. – Size and characteristics depend on type of
study
• To define a population – ask yourself: – What am I studying?– To whom or what does my study result apply
to? (related to generalization)21
![Page 22: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/22.jpg)
Sample
Study population: the population that is actually listed in your sampling frame
Sampling frame: listing of study population from which you'll draw your sample
Sample: a part of the whole Sampling: process of selection of the
required number of sampling units from a defined population
22
![Page 23: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/23.jpg)
An example
• What percentage of Women (20-55) in Dhaka Metropolitan city in Bangladesh were diagnosed with uterine cancer in 2000?–Study Population?–Sampling Frame?
23
![Page 24: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/24.jpg)
• Study Population?• Women (20-55) in Metropolitan Dhaka in
2000 who do not have a history of hysterectomy.
• Sampling Frame?• List of all women (20-55) in Metropolitan
Dhaka in 2000 who do not have a history of hysterectomy.
24
![Page 25: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/25.jpg)
Classification of Sampling Techniques
Sampling Techniques
NonprobabilitySampling Techniques
ProbabilitySampling Techniques
ConvenienceSampling
PurposiveSampling
QuotaSampling
SnowballSampling
SystematicSampling
StratifiedSampling
ClusterSampling
Multi-stageSampling
Simple RandomSampling 25
![Page 26: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/26.jpg)
Probability Sampling
• A sampling method that gives each unit in the population a known, non-zero equal chance of being selected is called a probability sampling method
• No unit receives preferences over the other• No units is left out intentionally
26
![Page 27: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/27.jpg)
Type of Probability Sampling
Simple random sampling Systematic sampling Stratified sampling Cluster sampling Multi-stage sampling
27
![Page 28: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/28.jpg)
Simple Random Sampling
Each group member has the same probability of being selected
Example: Selecting balls from a basket Can be done by using sampling frame and
random table Best applicable to homogeneous population Example ?
28
![Page 29: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/29.jpg)
Simple Random Sampling• The most basic sampling design.• If you can make a complete list of your target
population then you can use simple random sampling
• The idea is to assign a number to each of the units in a population and then use a random number generator of some sort to choose the respondents for the analysis.
29
![Page 30: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/30.jpg)
Systematic Sampling An estimate is made of expected total number of
units in the study population Divide this number by required sample size The resulting number is the sampling interval (n) Every nth unit is selected till the total sample size is
drawn
Example ?
30
![Page 31: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/31.jpg)
Stratified Sampling
When a population is heterogeneous Study population is first divided into homogeneous
groups or classes called strata The choice of stratification variables depends on
the variables that matter for responses.
31
![Page 32: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/32.jpg)
Stratified Sampling In most public health research, natural candidates
are race, income, education, gender, location, etc. Simple random sampling is performed in each
strata Allocation of samples among the strata can be
proportional to the size of the strata
32
![Page 33: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/33.jpg)
Stratified Sampling• Proportionate: when sampling units in the
strata are selected proportional to their representation in the source population
• Disproportionate: deliberately increasing the size of sampling units selected from a particular strata so they represent a disproportionate figure in the sample compared to the source population
33
![Page 34: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/34.jpg)
Cluster Sampling Groups of individuals are sampling units rather
than individuals Population is first divided into groups or
clusters A part of these clusters are then selected using
simple random sampling or systematic sampling
Saves money and time
Example ?
34
![Page 35: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/35.jpg)
Multistage Sampling When the total population is large and diverse Sample selection is carried out in several
stages Different sampling units at different stages or
levels Units are selected using simple random
sampling or systematic sampling
Example ?
35
![Page 36: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/36.jpg)
Non-probability Sampling
• The sampling units are selected as convenient to the researcher
• Has a greater chance of giving biased results
• Example ?
36
![Page 37: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/37.jpg)
Non-probability Sampling: types
• Convenience sampling: A convenience sample is simply one where the units that are selected for inclusion in the sample are the easiest to access.
• Purposive sampling: Sampling technique that rely on the judgment of the researcher when it comes to selecting the units that are to be studied.
37
![Page 38: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/38.jpg)
Type of Non-probability Sampling
• Snowball sampling: Snowball sampling is particularly appropriate when the population you are interested in is hidden and/or hard-to-reach.
• Quota sampling: the researcher decides in advance on certain key characteristics which s/he will use to stratify the sample.
38
![Page 39: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/39.jpg)
Selecting a sampling method
• Population to be studied– Size/geographical distribution– Heterogeneity with respect to variable
• Availability of list of sampling units• Level of precision required• Resources available
39
![Page 40: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/40.jpg)
Differences between two types of sampling
40
Probability sampling Non-probability sampling
Always for quantitative research method
Usually for qualitative research method
Sampling units have known probability of being selected
No such thing
Involves statistical analysis Does not involve statistics.
Results can be generalized Results are not intended to be generalized
Sample size calculation is involved
Sample size calculation is not involved
![Page 41: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/41.jpg)
Sampling Error
• Samples may be different from population – Choosing sample frame– Process of selecting sample– Failure to collect answers from everyone
(non-response)
41
![Page 42: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/42.jpg)
An example:Bangladesh Maternal Mortality and Health Care
Survey (BMMS) 20102nd nationally representative survey to:• provide national estimates of the maternal mortality
ratio (MMR) in Bangladesh
• identify causes of maternal deaths among adult women;
• understand antenatal, delivery and post-natal care
Sample Size: around 175,000 households
Sampling method: multi-stage cluster sampling
![Page 43: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/43.jpg)
Used a three stage sampling procedure • First stage: wards in urban and unions in rural
were used as the primary sampling units (PSUs)
• Second stage: selected two mohallas in each ward and two mouzas in each union
• Third stage: Each selected mohalla and mouza was segmented into clusters and one of these was selected from each selected mohalla and mouza
![Page 44: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/44.jpg)
Unions
Segment
Household
Mouzas
Rural Areas
Wards
Segment
Household
Mohallas
Urban Areas
![Page 45: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/45.jpg)
Sample Sizes Selected
Domains Clusters HouseholdsUrban 654 42510
Other Urban 488 31720Rural 1566 101790Total 2708 176020
![Page 46: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/46.jpg)
Response Rates: Households
Urban Rural Total0
25
50
75
100 98.6 98.9 98.898.2 98.6 98.4
2001 2010
![Page 47: Survey & Sampling 2014](https://reader033.vdocument.in/reader033/viewer/2022051519/577c80a71a28abe054a99afa/html5/thumbnails/47.jpg)
Response Rates Women
Urban Rural Total0
25
50
75
100 96.6 97.3 97.296.9 97.7 97.3
2001 2010