measurement error. survey record differs from its true value sampling error: arise from the random...
TRANSCRIPT
![Page 1: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/1.jpg)
Measurement Error
![Page 2: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/2.jpg)
Measurement Error Survey record differs from its true value
Sampling error: arise from the random sampling variation when n of units measured instead of N units.
Measurement error
(Systematic error, nonsampling error)
re Me
eY
![Page 3: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/3.jpg)
Not decrease with the overall sample size. Decrease with the repeated measurement. Possible sources of measurement error in
survey data Interviewer Coder
![Page 4: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/4.jpg)
Simplified Model
0)( MeE2)( MMeVar
0)( reE2)( rreVar
MMr eZeeY
iYny
1 )( yE
)()( 122 ppQ MrY
)()( 1 ppQ rZ
Normal Dist’n
![Page 5: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/5.jpg)
Effect In presence of measurement error with mean
zero, the estimator of mean and total remain unbiased or consistent.
For more complex parameters, the nice feature may not hold.
Fuller (1995) points out that the usual estimators for dist’n func., quantiles, regression coef. are biased.
![Page 6: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/6.jpg)
Assuming non-zero constant measurement error mean, the usual estimators of mean, total, proportion are also biased.
Furthermore, assuming correlated errors between individuals with the same interviewer, the usual estimator of standard errors are also biased.
![Page 7: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/7.jpg)
If estimates of the measurement error variances are available, it is possible to obtain bias-adjusted estimators.
Repeated measurement of sub-samples Allocate resources at design stage to make repeated
observations on a sub-sample. Hartley and Rao (1978) and Hartley and Biemer (1978)
provided interview and coder assignment conditions that permit the estimation of sampling and measurement error.
Measurement error variance model.
![Page 8: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/8.jpg)
Interviewer Effect Earliest examination of measurement error in the
survey focuses on evaluating the impact of interviewers on the data.
There is correlation among measured values collected by the same interviewer.
Hansen, Hurwitz and Bershad model shows
])1(1[)(
)( yij m
n
yVaryVar
![Page 9: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/9.jpg)
ANOVA model can be specified to estimate interviewer variability.
Model is appropriate for continuous responses.
For binary response, the result underestimate the intra-interview variability.
![Page 10: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/10.jpg)
References Full, W.A. Estimation in the presence of measurement
error. Scott, A. and Davis, P.. Estimating interviewer effects
fro survey responses. Hartley, H.O. and Biemer, P.. The estimation of
nonsampling variances in current surveys. Hartley, H.O. and Rao, J.N.K. The estimation of
nonsampling variance components in sample surveys. Measurement errors in surveys. Paul Biermer, et al.
![Page 11: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/11.jpg)
Binary Data and Interviewer EffectsAn Example
![Page 12: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/12.jpg)
Medical Questionnaires Often use binary variables Interested in proportion parameters Very specialized studies
Few reviewers (highly skilled) Very expensive to train Large case loads
Interviewer variability is usually ignored because it affects binary data less than continuous data
![Page 13: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/13.jpg)
New Zealand Quality of Health Care Study Studying ‘adverse events’ in New Zealand hospitals 2-stage design
PPS sample of hospitals Systematic sample of 575 medical records drawn from
each hospital for 1998 admissions Average case load per reviewer is 300 (problem!) Typical of such studies Interest in proportion of hospital admissions
associated with an adverse event
![Page 14: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/14.jpg)
Model
iprpiipr ebaY
Random Effects Model
Hospital Effect Interviewer Effect Respondent Effect Assume an underlying continuous variable initially
and then extend to the binary case
iapb
ipre
![Page 15: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/15.jpg)
Assumptions : Normally Distributed : Normally Distributed : Logisticly Distributed All these effects are assumed to be
uncorrelated with all other effects
iapb
ipre
![Page 16: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/16.jpg)
Design Effect Represents the inflation in variance due to the
interviewer and cluster effects (i.e. inflation when there are not independent observations)
This is assuming small interviewer and PSU effects
CCI mnD )1()1(1~
1
~
1
![Page 17: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/17.jpg)
Results = 0.04 = 0.002 = 687 Design Effect = 29.0 So the variability is increased by a
multiplicative factor of 29!
IC
~
n
![Page 18: Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead](https://reader035.vdocument.in/reader035/viewer/2022081007/56649e2b5503460f94b1a08a/html5/thumbnails/18.jpg)
Conclusions With high case loads, even small interviewer
variability can have high impact on estimates of population means and proportions
Binary data poses special challenges and more research needs to be done when the PSU and interviewer correlations are not small