to go further: intra- versus interindividual variability
TRANSCRIPT
![Page 1: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/1.jpg)
To go further: intra- versus interindividual variability
![Page 2: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/2.jpg)
2
Up to now: irrespective of models
• Multilevel data– Definition– Diagram
• Simple effects and contrasts• Correction for the number of tests• RM Anova versus mixed linear models
– Advantages– Disadvantages– Conclusion: when to use one or the other
• Interpretation of parameters, regression equation, and drawing an expected mean graph
• Conditions of applications• Mediation, confounding and moderation
![Page 3: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/3.jpg)
3
Up to now: specific for models
• Specific to RM ANOVA– Equality of covariance and sphericity (and
corrections when sphericity not met)• Specific to multilevel models– Fixed versus random effects– Selection of random effects in mixed linear models
![Page 4: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/4.jpg)
4
Definition: multilevel data
• Data can be non-independent for various reasons:– Clustered in groups (children in classes)– Several measures from same individual – Conditions while taking the measures (e.g., half of
them taken in the morning, half in the afternoon)
![Page 5: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/5.jpg)
5
Graphically: 2 levels
![Page 6: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/6.jpg)
6
When is an effect not estimable
• When there is only one observation for a combination of cells…
• Why?• Because the effect is indistinguishable from
residual/individual variability
![Page 7: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/7.jpg)
7
Contrasts
• Allow to test specific patterns in group effects• But…• They can be significant when the data do not
fit your hypothesized pattern– Some data get ignored
• They encourage researchers to “fish” (and you will finally get something)– Be careful what you wish for because you may get it
![Page 8: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/8.jpg)
8
Advantages of RM ANOVA
• Global test over all levels of categorical variables
• Unbiased (especially important for small sample sizes)
• Well-accepted in psychology
![Page 9: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/9.jpg)
9
Disadvantages of RM ANOVA
• Number of observations by cell have to be equal (even one missing data means all observations for this subject are useless)
• Number of cells have to be equal (for subjects)• Compound symmetry or sphericity
assumption (is it substantially credible?)
![Page 10: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/10.jpg)
10
When to use multilevel models
• When you have missing data• When by design you expect a different
number of observations per level 2 unit (e.g., follow-up of individuals)
• When you want to include a continuous level-1 variable
• When random intercept or random slope is of substantive interest
![Page 11: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/11.jpg)
Conditions of applications
• RM ANOVA and multilevel modeling have 2 conditions of application in common:– Normality of the DV by cell of the IV• Few outliers
– Homoscedasticity (equality of variance)
– (Linearity: trivial in ANOVA since we only estimate mean differences)
![Page 12: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/12.jpg)
12
Confounding
X
Y
X
Y
3 levels of Z
X and Y are associated within each level of Z
3 levels of Z
X and Y are not associated within each level of Z
![Page 13: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/13.jpg)
13
Mediation: a special case of confounding
IV C DV Mediation
IV DV Confounding
C
IV A C Confounding 2
DV
![Page 14: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/14.jpg)
14
Mediation: Baron and Kenny 1986
1. There must be a significant relationship between the independent variable and the dependent variable,
2. There must be a significant relationship between the independent variable and the mediating variable, and
3. The mediator must be a significant predictor of the outcome variable in an equation including both the mediator and the independent variable.
4. 4. The mediator must be caused by the IV and causing the DV
MacKinnon, D. P., Krull, J. L., Lockwood, C. M. (2000). Equivalence of the mediation, confounding and suppression effect. Prevention Science. 1(4). 173-181.
![Page 15: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/15.jpg)
15
Moderation and interaction
• A variable moderates another when the association between the IV and the DV is different for one level of the moderator variable than for another level.
• Example: the effect of antibiotics on response time is very small for people not drinking alcohol but is large for people drinking alcohol (alcohol is the moderator variable)
• “The difference in response time due to antibiotics differs across alcohol level”– 2 different in the sentence
![Page 16: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/16.jpg)
16
How to proceed
• Look at interaction plots• Estimate the interaction effect• If significant:– Estimate simple effects (relationship between IV
and DV for a specific level of a third (moderator) variable)
![Page 17: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/17.jpg)
17
RM ANOVA: condition of application
• If compound symmetry is met, OK• If not, then test sphericity (e is an estimate of
sphericity, range 0-1 with 1 = sphericity met)• If sphericity not OK, – you could do a MANOVA (i.e., treat each condition as
a DV and look at all the DVs together)– You could correct for sphericity (this in fact corrects
the df). Best practice:• e>.75, use Huynh-Feldt correction• e<.75, use Greenhouse-Geisser correction
![Page 18: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/18.jpg)
18
How to determine whether an IV is fixed or random
• Are the level of the IV chosen in a planned manner?
• Or were they randomly selected among other possible instances?
![Page 19: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/19.jpg)
19
Comparing model
• Likelihood ratio test, if estimation is done with maximum likelihood (ML)…
• But ML produces biased estimates.– 2(Log(L1)-log(L0)) follows a Chi-square(p1-p2)
that is only asymptotically true, p value is overestimated
• AIC/BIC and other information criteria– No absolute meaning– Can only be used to compare models: relative fit: The
lower the value, the better the model
![Page 20: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/20.jpg)
20
Interindividual variability
• Autists who have more stereotypy have less quality of life
• In other words, the variability in stereotypy between 2 different individuals (interindividual variability) has an impact on quality of life
![Page 21: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/21.jpg)
![Page 22: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/22.jpg)
22
Intraindividual variability
• An autist who increases in stereotypy will have a lower quality of life
• In other words, the variability in stereotypy within an individual (intraindividual variability) has an impact on quality of life
![Page 23: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/23.jpg)
![Page 24: To go further: intra- versus interindividual variability](https://reader036.vdocument.in/reader036/viewer/2022070306/551632d7550346b2068b4d5f/html5/thumbnails/24.jpg)