lecture 8: quasi-experiments aims & objectives –to differentiate between true and...
TRANSCRIPT
![Page 1: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/1.jpg)
Lecture 8: Quasi-experiments
• Aims & Objectives
– To differentiate between true and quasi-experiments
– To discuss the nature of random allocation
– To examine threats to experimental validity
– To examine some basic quasi-experimental designs
![Page 2: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/2.jpg)
Type of general approaches to design
• Descriptive• What, where, when and to whom
• Relational• Co-variaton
• Experimental• Causal analysis via random allocation
• Quasi-experimental• Causal statements when groups are not equivalent – no
random allocation
![Page 3: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/3.jpg)
Random allocation
• Every potential subject has an equal chance of being in any condition
• Simple randomisation
• Block randomisation– Blocks A&B, produce sequences e.g., AABB, ABAB.
Sequences are selected at random and subjects selected at random into that block
• Stratified randomisation– Select on a characteristic that influences the groups and have
block randomisation lists within those blocks
![Page 4: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/4.jpg)
Internal validity: I
• Ruling out a third cause– Randomisation controls for
• History effects• Maturation effects• Mortality• Statistical regression to the mean
– Randomisation does not control for• Effects equalising groups
– Diffusion of treatment effects– Compensatory rivalry– Compensatory equalisation
• Effect separating groups– Resentful demoralisation
![Page 5: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/5.jpg)
Statistical validity
• Risk of making a type 1 error
– Power– Fishing– Reliability of measures, treatments– Random irrelevance– Random heterogeneity of respondents
![Page 6: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/6.jpg)
External validity:generalisation
• Is the effect stable
– Over time– Across individuals– Across IVs & DVs– Across places
![Page 7: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/7.jpg)
Mook
• Research is not always about generalizability of findings
• Conceptualisation of generalizability are base don an agricultural model
• Experiments are about generalizability of theory not findings
![Page 8: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/8.jpg)
Construct validity
• Experimenter effects
– Structural• Mono-operation bias• Mono-method bias• Poor explication of constructs
– Interpersonal• Demand characteristics• Apprehension evaluation• Rosenthal effect
![Page 9: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/9.jpg)
Quasi-experiments
Nomenclature
X = a treatment
O = Observation
… = Not randomly assigned
![Page 10: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/10.jpg)
Uninterrupted designs
O X O
One group pre- post test design
Threats = history, maturation regression
![Page 11: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/11.jpg)
Non-equivalent groups
O X O…………O O
Untreated control group with pre and post test
![Page 12: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/12.jpg)
Reverse treatments
O X+ O…………….O x- O
![Page 13: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/13.jpg)
ITSDs
OOOOXOOOO………………..OOOO OOOO
OO OOOXOOOOOXOOO OOO
With switch replication
![Page 14: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/14.jpg)
ARIMA
OOOXOOO333 456 Upward drift334 444 Upward constant335 466 Gradual upwards333 333 No change
![Page 15: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/15.jpg)
Regression discontinuityDepression
Short LongPoverty
![Page 16: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/16.jpg)
Randomized field trials
• Randomisation by independent group
• Make seek treatment elsewhere– Within condition effects
• Placebo-control
![Page 17: Lecture 8: Quasi-experiments Aims & Objectives –To differentiate between true and quasi-experiments –To discuss the nature of random allocation –To examine](https://reader036.vdocument.in/reader036/viewer/2022081907/5515d01b550346cf6f8b45ba/html5/thumbnails/17.jpg)
Experiments: the last word
• Experiments are important because they allow us to show what can or ought to happen
– Bio feedback– Milgram– Sherrif’s boys camp study