Download - Data Consumerism HRU
![Page 1: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/1.jpg)
PEOPLE ANALYT
ICS:
HOW TO BE A
SMART DATA
CONSUMER
NYC 4/22/2016
![Page 2: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/2.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
2
![Page 3: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/3.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
IT’S NOT THAT EASY…
3
![Page 4: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/4.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
MORE REALITY THAN FICTION…
4
![Page 5: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/5.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO VALIDITY OF RESULTSResource: http://horan.asu.edu/cook&
campbell.htm
From the “Bible”:
5
![Page 6: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/6.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
6
INTERNAL VALIDITY?
![Page 7: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/7.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
INTERNAL VALIDITYGiven that there is a relationship, is it plausible there are other explanations for the model?
7
![Page 8: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/8.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO INTERNAL… History (effects may be due to
unforeseen events) Maturation Testing (becoming test savvy) Instrumentation Statistical Regression Selection (self or convenient selection) Mortality
8
![Page 9: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/9.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO INTERNAL… Interactions With Selection Ambiguity About the Direction of Causal
Inference Diffusion or Imitation of Treatments Compensatory Equalization of
Treatments (coffee talk) Compensatory Rivalry by Respondents'
Receiving Less Desirable Treatments Resentful Demoralization of
Respondents Receiving Less Desirable Treatments9
![Page 10: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/10.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
10
EXTERNAL VALIDITY?
![Page 11: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/11.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
EXTERNAL VALIDITYGiven that there’s a causal relationship, how likely is it that the conclusion is generalizable across people, groups, companies, locations, and time?
11
![Page 12: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/12.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO EXTERNAL… Interaction of Selection and Treatment
(participants) Interaction of Setting and Treatment
(places) Interaction of History and Treatment
12
![Page 13: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/13.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
CONSTRUCT VALIDITY?
13
![Page 14: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/14.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
14
CONSTRUCT VALIDITY?
![Page 15: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/15.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
CONSTRUCT VALIDITYDo the relationships in the model actually reflect the meaning of variables?
15
![Page 16: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/16.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO CONSTRUCT… Inadequate Preoperational Explication
of Constructs Mono-Operation Bias (when the boss
asks the questions) Mono-Method Bias Hypothesis Guessing within
Experimental Conditions Evaluation Apprehension
16
![Page 17: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/17.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO CONSTRUCT… Experimenter Expectancies (coaching) Confounding Constructs and Levels of
Constructs Interaction of Different Treatments Interaction of Testing and Treatment
(attention time!) Restricted Generalizability Across
Constructs
17
![Page 18: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/18.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
18
STATISTICAL CONCLUSION VALIDITY?
![Page 19: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/19.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
19
STATISTICAL CONCLUSION VALIDITY?
![Page 20: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/20.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
STATISTICAL CONCLUSION VALIDITYAre we correctly analyzing the data?
20
![Page 21: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/21.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
THREATS TO STATISTICAL… Low Statistical Power Violated Assumptions of Statistical
Tests Fishing and the Error Rate Problem (in
Kansas City…) The Reliability of Measures The Reliability of Treatment
Implementation Random Irrelevancies in the
Experimental Setting Random Heterogeneity of Respondents21
![Page 22: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/22.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
22
![Page 23: Data Consumerism HRU](https://reader036.vdocument.in/reader036/viewer/2022081521/58eed34d1a28ab5d118b4589/html5/thumbnails/23.jpg)
HOW TO BE A SMART DATA CONSUMER4/22/16
STEVE LEVYwww.linkedin.com/in/stevenmlevywww.twitter.com/[email protected]
23