oecd jevin west - | paris21 west - calling... · underutilized portfolio opportunities.” “...
TRANSCRIPT
![Page 1: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/1.jpg)
Jevin D. West and Carl T. BergstromUniversity of Washington
http://callingbullshit.org@callin_bull
Truth in Numbers, April 4, 2018
![Page 2: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/2.jpg)
we are drowning in bullshit
CC-BY 2.0 Azlan Dupree
![Page 3: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/3.jpg)
New School Bullshit
Old School Bullshit
![Page 4: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/4.jpg)
“Our collective mission is to refunctionalizecustomer-driven solutions for leveraging underutilized portfolio opportunities.”
New School Bullshit
![Page 5: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/5.jpg)
“Our collective mission is to refunctionalizecustomer-driven solutions for leveraging underutilized portfolio opportunities.”
“While short of statistical significance after Bonferroni correction (p=0.13), our results underscore a clinically important effect size (relative odds of survival at 5 years=1.2) that challenges the current therapeutic paradigm.”
![Page 6: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/6.jpg)
![Page 7: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/7.jpg)
Numbers appear to carry authority.
![Page 8: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/8.jpg)
This is why 37% of PARiS2! talks include made-up statistics
![Page 9: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/9.jpg)
Words are human constructs.
Numbers seem to come directly from nature
![Page 10: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/10.jpg)
Words appear fuzzy
"You think the countries are giving us their best people? No….They give us their worst people..."
![Page 11: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/11.jpg)
Words appear fuzzy
Numbers appear crisp.
"You think the countries are giving us their best people? No….They give us their worst people..."
![Page 12: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/12.jpg)
Numbers should be presented in context.
That means they have to allow us to make comparisons.
![Page 13: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/13.jpg)
This is 0.3% of DACA recipients!
Compare 8.6% Americans with a felony conviction.
![Page 14: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/14.jpg)
Price drops from 19,200 to 12,600.
Bitcoin loses 34% of its value in 13 days, or...
…Bitcoin was overpriced by 52% on Dec 12th.
![Page 15: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/15.jpg)
![Page 16: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/16.jpg)
Seat belts "only" drop annual risk of injury from about 2% to 1%.
Should we avoid those too?
![Page 17: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/17.jpg)
We are not teaching our students to question numbers.
![Page 18: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/18.jpg)
![Page 19: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/19.jpg)
![Page 20: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/20.jpg)
![Page 21: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/21.jpg)
http://callingbullshit.org
![Page 22: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/22.jpg)
1. Introduction to bullshit
2. Spotting bullshit
3. Causality
4. Statistical traps and trickery
5. Data Visualization
6. Big Data bullshit
7. Publication bias
8. Predatory publishing and scientific misconduct
9. Natural ecology of fake new and other bullshit
10. Refuting bullshit
![Page 23: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/23.jpg)
![Page 24: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/24.jpg)
![Page 25: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/25.jpg)
Tips for spotting quantitative bullshit1. Question the source
2. Consider the different ways numbers can be presented
3. Watch out for graphic manipulation
4. Don’t be intimidated by the black box
5. If a claim seems too good to be true...
6. Avoid confirmation bias.
7. Beware of unfair comparisons.
8. Think in orders of magnitude.
![Page 26: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/26.jpg)
1. Who is telling me this?
2. How do they know it?
3. What’s in it for them?
![Page 27: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/27.jpg)
“The rich, in short, aren't nearly
rich enough to finance Mr.
Obama's entitlement state
ambitions—even before his health-
care plan kicks in.
So who else is there to tax? Well, in
2008, there was about $5.65 trillion
in total taxable income from all
individual taxpayers, and most of
that came from middle income
earners. The nearby chart shows
the distribution, and the big hump
in the center is where Democrats
are inevitably headed for the same
reason that Willie Sutton robbed
banks.”
-The Wall Street Journal
April 17, 2011
![Page 28: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/28.jpg)
Bins differ widely in size!
![Page 29: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/29.jpg)
Ken Schultz via Brendan Nyhan
The Wall Street Journal
![Page 30: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/30.jpg)
Simplistic data graphics only
The New York Times (1920)
The New York Times (1920)Albert Stevens (1920) Cyclopedia of Fraternities
![Page 31: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/31.jpg)
![Page 32: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/32.jpg)
![Page 33: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/33.jpg)
![Page 34: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/34.jpg)
![Page 35: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/35.jpg)
![Page 36: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/36.jpg)
Tatem et al. (2004) Nature
![Page 37: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/37.jpg)
Method: Reductio ad absurdum
Show that an argument’s methods or assumptions lead to ridiculous conclusions.
![Page 38: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/38.jpg)
Sir — A. J. Tatem and colleagues calculate that women may out-sprint men by the middle of the twenty-second century (Nature 431,525; 2004). They omit to mention, however, that (according to their analysis) a far more interesting race should occur in about 2636, when times of less than zero seconds will be recorded.
In the intervening 600 years, the authors may wish to address the obvious challenges raised for both time-keeping and the teaching of basic statistics.”
— Kenneth Rice
“
Kenneth Rice (2004) Nature
![Page 39: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/39.jpg)
![Page 40: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/40.jpg)
Philip Bump, Washington Post
![Page 41: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/41.jpg)
Bloomberg’s Business Week
![Page 42: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/42.jpg)
Via http://blog.heapanalytics.com/how-to-lie-with-data-visualization/
![Page 43: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/43.jpg)
Tips for spotting quantitative bullshit1. Question the source
2. Consider the different ways numbers can be presented
3. Watch out for graphic manipulation
4. Don’t be intimidated by the black box
5. If a claim seems too good to be true...
6. Avoid confirmation bias.
7. Beware of unfair comparisons.
8. Think in orders of magnitude.
![Page 44: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/44.jpg)
Algorithm
?DataDataData
Output
Even when you don’t know how an algorithm or statistical test works, you can spot bullshit by looking carefully at what goes in and what comes out.
Interpretation
![Page 45: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/45.jpg)
![Page 46: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/46.jpg)
Cesare LombrosoCriminal Man (1876)
![Page 47: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/47.jpg)
out
![Page 48: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/48.jpg)
“Unlike a human examiner/judge, a computer vision algorithm or classifier has absolutely no subjective baggages [sic], having no emotions, no biases whatsoever due to past experience, race, religion, political doctrine, gender, age, etc., no mental fatigue, no preconditioning of a bad sleep or meal. The automated inference on criminality eliminates the variable of meta-accuracy (the competence of the human judge/examiner) all together.”
—Wu & Zhang(2017)
![Page 49: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/49.jpg)
Criminals have smaller angle θ, larger curvature ρ than non-criminals.
![Page 50: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/50.jpg)
![Page 51: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/51.jpg)
Criminal and non-criminal “subtypes”
Criminal
Non-criminal
![Page 52: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/52.jpg)
![Page 53: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/53.jpg)
Algorithm
?DataDataData
Output
Even when you don’t know how an algorithm or statistical test works, you can spot bullshit by looking carefully at what goes in and what comes out.
Interpretation
![Page 54: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/54.jpg)
Big Data (n)
The idea that a sufficiently large pile of horseshit will, with probability one, somewhere contain a pony.
![Page 55: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/55.jpg)
If a claim seems too good (or too bad) to be true, it probably is.
![Page 56: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/56.jpg)
OMG!!!Gonnamake mygirl quither metalband!1!!
![Page 57: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/57.jpg)
“It's a cautionary tale to some degree,” Kenny told the Washington Post.
“People who go into rap music or hip hop or punk, they're in a much more occupational hazard profession compared to war. We don't lose half our army in a battle. ”
Justin Moyer, Tampa Bay TimesThe deadliest profession: hip-hop artist.
![Page 58: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/58.jpg)
Data censoring
![Page 59: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/59.jpg)
Right censoring
2013 2014 2015 2016 2017CC0 publicdomainimages.net
![Page 60: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/60.jpg)
Right censoring
2013 2014 2015 2016 2017CC0 publicdomainimages.net
![Page 61: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/61.jpg)
Right censoring
2013 2014 2015 2016 2017CC0 publicdomainimages.net
![Page 62: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/62.jpg)
Right censoring
2013 2014 2015 2016 2017CC0 publicdomainimages.net
![Page 63: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/63.jpg)
Numark DJ ControllerBC Rich Warlock GuitarEpiphone DobroYamaha Yas61lii sax
![Page 64: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/64.jpg)
Many musicians from youngergenres – rock, electronic, punk,metal, rap, and hip hop –appear unlikely to live long enough to acquire the illnesses of middle and old age.”
— Kearney (2015)
“
![Page 65: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/65.jpg)
Many musicians from youngergenres – rock, electronic, punk,metal, rap, and hip hop –appear unlikely to live long enough to acquire the illnesses of middle and old age.”
— Kearney (2015)
“ha
ve n
ot yet
lived
![Page 66: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/66.jpg)
A game of telephone
Scholarlyarticle
Popular article
Dataviz
Washington Post
Twitter meme
![Page 67: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/67.jpg)
Tips for spotting quantitative bullshit1. Question the source
2. Consider the different ways numbers can be presented
3. Watch out for graphic manipulation
4. Don’t be intimidated by the black box
5. If a claim seems too good to be true...
6. Avoid confirmation bias.
7. Beware of unfair comparisons.
8. Think in orders of magnitude.
![Page 68: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/68.jpg)
![Page 69: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/69.jpg)
Overall, the results of the current study revealed more similarity in the letters written for male and female job candidates than differences....
Letters written for women included language that was just as positive and placed equivalent emphasis on ability, achievement, and research.”
“T. Schmader, J. Whitehead, and V. Wysocki. (2008) A linguistic comparison of letters of recommendation for male and female chemistry and biochemistry job applications. Sex Roles 57: 509-514
![Page 70: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/70.jpg)
The image my friend tweeted illustrates the hypothesis, not the results.
“standout” words “grindstone” words
![Page 71: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/71.jpg)
Tips for spotting quantitative bullshit1. Question the source
2. Consider the different ways numbers can be presented
3. Watch out for graphic manipulation
4. Don’t be intimidated by the black box
5. If a claim seems too good to be true...
6. Avoid confirmation bias.
7. Beware of unfair comparisons.
8. Think in orders of magnitude.
![Page 72: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/72.jpg)
Is fresh juice sweeter than juice from concentrate?
![Page 73: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/73.jpg)
Fresh
21 people 4 people
Conclusion: Fresh juice is sweeter!p<0.01 (exact binomial test)
From Concentrate
![Page 74: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/74.jpg)
I am comparing apples and oranges!
CC0 jarmoluk, picaidol (pixabay)
![Page 75: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/75.jpg)
![Page 76: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/76.jpg)
Streaming video was hardly a thing in 2009! “
”
![Page 77: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/77.jpg)
Tips for spotting quantitative bullshit1. Question the source
2. Consider the different ways numbers can be presented
3. Watch out for graphic manipulation
4. Don’t be intimidated by the black box
5. If a claim seems too good to be true...
6. Avoid confirmation bias.
7. Beware of unfair comparisons.
8. Think in orders of magnitude.
![Page 78: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/78.jpg)
<— hasn’t he suffered enough?
![Page 79: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/79.jpg)
$70 million sounds like a lot of cash.
But how much is it in the context of the entire food stamp program?
![Page 80: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/80.jpg)
What fraction of Americans receive food stamps?
1% 10% 100%
![Page 81: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/81.jpg)
What fraction of Americans receive food stamps?
1% 10% 100%
![Page 82: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/82.jpg)
How much does the average food stamp recipient receive
annually?
$100 $1,000 $10,000
![Page 83: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/83.jpg)
How much does the average food stamp recipient receive
annually?
$100 $1,000 $10,000
![Page 84: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/84.jpg)
How many people are there in the United States?
![Page 85: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/85.jpg)
How many people are there in the United States?
About 300,000,000
![Page 86: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/86.jpg)
Thus total expenditures on the food stamp program (not counting administration costs) are about
300,000,000 × 0.1 × $1000 =
$30,000,000,000
![Page 87: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/87.jpg)
The fraction lost to fraud is thus
$70,000,000 / $ 30,000,000,000 =
0.2% of expenditures
Typical losses in retail would be on the order of 1.5% to 3%.
![Page 88: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/88.jpg)
![Page 89: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/89.jpg)
![Page 90: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/90.jpg)
![Page 91: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/91.jpg)
“Falsehood flies, and the Truth comes limping after it.”
—Jonathan Swift (1710)
![Page 92: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/92.jpg)
Tips for spotting quantitative bullshit1. Think about how numbers are presented.
2. Don’t be fooled by visualization.
3. Question the source.
4. Don’t be intimidated.
5. If a claim seems too good to be true...
6. Avoid confirmation bias.
7. Beware of unfair comparisons.
8. Think in orders of magnitude.
9. Be aware of common statistical traps.
![Page 93: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/93.jpg)
Algorithm
?DataDataData
Output
Even when you don’t know how an algorithm or statistical test works, you can spot bullshit by looking carefully at what goes in and what comes out.
Interpretation
![Page 94: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/94.jpg)
“Neil Postman’s Third Law
At any given time, the chiefsource of bullshit with which you have to contend is yourself.”
![Page 96: OECD jevin west - | PARIS21 West - Calling... · underutilized portfolio opportunities.” “ While short of statistical significance after Bonferroni correction (p=0.13), our results](https://reader034.vdocument.in/reader034/viewer/2022050405/5f824505499095203524d2a3/html5/thumbnails/96.jpg)