statistical fallacies - heidelberg university · tyson h. holmes, ten categories of statistical...

35
Statistical Fallacies Mustafa Fuad Rifet Ibrahim https://upload.wikimedia.org/wikipedia/commons/4/40/Fisher_iris_versicolor_sepalwidth.svg

Upload: others

Post on 23-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Statistical Fallacies

Mustafa Fuad Rifet Ibrahim

https://upload.wikimedia.org/wikipedia/commons/4/40/Fisher_iris_versicolor_sepalwidth.svg

Page 2: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Outline● Introduction● Sampling● Measurement

Page 3: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction

Page 4: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction● Survey about University Heidelberg students

Page 5: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction● Survey about University Heidelberg students● Love for mathematics

Page 6: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction● Survey about University Heidelberg students● Love for mathematics● Ask random people in the Mathematikon:

„Do you love mathematics?“ Yes/No

Page 7: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction● Survey about University Heidelberg students● Love for mathematics● Ask random people in the Mathematikon:

„Do you love mathematics?“ Yes/No● Result: 223/302 said YES and the rest said NO

Page 8: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction● Survey about University Heidelberg students● Love for mathematics● Ask random people in the Mathematikon:

„Do you love mathematics?“ Yes/No● Result: 223/302 said YES and the rest said NO● I report my astonishing results:

„...with this we were able to show that 73.8410596% of Heidelberg students love math. The Heidelberg student is truly a mathematically inclined person!“

Page 9: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Introduction● Survey about University Heidelberg students● Love for mathematics● Ask random people in the Mathematikon:

„Do you love mathematics?“ Yes/No● Result: 223/302 said YES and the rest said NO● I report my astonishing results:

„...with this we were able to show that 73.8410596% of Heidelberg students love math. The Heidelberg student is truly a mathematically inclined person!“

Really?……..Eh..I don‘t think so..

Page 10: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Sampling

Probability Nonprobability

Page 11: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Simple Random Sampling

Page 12: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Simple Random Sampling

Page 13: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Simple Random Sampling

Page 14: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Stratified Sampling

Page 15: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Stratified Sampling

Page 16: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Cluster Sampling

Page 17: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Systematic Sampling1 2 3 4 5 6

7 8 9 10 11 12

13 14 15 16 17 18

19 20 21 22 23 24

25 26 27 28 29 30

1 4 7 10 13 16 19 22 25 28

Page 18: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Probability Sampling

● Systematic Sampling1 2 3 4 5 6

7 8 9 10 11 12

13 14 15 16 17 18

19 20 21 22 23 24

25 26 27 28 29 30

1 4 7 10 13 16 19 22 25 28

Page 19: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

Page 20: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling

Page 21: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling

https://www.pss-interservice.com/files/img/content/referenzen/Mathematikon%2C%20Heidelberg/PSS_DE_Matematicon_Heidelberg_06.jpg

Page 22: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling● Snowball Sampling

https://www.pss-interservice.com/files/img/content/referenzen/Mathematikon%2C%20Heidelberg/PSS_DE_Matematicon_Heidelberg_06.jpg

Page 23: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling● Snowball Sampling

https://www.pss-interservice.com/files/img/content/referenzen/Mathematikon%2C%20Heidelberg/PSS_DE_Matematicon_Heidelberg_06.jpg

https://img-aws.ehowcdn.com/340x221p/cpi.studiod.com/www_ehow_com/photos.demandstudios.com/getty/article/152/172/123076592_XS.jpg

Page 24: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling● Snowball Sampling● Judgmental/Purposive

Sampling

https://www.pss-interservice.com/files/img/content/referenzen/Mathematikon%2C%20Heidelberg/PSS_DE_Matematicon_Heidelberg_06.jpg

https://img-aws.ehowcdn.com/340x221p/cpi.studiod.com/www_ehow_com/photos.demandstudios.com/getty/article/152/172/123076592_XS.jpg

Page 25: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling● Snowball Sampling● Judgmental/Purposive

Sampling● Quota Sampling

https://www.pss-interservice.com/files/img/content/referenzen/Mathematikon%2C%20Heidelberg/PSS_DE_Matematicon_Heidelberg_06.jpg

https://img-aws.ehowcdn.com/340x221p/cpi.studiod.com/www_ehow_com/photos.demandstudios.com/getty/article/152/172/123076592_XS.jpg

Page 26: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Nonprobability Sampling

● Convenience Sampling● Snowball Sampling● Judgmental/Purposive

Sampling● Quota Sampling● ... https://www.pss-interservice.com/files/img/content/referenzen/Mathematikon%2C%20Heidelberg/PSS_DE_Matematicon_Heidelberg_06.jpg

https://img-aws.ehowcdn.com/340x221p/cpi.studiod.com/www_ehow_com/photos.demandstudios.com/getty/article/152/172/123076592_XS.jpg

Page 27: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Sampling

Franklin D. Roosevelt

Alf London

https://upload.wikimedia.org/wikipedia/commons/1/1c/FDR_in_1933_2.jpg https://upload.wikimedia.org/wikipedia/commons/d/db/LandonPortr.jpg

https://upload.wikimedia.org/wikipedia/commons/a/a4/LiteraryDigest-19210219.jpg

Page 28: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Measurement

http://www.businessnewsdaily.com/images/i/000/001/482/original/TAPE-MEASURE-ART.jpg?1326819398

Page 29: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Measurement

● Definition of measured quantities

https://upload.wikimedia.org/wikipedia/commons/a/ab/Unit_relations_in_the_new_SI.svg

Page 30: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Measurement

● Definition of measured quantities

Stephen K. Campbell, Flaws and Fallacies in Statistical Thinking, 1974

Page 31: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Measurement

● Equipment precision● Lost data

https://www.opticscentral.com.au/media/catalog/product/cache/1/image/9df78eab33525d08d6e5fb8d27136e95/m/o/motic_ba81b_professional_biological_binocular_microscope_1.jpg

Page 32: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Measurement

● Spurious Precision

„An automobile advertisement caught the reader‘s attention with the assertion that

on a certain day an estimated 262,825,033.74 tons of snow fell upon

the United States.“

Stephen K. Campbell, Flaws and Fallacies in Statistical Thinking, 1974

Page 33: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Measurement

● Imperfect proxy

„Smythe‘s Elixir corrects a variety of scalp diseases and stops the hair loss they cause. Smythe‘s has been

used by over half-a-million people on our famous Double-Your-Money-Back-Guarantee. Only 1% of

those men and women were not helped by Smythe‘s and asked for a refund. This is truly an amazing

performance.“Stephen K. Campbell, Flaws and Fallacies in Statistical Thinking, 1974

Page 34: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

● Survey about University Heidelberg students● Love for mathematics● Ask random people in the Mathematikon:

„Do you love mathematics?“ Yes/No● Result: 223/302 said YES and the rest said NO● I report my astonishing results:

„...with this, we were able to show that 73.8410596% of Heidelberg students love math. The Heidelberg student is truly a mathematically inclined person!“

← !← !

← !

Example from the beginning...

Page 35: Statistical Fallacies - Heidelberg University · Tyson H. Holmes, Ten categories of statistical errors: a guide for research in endocrinology and metabolism, 2004 David J. Slutsky,

Sources● Tyson H. Holmes, Ten categories of statistical errors: a guide for researchin endocrinology and metabolism, 2004● David J. Slutsky, Statistical Errors in Clinical Studies, 2013● Stephen K. Campbell, Flaws and Fallacies in Statistical Thinking, 1974● Robert M. Groves et al, Survey Methodology, 2009