![Page 1: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/1.jpg)
A Fiddler on the Roof:Tradition vs. Modern Methods
in Teaching Inference
Patti Frazer LockRobin H. Lock
St. Lawrence University
Joint Mathematics MeetingsJanuary 2013
![Page 2: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/2.jpg)
Simulation methods provide an exciting new method for
teaching statistical inference!
![Page 3: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/3.jpg)
Let’s look at hypothesis tests.
![Page 4: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/4.jpg)
Example: Beer and Mosquitoes
Does consuming beer attract mosquitoes? Experiment: 25 volunteers drank a liter of beer,18 volunteers drank a liter of waterRandomly assigned!Mosquitoes were caught in traps as they approached the volunteers.1
1 Lefvre, T., et. al., “Beer Consumption Increases Human Attractiveness to Malaria Mosquitoes, ” PLoS ONE, 2010; 5(3): e9546.
![Page 5: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/5.jpg)
Beer and Mosquitoes
Beer mean = 23.6
Water mean = 19.22
Does drinking beer actually attract mosquitoes, or is the difference just due to random chance?
Beer mean – Water mean = 4.38
Number of Mosquitoes Beer Water 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
![Page 6: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/6.jpg)
Traditional Inference
1 22 21 2
1 2
s sn n
X X
Which formula?
Calculate numbers and plug into formula
Plug into calculator
4. Compute p-value
df?
p-value?
0.0005 < p-value < 0.001
187.3
251.4
22.196.2322
68.3
1. State hypotheses 2. Check conditions
3. Compute t.s. Distribution?
5. Conclusion
![Page 7: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/7.jpg)
Simulation Approach
Beer mean = 23.6
Water mean = 19.22
Does drinking beer actually attract mosquitoes, or is the difference just due to random chance?
Beer mean – Water mean = 4.38
Number of Mosquitoes Beer Water 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
![Page 8: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/8.jpg)
Simulation ApproachNumber of Mosquitoes Beer Water 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
Find out how extreme these results would be, if there were no difference between beer and water.
What kinds of results would we see, just by random chance?
Number of Mosquitoes Beverage 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
![Page 9: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/9.jpg)
Simulation ApproachBeer Water
Find out how extreme these results would be, if there were no difference between beer and water.
What kinds of results would we see, just by random chance?
Number of Mosquitoes Beverage 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
27 212127241923243113182425211812191828221927202322
2026311923152212242920272917252028
𝑥𝐵−𝑥𝑊=21.63−23.00=−1.37Now repeat this thousands of times!
![Page 10: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/10.jpg)
This is an intro Statistics course, we can’t spend a lot of time teaching Computer Programming techniques.
![Page 11: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/11.jpg)
We need technology!
StatKeywww.lock5stat.com
![Page 13: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/13.jpg)
P-value: The probability of seeing results as extreme as, or more extreme than, the sample results, if the null hypothesis is true.
That makes sense!!
![Page 14: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/14.jpg)
All I need to do a test are the summary statistics.
![Page 15: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/15.jpg)
But, what about Confidence Intervals?
![Page 16: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/16.jpg)
Example: What is the average price of a used Mustang car?
Select a random sample of n=25 Mustangs from a website (autotrader.com) and record the price (in $1,000’s) for each car.
![Page 17: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/17.jpg)
Sample of Mustangs:
Our best estimate for the average price of used Mustangs is $15,980, but how accurate is that estimate?
Price0 5 10 15 20 25 30 35 40 45
MustangPrice Dot Plot
𝑛=25 𝑥=15.98 𝑠=11.11
![Page 18: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/18.jpg)
Traditional Inference1. Which formula?
3. Calculate summary stats
5. Plug and chug
𝑥± 𝑡∗ ∙ 𝑠√𝑛𝑥± 𝑧∗ ∙ 𝜎
√𝑛
,
4. Find t*
95% CI
df?
df=251=24
OR
t*=2.064
15.98±2 .064 ∙ 11.11√25
15.98±4.59=(11.39 ,20.57)6. Interpret in context
CI for a mean
2. Check conditions
![Page 19: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/19.jpg)
Our best estimate for the average price of used Mustangs is $15,980, but how accurate is that estimate?
Simulation Approach
We simulate a sampling distribution using bootstrap statistics!
![Page 20: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/20.jpg)
BootstrappingAssume the “population” is many, many copies of the original sample.
“Let your data be your guide.”
A bootstrap sample is found by sampling with replacement from the original sample, using the same sample size.
![Page 21: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/21.jpg)
Original Sample Bootstrap Sample
![Page 22: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/22.jpg)
StatKey
![Page 23: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/23.jpg)
Using the Bootstrap Distribution to Find a Confidence Interval
Keep 95% in middle
Chop 2.5% in each tail
Chop 2.5% in each tail
We are 95% sure that the mean price for Mustangs is between $11,930 and $20,238
![Page 24: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/24.jpg)
Sampling distributions are a critical concept. Are you replacing them with this newfangled idea?
![Page 25: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/25.jpg)
But we need a theoretical basis to make valid
statistical conclusions.
![Page 26: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/26.jpg)
An “old” justification
"Actually, the statistician does not carry out this very simple and very tedious process, but his conclusions have no justification beyond the fact that they agree with those which could have been arrived at by thiselementary method."
-- Sir R. A. Fisher, 1936
![Page 27: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/27.jpg)
A more recent justification:
“... Randomization-based inference makes a direct connection between data production and the logic of inference that deserves to be at the core of every introductory course.”
-- Professor George Cobb, 2007
![Page 28: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/28.jpg)
But my students are expected to know what a t-test is when they leave my course.
![Page 29: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/29.jpg)
Let’s build conceptual understanding with these
new methods and then show them the standard formulas.
![Page 30: A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference](https://reader035.vdocument.in/reader035/viewer/2022081503/5681635a550346895dd41bb3/html5/thumbnails/30.jpg)
OK – you’ve made good points.
But what about a textbook?