statistics (and sotl projects)
DESCRIPTION
Statistics (and SoTL Projects). It’s as much who you know, as what you know! . “Lies, Damned Lies, and Statistics” A Case Study in Statistics Use of a Stats Analytical Framework Statistics 101 Some Basics Which Statistical Test Should You Use in Your SoTL Work? Some Examples . - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/1.jpg)
Statistics (and SoTL Projects)
Jim SmithMichigan State UniversityLyman Briggs College
It’s as much who you know, as what you know!
“Lies, Damned Lies, and Statistics”
A Case Study in Statistics
Use of a Stats Analytical Framework
Statistics 101
Some Basics
Which Statistical Test Should You Use in Your SoTL Work?
Some Examples
![Page 2: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/2.jpg)
Learning Goals
By the end of this session, scholars will (have):
• Understand the need for and the role(s) of statistical tests in science education research;
• Be able to explain some basic tenets of statistics;
• Explored some literature examples of the application of statistics to SoTL work; and
• Begin to formulate a statistical framework for their Biology Scholars research project.
![Page 3: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/3.jpg)
Statistics and SoTL Projects
Did student learning increase as a result of my cell model assignment?
Do representations in comic book form improve student understanding of photosynthetic processes?
Are there differences in the preparedness and motivation levels of students who W/D/F in Introductory Biology?
Does increased metacognition decrease the W/D/F rate in Introductory Biology?
Statistics are important components of strategies to answer these questions!
![Page 4: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/4.jpg)
With respect to Statistics: Where would you place yourself on the following
scale?
1. From my perspective, there’s “Lies, Damned Lies, and Statistics”
2. I agree with the above statement somewhat, but not strongly.
3. I am halfway between “Damned Lies” and “Comfort”.
4. I agree with the below statement, but not strongly.
5. I am completely comfortable with statistics as they apply to SoTL work.
![Page 5: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/5.jpg)
The Problem – Young and Fry (2008)
“While the results are reported to be statistically significant, I am not familiar enough with the Spearman’s Rho nonparametric correlation analysis to know whether the data are truly convincing. ”
ASM Bio Scholar Summer 2012
![Page 6: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/6.jpg)
Young and Fry (2008)
![Page 7: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/7.jpg)
Framework for Analysis of Statistical Inference
Identify Variables of Interest
Formulate Hypotheses
Design Sampling Strategy
Collect Raw Data
Perform
Statistical Test(s)
Inference(Level 1)
Inference (Level 2+)
Tasks
• Identify the appropriate elements in the article of interest and map them onto the boxes
• Decide if the statistical test was appropriately chosen and carried out
• Decide if the claims (inferences) are supportable at each level
• Tie the framework to your projectSmith, Valles & Zeleke, in prep.
![Page 8: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/8.jpg)
An Application – Young and Fry (2008)
What is the MAI, and how was it used to measure aspects of metacognition?
![Page 9: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/9.jpg)
An Application – Young and Fry (2008)
What is the difference between metacognitive knowledge and metacognitive regulation?
![Page 10: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/10.jpg)
Framework for Analysis of Statistical Inference
Identify Variables of Interest
Formulate Hypotheses
Design Sampling Strategy
Collect Raw Data
Perform
Statistical Test(s)
Inference(Level 1)
Inference (Level 2+)
Tasks
• Identify the appropriate elements in the article of interest and map them onto the boxes
• Decide if the statistical test was appropriately chosen and carried out
• Decide if the claims (inferences) are supportable at each level
• Tie the framework to your projectSmith, Valles & Zeleke, in prep.
![Page 11: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/11.jpg)
ASM BSP S12: STATS 101
What do I really need to know about Statistics?
![Page 12: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/12.jpg)
ASM BSP S12: STATS 101
What do I really need to know about Statistics?
If you are going to do SoTL research, you really do need a basic working knowledge of statistical inference
![Page 13: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/13.jpg)
Fun, but no help for today
![Page 14: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/14.jpg)
Extremely helpful!
![Page 15: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/15.jpg)
What the difference between:
Experimental (or Research) Hypothesis
and
Statistical Hypothesis
![Page 16: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/16.jpg)
What the difference between:
Experimental (or Research) Hypothesis
HA: Metacognition improves student learning
and
Statistical Hypothesis
![Page 17: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/17.jpg)
What the difference between:
Experimental (or Research) Hypothesis
and
Statistical Hypothesis
HA: Course grade is correlated with MAI total
![Page 18: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/18.jpg)
What the difference between:
Experimental (or Research) Hypothesis
and
Statistical Hypothesis
H0: No correlation of Course grade with MAI total
![Page 19: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/19.jpg)
The Problem – Young and Fry (2008)
The data allow us to reject the hypothesis that there is no correlation between Course Grade and MAI total.
What is the difference between significance level and effect size?
![Page 20: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/20.jpg)
What the difference between:
Experimental (or Research) Hypothesis
HA: Metacognition improves student learning
and
Statistical Hypothesis
![Page 21: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/21.jpg)
What the difference between:
Discrete Numbers
and
Continuous Numbers
![Page 22: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/22.jpg)
With respect to Statistics: Where would you place yourself on the following
scale?
1. From my perspective, there’s “Lies, Damned Lies, and Statistics”
2. I agree with the above statement somewhat, but not strongly.
3. I am halfway between “Damned Lies” and “Comfort”.
4. I agree with the below statement, but not strongly.
5. I am completely comfortable with statistics as they apply to SoTL work.
![Page 23: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/23.jpg)
What the difference between:
Discrete Numbers
Categorical; membership known without error
and
Continuous Numbers
![Page 24: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/24.jpg)
What the difference between:
Discrete Numbers
and
Continuous Numbers
Not known without error; have a distribution
![Page 25: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/25.jpg)
Overall: Mean = 74.70 (74.70%) +/- 11.45 SD TH: Mean = 24.47 (81.57%) +/- 3.91 SD ER: Mean = 28.96 (72.40%) +/- 5.52 SD MC: Mean = 21.27 (70.90%) +/- 4.45 SD
Discrete or Continuous?
![Page 26: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/26.jpg)
What the difference between:
Non-parametric Statistics
For discrete data; for data that violate parametric assumptions
and
Parametric Statistics
![Page 27: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/27.jpg)
What the difference between:
Non-parametric Statistics
e.g., Chi-squared tests, Mann-Whitney U test, Wilcoxon Rank Sums test
and
Parametric Statistics
![Page 28: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/28.jpg)
What the difference between:
Non-parametric Statistics
and
Parametric Statistics
![Page 29: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/29.jpg)
What the difference between:
Non-parametric Statistics
and
Parametric Statistics
e.g., t-test, ANOVA, Pearson’s r
![Page 30: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/30.jpg)
Assumptions of Parametric Statistics(for continuous data)
Observations are unbiased and independent
Data are normally distributed
Equal variances across groups
![Page 31: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/31.jpg)
Stat
istic
al D
ecis
ion
Tree
From: Robert Gerwien, “A Painless Guide to Statistics: Online Resources for Biology”, http://abacus.bates.edu/~ganderso/biology/resources/statistics.html
![Page 32: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/32.jpg)
Stat
istic
al D
ecis
ion
Tree
Was the use of Spearman’s Rank Correlation test appropriate?
Work with your group
Yes/No, and why
Young and Fry: Revisited
![Page 33: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/33.jpg)
Young and Fry: Was theirs the appropriate statistical test?
REM - You will find disagreement in the ranks (including among manuscript reviewers)
![Page 34: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/34.jpg)
Test Time: What kind of data? Test?
Encouragingly, using t test analysis, we found that in four of our courses (both BSCI 223 courses, BSCI 424, and BSCI 422) there was significant improvement on the concept inventory scores from presurvey to postsurvey.
From Marbach-Ad et al. 2009
![Page 35: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/35.jpg)
Test Time: What kind of data? Test?
From Drew & Triplett 2008
![Page 36: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/36.jpg)
Test Time: What kind of data? Test?
From Steck et al. 2012
![Page 37: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/37.jpg)
Test Time: What kind of data? Test?
From Steck et al. 2012
![Page 38: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/38.jpg)
Test Time: What kind of data? Test?
From Steck et al. 2012
“I’m baffled…”
![Page 39: Statistics (and SoTL Projects)](https://reader035.vdocument.in/reader035/viewer/2022062305/5681624b550346895dd28ea3/html5/thumbnails/39.jpg)
You may (probably) need help!! Become friends/colleagues with a really smart
biologist or social scientist who uses a statistical approach in their own work
• A lot of these folks have strong experimental design skills
• Ecologists and Evolutionary Biologists seem to be particularly strong
On-campus statistical consulting service?