it takes a village to raise a sotl project: assessing the assessment of an atp comic
DESCRIPTION
Pre-test Post-Test Two weeks after using the book. Using the book in class Optical Allusions: Assessment recap Hosler, Jay S. and Boomer, K.B. (2011). Are Comic Books an Effective Way to Engage Non- Majors in Learning and Appreciating Science? CBE-Life Science Education 10, pg. 309–317TRANSCRIPT
![Page 1: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/1.jpg)
It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic
![Page 2: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/2.jpg)
It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic
![Page 3: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/3.jpg)
Pre-test Post-TestTwo weeks after using the
book.
Using the
book in class
Optical Allusions: Assessment recap
Hosler, Jay S. and Boomer, K.B. (2011). Are Comic Books an Effective Way to Engage Non- Majors in Learning and Appreciating Science? CBE-Life Science Education 10, pg. 309–317
![Page 4: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/4.jpg)
The Initial Plan:
• Didn’t use them• Instead, made all of that and more
for an ATP story.• How come?
• I received a SoTL summer grant to develop a photosynthesis comic, prose story and textbook piece
![Page 5: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/5.jpg)
The comic book story
Molecular Techniques Class:Alyssa Fazi, Kat Connolly, Nathan Bicher, Shannon Harrington, and Jared Haidet
Try to make something teachers will actually use.
![Page 6: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/6.jpg)
The narrated comic
“They can buy hundreds of comics with story and character. They buy your book to master biology. Anything that gets in the way of their grasping those fundamentals is an obstacle.”
- Thomas LeBien
![Page 7: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/7.jpg)
How do you know students didn’t like the comic (Optical Allusions) just because of the narrative?
How do you know your prose (Photosynthesis) will be any good?
The illustrated prose story
![Page 8: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/8.jpg)
The textbook excerpt
Use a textbook excerpt. Otherwise you run the risk of assessing your ability to write a textbook excerpt.
Freeman (2011) Biological Science, pages 148-150
![Page 9: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/9.jpg)
Illustrated Prose Story
Textbookexcerpt
Narratedcomic
Comic bookstory
![Page 10: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/10.jpg)
Protocol, IRB and Analysis
Content Pre-test12 MC
questions
Large Group
Content Post-test 2
12 MC questions
Attitude Survey 4 Likert
questions
Small Group
3 weeks
Small Group
Read the ATP
passage
ImmediateContent
Post-test 112 MC
questions
1 week
Approved.
Let’s run the numbers.
![Page 11: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/11.jpg)
Results: Attitudes
They liked the prose and the two comics significantly more…....................….than the textbook.
Results: Content scores
They scored significantly higher with the text and two comics ……..…............than the prose.
![Page 12: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/12.jpg)
Think critically!
• Didn’t ask others to proof anything other than the comic story. (I forgot Jim’s admonition…)
• Maybe prose only works for certain topics.
• Could be the content test was less than effective.
• Ceiling effect: not that much content?
• Sample size is still too small
• Didn’t wait long enough for post-test 2
![Page 13: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/13.jpg)
Or, have others think critically for you…
Consider different learning experiences?Maybe students in POEs more comfortable with prose narrative would respond differently to it.
Are style and format an issue?The layout of the comic story is a little intimidating but the narrated comic seems better organized and accessible.
Do comics work better in certain contexts?Richard Mayer and his colleagues have found that comics used as a lesson summary for college students did better than students who received written or pictorial summaries.
![Page 14: It takes a village to raise a SoTL project: Assessing the assessment of an ATP comic](https://reader035.vdocument.in/reader035/viewer/2022081521/5a4d1ae77f8b9ab05997958d/html5/thumbnails/14.jpg)
Thanks.
Now, feel free to make my “To Do” list longer