peerwise bates (stlhe 2013)
DESCRIPTION
Contributed presentation at the 2013 STLHE Conference in Cape Breton NS June 2013TRANSCRIPT
![Page 1: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/1.jpg)
7 Research-‐Based Principles For Learning & Teaching
Adapted from ‘How Learning Works’
![Page 2: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/2.jpg)
Overview
I. About PeerWise
II. Implemention
III. Engagement, Learning, Question Quality
![Page 3: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/3.jpg)
• Course-‐based online MulGple Choice QuesGon repository built by students
• Students: – develop new questions with
associated explanations – answer existing questions and rate
them for quality and difficulty – take part in discussions – can follow other authors
peerwise.cs.auckland.ac.nz
![Page 4: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/4.jpg)
>100,000 student contributors
>500,000 unique questions
>10,000,000 answers
![Page 5: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/5.jpg)
5
As a question author…..
![Page 6: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/6.jpg)
6
![Page 7: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/7.jpg)
7
![Page 8: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/8.jpg)
![Page 9: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/9.jpg)
![Page 10: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/10.jpg)
10
As a question answerer …..
![Page 11: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/11.jpg)
11
![Page 12: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/12.jpg)
12
![Page 13: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/13.jpg)
13
![Page 14: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/14.jpg)
14
![Page 15: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/15.jpg)
Overview
I. About PeerWise
II. Implemention
III. Engagement, Learning, Question Quality
![Page 16: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/16.jpg)
Implementation in PHAS 101 8 sections (4-3-1) N(total) ~1800 2012 W2 3 sections N ~750 All non majors. 2 PeerWise assignments
- scaffolded ahead of the first - support woven into 4 subsequent tutorials
16
![Page 17: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/17.jpg)
Assessment requirements As a minimum: • Write one question • Answer 5 • Comment on & rate 3 Contributed 2 x 2.5% to course assessment (mostly participation, small bonus for performance)
Student questions on midterm and final 17
![Page 18: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/18.jpg)
We were deliberately hands off. • No moderation • No corrections • No interventions at all
But we did observe…..
18
![Page 19: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/19.jpg)
Scaffolding in tutorials
19
![Page 20: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/20.jpg)
Scaffolding in tutorials
20
![Page 21: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/21.jpg)
![Page 22: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/22.jpg)
Overview
I. About PeerWise
II. Implemention
III. Engagement, Learning, Question Quality
![Page 23: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/23.jpg)
![Page 24: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/24.jpg)
• Phys 101 uptake graph showing midterm
![Page 25: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/25.jpg)
Engagement
First assessment exercise: • 664 acGve students (85% of cohort) • 1340 Q, 11000 A, 5000 C • x1.75, x17, x7 minimum requirements
![Page 26: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/26.jpg)
Engagement
Score
![Page 27: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/27.jpg)
Examples
27
![Page 28: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/28.jpg)
28
![Page 29: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/29.jpg)
![Page 30: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/30.jpg)
![Page 31: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/31.jpg)
Learning • Good engagement and parGcipaGon beyond the minimum requirements
• CorrelaGon between use and end-‐of-‐course outcome
• ReplicaGon study in 3 insGtuGons, 5 courses, 3 disciplines
1st year Physics N=172 University of Edinburgh
![Page 32: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/32.jpg)
1st year Physics N=172 University of Edinburgh
1st year Chemistry N=172 University of Edinburgh
![Page 33: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/33.jpg)
0%
5%
10%
15%
20%25%
30%
35%
40%
45%
50%
1 2 3 4 5 6
Taxonomic Category
Perc
enta
ge o
f Sub
mitt
ed Q
uest
ions
Learning
• QuesGon quality: mapped onto levels in cogniGve domain of Bloom’s taxonomy
• Surprisingly high overall quality, even from ‘novices’
First semester N = 350
Second semester N = 252
![Page 34: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/34.jpg)
![Page 35: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/35.jpg)
![Page 36: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/36.jpg)
Acknowledgements
Physics 101 course team Georg Rieger Firas Moosvi Emily Altiere UBC CWSEI
[email protected] @simonpbates
Ross Galloway Judy Hardy Karon McBride Alison Kay Keith Brunton Jonathan Riise Danny Homer
Chemistry – Peter Kirsop Biology – Heather McQueen
Physics – Morag Casey
Comp Sci – Paul Denny
![Page 37: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/37.jpg)
![Page 38: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/38.jpg)
Resources -‐ PeerWise Site: http://peerwise.cs.auckland.ac.nz Community: http://www.PeerWise-Community.org JISC-funded multi institution study:
https://www.wiki.ed.ac.uk/display/SGC4L/Home UoE Physics Pilot Study: AIP Conf. Proc. 1413, 359
http://dx.doi.org/10.1063/1.3680069 RSC overview article http://www.rsc.org/Education/EiC/issues/2013January/
student-generated-assessment.asp UoE Physics scaffolding resources
http://www2.ph.ed.ac.uk/elearning/projects/peerwise/
![Page 39: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/39.jpg)
![Page 40: PeerWise Bates (STLHE 2013)](https://reader033.vdocument.in/reader033/viewer/2022050919/5486ff47b47959e20c8b53d8/html5/thumbnails/40.jpg)
Question quality analysis (1st year Physics University of Edinburgh)
Assessing the quality of a student-generated question repository, submitted to Phys
Rev, ST Phys Educ Res.
Multi-institution, multi-course study
Student-generated content: Enhancing learning through sharing multiple-choice
questions, submitted to International Journal of Science Education
Scaffolding Student Learning via Online Peer Learning, submitted to International
Journal of Science Education
Publications in preparation / review / press