student generated content for enhanced engagement and learning
DESCRIPTION
Workshop presentation given at the Physics Higher Education Conference 2011, held at the University of Lancaster 8-9 Sept 2011TRANSCRIPT
Physics Education Research The University of Edinburgh
1
Student generated content for enhanced engagement and learning
PHEC 8-9 Sept 2011, Lancaster UK.
Physics Education Research The University of Edinburgh
The University of Edinburgh Edinburgh, Scotland
5th July, 2010
Paul Denny
PeerWise bridging the gap between online learning and social media
Department of Computer Science The University of Auckland New Zealand http://peerwise.cs.auckland.ac.nz/
Physics Education Research The University of Edinburgh
Intro and overview of PeerWise
Group-based question creation session
(Break)
Groups answer questions created
Results of pilot implementation at Edinburgh 2010-11
3
Physics Education Research The University of Edinburgh
overview
4
Physics Education Research The University of Edinburgh
Student familiarity with
Web 2.0 The energy and
creativity of a large class
Student requests for
more problems
Physics Education Research The University of Edinburgh
• Web-based MCQ repository built by students
• Students: – develop new questions with
associated explanations – answer existing questions and
rate them for quality and difficulty – take part in discussions – can follow other authors
Physics Education Research The University of Edinburgh
• 2007-Summer 2010 – 45 institutions
– 260 courses
– 20661 students have contributed
– 57324 questions have been written
– 1527574 answers have been submitted
Physics Education Research The University of Edinburgh
• To date – 140 institutions
– 879 courses
– 47719 students have contributed
– 164503 questions have been written
– 3879994 answers have been submitted
Physics Education Research The University of Edinburgh
What we did in our course(s)
9
Physics Education Research The University of Edinburgh
PeerWise was introduced in workshop sessions in Week 5
Students worked through structured introductory activities
Grunge Prowkers test available from www.uwe.ac.uk/elearning/examples/mcq.pdf 10
Physics Education Research The University of Edinburgh
PeerWise was introduced in workshop sessions in Week 5
Students worked through structured example task and devised own Qs in groups.
11
Physics Education Research The University of Edinburgh
12
Physics Education Research The University of Edinburgh
In S1, an assessment was set for the end of Week 6:
Minimum requirements:
• Write one question • Answer 5 • Comment on & rate 3
Contributed ~3% to course assessment 13
Physics Education Research The University of Edinburgh
14
Physics Education Research The University of Edinburgh
We were deliberately hands off.
• No moderation • No corrections • No interventions at all
But we did observe…..
15
Physics Education Research The University of Edinburgh
Your turn
• Assemble into themed groups (eg mechanics, e&m, quantum, data handling, thermal)
• Create some questions…..
16
Physics Education Research The University of Edinburgh
What we found engagement, examples, effects
17
Physics Education Research The University of Edinburgh
18
It’s just a gimmick…..
Physics Education Research The University of Edinburgh
Uptake for in- course assessment
(class size of ~200)
350 questions in total
~3500 answers ~2000 comments
19
Workshop training
Live Due
Physics Education Research The University of Edinburgh
20
They’ll put in nonsense & irrelevant questions….
Physics Education Research The University of Edinburgh
21
Physics Education Research The University of Edinburgh
Quality of submissions:
• Average quality was very good
• Few trivial questions / nonsense distracters
• ‘Community moderation’ discouraged sub-par questions
22
Physics Education Research The University of Edinburgh
23
The questions will be poor quality… rote learning, factual recall blah blah blah…..
Physics Education Research The University of Edinburgh
24
Physics Education Research The University of Edinburgh
Physics Education Research The University of Edinburgh
26
The science will be all wrong……
Physics Education Research The University of Edinburgh
27
Physics Education Research The University of Edinburgh
Perceptions
We sought student feedback both in ‘wash-up’ sessions after the assessment and in the end of course questionnaire
28
Physics Education Research The University of Edinburgh
Positives
29
Physics Education Research The University of Edinburgh
Positives
30
Physics Education Research The University of Edinburgh
Negatives
31
Physics Education Research The University of Edinburgh
32
… but they’ll lose interest after a while….
Physics Education Research The University of Edinburgh
Mid-semester deadline
Physics Education Research The University of Edinburgh
End-of-semester deadline
Physics Education Research The University of Edinburgh
35
… but you can’t prove that greater use correlates with performance….
Physics Education Research The University of Edinburgh
Low PeerWise Activity
High PeerWise Activity
Physics Education Research The University of Edinburgh
Matched Pairs: Scottish, male, non-majors
1 2 3 4 5 6 PW activity
X MPA X MPA LPA LPA No auth
PW mark
X 23 X 23 14 14 CW 70 71 48 50 62 67 Exam 56 69 49 54 40 34 Grade B A D C D Fail
Physics Education Research The University of Edinburgh
38
Take-homes: • Provide orientation task • Set the quality bar very high • Force yourself to be hands-off • Set an assessment task • Leave the deadline as late as you can • Assessment is quality-based but light-load (no
direct marking required) • Unleash the creativity of your students!
Physics Education Research The University of Edinburgh
http://bit.ly/EdPER
Acknowledgements: We gratefully acknowledge departmental
development project grant support from the Higher Education Academy UK Physical Sciences Centre.
Physics Education Research The University of Edinburgh
Now under way: • JISC Assessment and Feedback research project:
Student Generated Content for Learning (SGC4L)
Forthcoming HEA funding opportunities: Volunteer partner institutions needed