Download - Denis duret 2010
Summative assessment
for 4th year Veterinary
students on VITAL
Denis DuretIT Officer
School of Veterinary Science
Overview
• Background information
• Assessment on VITAL
– Preparation
– Implementation
– Marking
• Key Findings
– Student perception
– Staff perception
• Conclusion
Background information
• Equine
• Small animal
• Farm animal
3 exams in March Based at Leahurst
Background information
• 20083 paper based exams (online version cancelled)
• 2009One exam on VITAL MCQs without pictures
• 2010Two out of three exams on VITALMCQs with pictures
Assessment on VITAL
Part 1: preparation
Assessment on VITAL
A number of related guides are available on the VITAL support staff website
• How to Guide - Test tool.pdf (Full guide)
• How to Guide - Test tool.pdf (Quick start guide)
• How to Guide - Test tool - 17 question types.pdf
• How to Guide - Test tool - troubleshooting.pdf
• How to Guide - Test tool - Tips on running VITAL tests under controlled conditions.pdf
Part 2: Implementation
Assessment on VITAL
Part 3: Marking
Assessment on VITAL
Part 3: Marking (what you don’t get)
Key Findings
• 116 students
• SurveyMonkey (58 students contributed)
• Some students failed
• 2 - Equine (paper based)
• 1 - Farm (online)
• 19 - Small animal (online)
Student perception
Key Findings
What exam format did you prefer?
Online (Small Animal & FarmAnimal) 36.2% (21)
On paper (Equine) 63.8% (37)
Student perception
Key Findings
• “The format for the exams was pretty much exactly the same. The advantage of the online exam was the use of pictures.
• “Having pictures is good, also it felt more informal and therefore less stressful”
• “No need to transcribe answer from question sheet to answer sheet.”
Student perception
Key Findings
• “able to write stuff down on the question paper to help work things out”
• “I find looking at a computer screen for a long time difficult”
• “Travelling to Liverpool for exams was a pain and is the major down side to the online exams!!!.”
• “I don’t trust vital”
Student perception
Key Findings
Considering the online exams had questions with pictures, which format allowed you to demonstrate your knowledge to the best of
your ability?
Online (Small Animal & FarmAnimal) 71.9% (41)
On paper (Equine) 28.1% (16)
Student perception
Key Findings
Which format was easier to fill in?
Online (Small Animal & FarmAnimal (70.2%) 40
On paper (Equine) 29.8% (17)
Student perception
Key Findings
Which format was the more stressful?
Online (Small Animal & FarmAnimal) 48.2% (27)
On paper (Equine) 12.5% (7)
Both10.7% (6)
Neither28.6% (16)
Student perception
Key Findings
• “photos would be a great idea...but many of the photos were of poor quality”
• “I think if people get used to doing the online exams then it will be fine. “
Student perception (other comments)
Key Findings
Pap
er b
ased
vers
ion
:O
nlin
e ve
rsio
n
Not sure about it....• Worked well so far (paper based version). •No pictures with the MCQ•Travelling to Liverpool (students + members of staff)
Worked well but ...• Slightly concerned about back up•Lack of statistics from VITAL
Happy with the format• More pictures for next year.•Ability to randomise questions
Staff perception (academics)
Shaun McKane
Fraser McConnell
Richard Murray
Key Findings
Online version• Easy to set up•Instant access to the results
Online version• More work with Excel
Staff perception (support)
Nicky Wyllie
Denis Duret
Conclusion
• It worked ...
• Need to prepare the students
• Improve picture quality
What’s next?
• 3 exams online next year
• Other tools
• More pictures and videos?
• EMQs for final year exam
Questions &
Discussion