denis duret 2010

Summative assessment

for 4th year Veterinary

students on VITAL

Denis DuretIT Officer

School of Veterinary Science

Overview

• Background information

• Assessment on VITAL

– Preparation

– Implementation

– Marking

• Key Findings

– Student perception

– Staff perception

• Conclusion

Background information

• Equine

• Small animal

• Farm animal

3 exams in March Based at Leahurst

Background information

• 20083 paper based exams (online version cancelled)

• 2009One exam on VITAL MCQs without pictures

• 2010Two out of three exams on VITALMCQs with pictures

Assessment on VITAL

Part 1: preparation

Assessment on VITAL

A number of related guides are available on the VITAL support staff website

• How to Guide - Test tool.pdf (Full guide)

• How to Guide - Test tool.pdf (Quick start guide)

• How to Guide - Test tool - 17 question types.pdf

• How to Guide - Test tool - troubleshooting.pdf

• How to Guide - Test tool - Tips on running VITAL tests under controlled conditions.pdf

Part 2: Implementation

Assessment on VITAL

Part 3: Marking

Assessment on VITAL

Part 3: Marking (what you don’t get)

Key Findings

• 116 students

• SurveyMonkey (58 students contributed)

• Some students failed

• 2 - Equine (paper based)

• 1 - Farm (online)

• 19 - Small animal (online)

Student perception

Key Findings

What exam format did you prefer?

Online (Small Animal & FarmAnimal) 36.2% (21)

On paper (Equine) 63.8% (37)

Student perception

Key Findings

• “The format for the exams was pretty much exactly the same. The advantage of the online exam was the use of pictures.

• “Having pictures is good, also it felt more informal and therefore less stressful”

• “No need to transcribe answer from question sheet to answer sheet.”

Student perception

Key Findings

• “able to write stuff down on the question paper to help work things out”

• “I find looking at a computer screen for a long time difficult”

• “Travelling to Liverpool for exams was a pain and is the major down side to the online exams!!!.”

• “I don’t trust vital”

Student perception

Key Findings

Considering the online exams had questions with pictures, which format allowed you to demonstrate your knowledge to the best of

your ability?

Online (Small Animal & FarmAnimal) 71.9% (41)

On paper (Equine) 28.1% (16)

Student perception

Key Findings

Which format was easier to fill in?

Online (Small Animal & FarmAnimal (70.2%) 40

On paper (Equine) 29.8% (17)

Student perception

Key Findings

Which format was the more stressful?

Online (Small Animal & FarmAnimal) 48.2% (27)

On paper (Equine) 12.5% (7)

Both10.7% (6)

Neither28.6% (16)

Student perception

Key Findings

• “photos would be a great idea...but many of the photos were of poor quality”

• “I think if people get used to doing the online exams then it will be fine. “

Student perception (other comments)

Key Findings

Pap

er b

ased

vers

ion

:O

nlin

e ve

rsio

n

Not sure about it....• Worked well so far (paper based version). •No pictures with the MCQ•Travelling to Liverpool (students + members of staff)

Worked well but ...• Slightly concerned about back up•Lack of statistics from VITAL

Happy with the format• More pictures for next year.•Ability to randomise questions

Staff perception (academics)

Shaun McKane

Fraser McConnell

Richard Murray

Key Findings

Online version• Easy to set up•Instant access to the results

Online version• More work with Excel

Staff perception (support)

Nicky Wyllie

Denis Duret

Conclusion

• It worked ...

• Need to prepare the students

• Improve picture quality

What’s next?

• 3 exams online next year

• Other tools

• More pictures and videos?

• EMQs for final year exam

Questions &

Discussion