framework for feedback: the peer mini-clinical examination as a formative assessment tool

1
Correspondence: Robbert Duvivier, International Federation of Medical Students’ Associations IFMSA PO Box 63, 01212 Ferney- Voltaire, France. Tel: 00 31 6 2835 9428; Fax: 00 31 6 2835 9428; E-mails: [email protected] doi: 10.1111/j.1365-2923.2012.04234.x Framework for feedback: the peer mini-clinical examination as a formative assessment tool Deirdre Bennett, Martina Kelly & Siun O’Flynn What problems were addressed? Our students wanted more feedback on their performance with patients in the clinical setting. We wanted to develop students’ ability to deliver and accept useful feedback. The mini-clinical examination (mini-CEX) is part of our assessment programme and is familiar to students. It is a workplace-based assessment in which student performance during a focused clinical encounter is evaluated. Immediate feedback on performance and the teaching opportunity provided have been identified as strengths of the process by students. 1 We wondered if the mini-CEX format could serve as a useful framework for a process of reciprocal peer feedback on clinical placements. What was tried? We ran a pilot study to assess the utility and acceptability to students of the mini-CEX as a framework for feedback. Forty students, assigned in pairs, undertook two peer mini-CEX evaluations whilst on clinical attachments. In this way, each student acted as both learner and assessor. The National Health Service mini-CEX form, with minor modifications for the undergraduate setting, was used. The assessor assigned a mark and identified areas for improvement in his or her peer’s performance. All students were asked to complete a qualitative survey evaluating the process. Responses were coded and grouped into themes independently by the authors. The marks and written feedback on the mini-CEX forms completed by the student assessors were also examined. What lessons were learned? The mini-CEX provided a useful framework for formative peer feedback in the undergraduate clinical setting. Peer assessors were able to identify the areas in which students had performed well and those that required improvement, and noted these, along with actions for improvement, on the mini-CEX forms. However, no student scored less than 4 out of 5. This is unlikely to accurately reflect the range of student performance and suggests that students may have found quantitative evaluation more challenging. Qualitative feedback revealed that students liked benchmarking their own performances against those of their peers, receiving useful feedback, gaining experience for other examinations, the real- life context of the mini-CEX and the opportunity to gain a different perspective by examining a peer’s performance. Negative comments focused on the validity of the feedback in view of the lack of qualification of peers, logistical issues concerning the organisation of the assessment, and desire for more guidance regarding standards to apply in assessing peers. Although the mini-CEX was effective in scaffold- ing peer feedback, students appeared to lack confidence in the process. Although they recogni- sed that the feedback was useful, only half of the students felt that it was appropriate to be assessed by a peer. Building a culture of peer-assisted learning might improve this. More guidance from faculty staff on standards and metrics underpinning judgements is needed and we have piloted a more structured mini-CEX form in response to this need. Our students are trained in giving and receiving feedback; however, their confidence in these skills did not transfer to a real-life setting. Graduated real-life application of feedback skills facilitated by faculty members may help to bridge this gap. REFERENCE 1 Hill F, Kendall K. Adopting and adapting the mini-CEX as an undergraduate assessment and learning tool. Clin Teach 2007;4:244–8. Correspondence: Dr Deirdre Bennett, Medical Education Unit, School of Medicine, University College Cork, Cork, Ireland. Tel: 00 353 21 490 1591; Fax: 00 353 21 490 1594; E-mail: [email protected] doi: 10.1111/j.1365-2923.2012.04230.x Medical students teach basic life support in hospital Bryan Sisk, S Beth Bierer, Meredith Lahl & Ehsan H Balagamwala What problems were addressed? Hospitalised infants have an elevated risk for cardiorespiratory arrest after 512 Ó Blackwell Publishing Ltd 2012. MEDICAL EDUCATION 2012; 46: 501–527 really good stuff

Upload: deirdre-bennett

Post on 01-Oct-2016

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Framework for feedback: the peer mini-clinical examination as a formative assessment tool

Correspondence: Robbert Duvivier, International Federation ofMedical Students’ Associations IFMSA PO Box 63, 01212 Ferney-Voltaire, France. Tel: 00 31 6 2835 9428; Fax: 00 31 6 2835 9428;E-mails: [email protected]

doi: 10.1111/j.1365-2923.2012.04234.x

Framework for feedback: the peer mini-clinicalexamination as a formative assessment tool

Deirdre Bennett, Martina Kelly & Siun O’Flynn

What problems were addressed? Our studentswanted more feedback on their performance withpatients in the clinical setting. We wanted todevelop students’ ability to deliver and accept usefulfeedback. The mini-clinical examination (mini-CEX)is part of our assessment programme and is familiarto students. It is a workplace-based assessment inwhich student performance during a focusedclinical encounter is evaluated. Immediate feedbackon performance and the teaching opportunityprovided have been identified as strengths of theprocess by students.1 We wondered if the mini-CEXformat could serve as a useful framework for aprocess of reciprocal peer feedback on clinicalplacements.What was tried? We ran a pilot study to assess theutility and acceptability to students of the mini-CEXas a framework for feedback. Forty students, assignedin pairs, undertook two peer mini-CEX evaluationswhilst on clinical attachments. In this way, eachstudent acted as both learner and assessor. TheNational Health Service mini-CEX form, with minormodifications for the undergraduate setting, wasused. The assessor assigned a mark and identifiedareas for improvement in his or her peer’sperformance. All students were asked to complete aqualitative survey evaluating the process. Responseswere coded and grouped into themes independentlyby the authors. The marks and written feedback onthe mini-CEX forms completed by the studentassessors were also examined.What lessons were learned? The mini-CEX provideda useful framework for formative peer feedback inthe undergraduate clinical setting. Peer assessorswere able to identify the areas in which studentshad performed well and those that requiredimprovement, and noted these, along with actionsfor improvement, on the mini-CEX forms. However,no student scored less than 4 out of 5. This isunlikely to accurately reflect the range of student

performance and suggests that students may havefound quantitative evaluation more challenging.Qualitative feedback revealed that students likedbenchmarking their own performances againstthose of their peers, receiving useful feedback,gaining experience for other examinations, the real-life context of the mini-CEX and the opportunity togain a different perspective by examining a peer’sperformance. Negative comments focused on thevalidity of the feedback in view of the lack ofqualification of peers, logistical issues concerningthe organisation of the assessment, and desire formore guidance regarding standards to apply inassessing peers.

Although the mini-CEX was effective in scaffold-ing peer feedback, students appeared to lackconfidence in the process. Although they recogni-sed that the feedback was useful, only half of thestudents felt that it was appropriate to be assessedby a peer. Building a culture of peer-assistedlearning might improve this. More guidance fromfaculty staff on standards and metrics underpinningjudgements is needed and we have piloted amore structured mini-CEX form in response to thisneed. Our students are trained in giving andreceiving feedback; however, their confidence inthese skills did not transfer to a real-life setting.Graduated real-life application of feedback skillsfacilitated by faculty members may help to bridgethis gap.

REFERENCE

1 Hill F, Kendall K. Adopting and adapting the mini-CEXas an undergraduate assessment and learning tool. ClinTeach 2007;4:244–8.

Correspondence: Dr Deirdre Bennett, Medical Education Unit, Schoolof Medicine, University College Cork, Cork, Ireland.Tel: 00 353 21 490 1591; Fax: 00 353 21 490 1594;E-mail: [email protected]

doi: 10.1111/j.1365-2923.2012.04230.x

Medical students teach basic life support inhospital

Bryan Sisk, S Beth Bierer, Meredith Lahl &Ehsan H Balagamwala

What problems were addressed? Hospitalised infantshave an elevated risk for cardiorespiratory arrest after

512 � Blackwell Publishing Ltd 2012. MEDICAL EDUCATION 2012; 46: 501–527

really good stuff