mcq writing group · feedback if wrong answer + guidance for further reading/ for finding the right...
TRANSCRIPT
![Page 1: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/1.jpg)
1 Brussels 21 November 2009 1
UPDATE ON CARDIOLOGY
E-PLATFORM
MCQ WRITING GROUP
CESMA Meeting 21st Nov 2009
Dr Peter Mills Chairman EBSC
![Page 2: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/2.jpg)
Click to edit Master title style
2 2
Approx. 70 Writers from 11 countries (UK, Belgium,
Netherlands, Sweden, Germany, Spain, Italy, Czech Rep.,
Greece, Poland, Switzerland)
1st Writing session – started in Autumn 2008: each Writer is
assigned a topic from the ESC General Cardiology Core
Curriculum
2 Brussels 21 November 2009
![Page 3: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/3.jpg)
Click to edit Master title style
3 3
Spring 09 MCQ Review Meeting - Approx. 400 MCQs produced
and reviewed
Summer 09 – focus on producing MCQs for the Second Edition ESC
Textbook for General Cardiology (over 200 MCQs produced)
Fine-tuning MCQ Format for Knowledge Assessment
• Best of Five (only one correct answer)
• All MCQs are written against EBAC Accredited Educational
Resources - ESC Guidelines
- ESC Textbook
- Education in Heart articles
- ....
3 Brussels 21 November 2009
![Page 4: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/4.jpg)
Click to edit Master title style
4
MCQs are for:
Learning purposes: “Open Book Assessment” - formative questions with
feedback if wrong answer + guidance for further reading/ for finding the right
answer.
Requirement: large bank of questions + all questions have to relate to an
educational resource. Questions can be re-used ... “if you know the answer to
the 5000 MCQs in the Bank, you know the breadth of the Curriculum!”
Assessing purposes: “Examination type Assessment” - summative questions
(no feedback if given + a question once used ought not to be used again)
Requirement: questions do NOT necessarily relate to an educational resource.
The questions have to remain secret:
4 Brussels 21 November 2009
![Page 5: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/5.jpg)
Click to edit Master title style
5
MCQs Formats: The MCQ Writing Group are currently
assessing various formats of MCQs and their respective
implementations (for the different purposes)
Best of Five: (only one correct answer)
Question Stem
Option 1 – True <-
Option 2 - False
Option 3 - False
Option 4 - False
Option 5 - False
Best of five (more than one correct answer)
True / False
5 Brussels 21 November 2009
![Page 6: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/6.jpg)
Click to edit Master title style
6 6
In cooperation with the British Cardiovascular Society, the First General
Cardiology Knowledge Assessment was organised in London on 30 May 2009.
120 MCQs selected from the MCQ Bank – reflecting Core Curriculum distribution
Candidates: 60 cardiologists (mostly year 3 and year 4 of Specialist Training)
Psychometric reports:
• Pilot Knowledge Assessment was valid and reliable (“year 4 ST4 +” did better than
“year 3 ST3 -”)
• Cronbach’s alpha coefficient was 0.75 – very good for a pilot (high-stakes situations
should have a reliability of 0.8-0.9)
6 Brussels 21 November 2009
![Page 7: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/7.jpg)
Click to edit Master title style
7 7 7 Brussels 21 November 2009
![Page 8: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/8.jpg)
Click to edit Master title style
8 8 8 Brussels 21 November 2009
![Page 9: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/9.jpg)
Click to edit Master title style
9 9
The “Bank” started off with approx. 90 MCQs from UK Writers
The “Bank” aims to develop 4 to 5’000 MCQs for both
–> “Open Book Assessment” – formative assessment of knowledge
related to EBAC approved educational products – Textbook,
Guidelines, etc
-> Standard Examination – MCQs not necessarily related to
educational content
9 Brussels 21 November 2009
![Page 10: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/10.jpg)
Click to edit Master title style
10 10
After one year, the “Bank” holds approx. 1400 MCQs (UK Writers,
new MCQs, EBAC Accredited Educational Resources – Guidelines,
Textbook (1st and 2nd edition), Education in Heart articles)
The MCQ Team are working with ESC Education Committee and
the EBSC to bring the MCQ Writing Process on-line for greater
reliability, efficiency and flexibility
On-going process of recruiting MCQ Writers and production of
MCQs
10 Brussels 21 November 2009
![Page 11: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/11.jpg)
Click to edit Master title style
11
Thank you!
11 11 Brussels 21 November 2009
![Page 12: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/12.jpg)
Click to edit Master title style
12 12
The “Bank” aims to develop 4 to 5’000 MCQs
–> “Open Book Assessment” – formative assessment of knowledge
related to EBAC approved educational products – Textbook,
Guidelines, etc
-> Standard Examination – MCQs not necessarily related to
educational content.
12 Brussels 21 November 2009
![Page 13: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/13.jpg)
Click to edit Master title style
13
Why 360° Assessment?
One piece in the jigsaw of defining a good competent doctor
Recognises team work
Recognises the existence of patients (who are also voters)
Can be structured in a non-threatening, constructive way
13 13 Brussels 21 November 2009
![Page 14: MCQ WRITING GROUP · feedback if wrong answer + guidance for further reading/ for finding the right answer. ... new MCQs, EBAC Accredited Educational Resources – Guidelines,](https://reader031.vdocument.in/reader031/viewer/2022021718/5b5ddcfa7f8b9aa1428f083e/html5/thumbnails/14.jpg)
Click to edit Master title style
14
A Multi-rater feedback ...
14 14 Brussels 21 November 2009