RUBRICS USED TO ASSESS COMMUNICATION SKILLS OF UTrue Communication Skills Assessment in Interdepartmental OSCE stations : Standard Setting Using The MAAS-Global and EduG

Winny Setyonugroho; Thomas Kropmans; Kieran M Kennedy

OTTAWA 2016 PAPER 180 OUTCOME BASED ASSESSMENT

Why Communication Skills (CS)• Good communication has a positive impact on patient behavior, patient care

outcomes, and patient satisfaction.

INMED 2015

• Patients' decision to sue was influenced not only by the original injury but also by insensitive handling and poor communication afterward

INMED 2015

Assessing CS in OSCE • The OSCE is a common tool to assess CS

• Our systematic review shows a lack of consensus, interpretation and definitions of CS domains amongst researchers

• There is no agreed universally accepted standard for communication skills assessment.

INMED 2015

As if measuring length with a rubber band

No agreed accepted standard for communication skills assessment is:

INMED 2015

To calibrate the communication skills component of existing clinical skills stations of OSCEs

We calibrated OSCE checklists using the Maas-Global as a standard

The Aim

How do we calibrate?

INMED 2015

We use the Maas-Global as the standard.

Why do we use the Maas-Global ?

• Maas-Global is a measurement instrument, developed by Maastricht University

• Maas-Global is a valid and reliable measurement instrument

INMED 2015

The focus of this instrument is on the communication process, rather than the content, i.e. how questions are asked rather than what is asked

3 raters , each analyzed 118 station forms , from 3 academic terms 2010-2013f o

r m s

a m p l e

1

2

3

4

5

6

7

8

INMED 2015

INMED 2015

Item MAAS-Global

INMED 2015

INMED 2015

•This study found that a calibration procedure is reliable

• And even better, we can calibrate with 2 raters instead of 3

• We converted a ‘rubber band’ into ‘thermometer’ for CS

Next step of the study: Compare the examination results within and between students, cohorts, and institutions.

INMED 2015

Conclusion