cbmepg.mcmaster.ca

Assessment Mapping

Workshop

Dr. Som Mukherjee

Dr. Lori Whitehead

Lisa Colizza Allison Paquette

1January 8, 2021

January 8, 2021

cbmepg.mcmaster.ca

Mapping for Success

• Determine what is to be included

• Define target audience and build maps to accommodate their needs

• Choose a few key maps for stakeholder distribution

• Label each map to

o Illustrate function

o Identify the most relevant stakeholder(s)

• Develop a process to provide ongoing access of updated documents to

appropriate stakeholder(s)

• Add accessory maps for back office, if needed

• Review, update, refine, change

2January 8, 2021

cbmepg.mcmaster.ca

What is Assessment Mapping?

• A way to ensure that the types of assessment you have chosen are

assessing the learning outcomes of your program.

• Provides a visual depiction of the spread or patterns to ensure a

balance of formative and summative assessment, deadlines

and feedback returns.

• Aligning timing of compiled assessments to be available before

Coach and Competence Committee meetings

• Ensure balance such that

o assessments are not based on too many of the same learning

outcomes

o all learning outcomes are being assessed

3January 8, 2021

cbmepg.mcmaster.ca

How Should We Do It? Should Assessment Drive Learning?

4January 8, 2021

cbmepg.mcmaster.ca

Review of

Assessment

Tools

5January 8, 2021

cbmepg.mcmaster.ca

Revised O-Scale

6January 8, 2021

Level Anchor Descriptor

1 “I had to do”The physician had to perform the clinical activity

while the resident observed.

2 “I had to talk them through” The resident required constant direction.

3“I had to prompt them from time to

time”The resident required frequent direction.

4 “I had to provide minor direction” The resident required minor direction.

5“I did not need to provide direction for

safe and independent care”

No direction was required for safe independent

care.

cbmepg.mcmaster.ca

Prep Documents

• From the Royal College document suite

o EPAs

o Competencies /OTR

• List of

o clinical rotations

o non-clinical activities – AHD, workshops, retreats, OSCEs, practice exams,

Journal Club, Competence committee dates, Academic Coach meetings,

mid year evaluation, etc.

o Assessment tools

• Current or old curriculum maps

7January 8, 2021

cbmepg.mcmaster.ca

Direct MappingMedical Oncology Residency Program

Function: List of EPAs from each CBD Stage matched to all block rotationsTarget Stakeholders: PD and Residency Office, Accreditation

cbmepg.mcmaster.ca

Reverse Mapping Internal Medicine Residency Program

Function: Each block rotation lists attainable/target EPAs, other learning experiences and assessment toolsTarget Stakeholders: Resident, Supervising Attending, PD and Residency office, Accreditation

cbmepg.mcmaster.ca

Summary Map: Year at a GlanceMedical Oncology Residency Program

Function: A calendar of all learning activities for each cohort by PG Year, CanMEDS Competencies & Assessment tools aligned

Target Stakeholders: Resident, PD and Residency office, Accreditation

cbmepg.mcmaster.ca

Summary Map: CBD Stage-at-a-GlanceInternal Medicine Residency Program

Function: A calendar of all learning activities for each CBD stage. CanMEDS-based Competencies and Assessment tools aligned

Target Stakeholders: Resident, PD and residency office, Accreditation

CBME Stage Block

Rotations

Other

Training

Experiences

Linked

EPAs

CanMEDS

Roles

CanMEDS

Enabling

Competencies

Assessment

Tools

Foundations

of Discipline

Orientation/Bo

ot Camp

(sessional)

EPA - 3 Medical Expert

Collaborator

Scholar

Professional

ME - 1.4.13.1.1,

1.4.13.1.4

COLL – 1

SCL - 1

PRO – 4

Attendance

Form 2

CTU (2 blocks) EPA - 1, 2,

3

Medical Expert

Communicator

Collaborator

Professional

ME – 1.0, 1.1, 1.2, 1.4,

2.1.1, 2.2.13, 2.3, 3.4.2,

4.1

COM – 5.2

COLL – 1.2.2

LDR – 1.2

SCL – 2.4, 3, 4.4.1

PRO – 4.1

Form 1, 2

ITAR

MSF

cbmepg.mcmaster.ca

Putting It All Together

Workshop (September 2020) – focus on Curriculum Mapping foundation

Today’s Workshop – Adding Assessment tools to complete Curriculum Mapping

12January 8, 2021

Reverse MapDirect Map

Review Competencies/OTR

Organize: Select best

summary map(s)

Assign Assessment Tools

Summary Map

CBD Stage at a GlanceSummary Map

Year at a Glance

List all Rotations and Other Learning

ActivitiesReview EPAs

cbmepg.mcmaster.ca

Breakout Session

Plugging

Assessment

Skills into

Summary Maps

13January 8, 2021

Building on

Existing

Documents

cbmepg.mcmaster.ca

Wrap Up

Follow Up?

14January 8, 2021

Q & A

cbmepg.mcmaster.ca

How Should We Do It? Should Assessment Drive Learning?

15January 8, 2021

CanMEDS

Enabling

Competencies

Use literature, CQI,

focus groups, resident

feedback when

choosing assessment

tools

Plug in clinical

rotations and

other training

experiences

cbmepg.mcmaster.ca

Four Fundamental Maps

16January 8, 2021

Map Function Target Stakeholder

Direct Mapping List of EPAs from each CBD

stage matched to all block

rotations

1. PD and residency office

2. Accreditation

Reverse Mapping

Each block rotation lists

attainable/target EPAs, other

learning experiences and

assessment tools

1. Resident – navigation tool for each rotation

2. Supervising attending – guide for learning

plan

3. PD and residency office

4. Accreditation

Summary Map

Year at a Glance

A calendar of all learning

activities for each

resident/cohort for each PG

year.

CanMEDS/Competencies and

Assessment tools aligned

1. Resident – navigation tool for each PG year

2. PD and residency office

3. Accreditation

Summary Map

CBD Stage at a

Glance

A calendar of all learning

activities for each CBD stage.

CanMEDS/Competencies and

Assessment tools aligned

1. Resident – navigation tool for each CBD

stage

2. PD and residency office

3. Accreditation

cbmepg.mcmaster.ca

Click to edit

Master title

style

January 8, 2021 17

Thank you!