NBOME UPDATE FOR SOMAOMED 2020 | October 17, 2020

John R. Gimpel, DO, MEd, President & CEO

PROTECTING THE PUBLIC BY

PROVIDING THE MEANS TO ASSESS

COMPETENCIES FOR OSTEOPATHIC

MEDICINE AND RELATED HEALTH

CARE PROFESSIONS SINCE 1934.

2 | www.NBOME.org | © 2019 NBOME

LEADERSHIP

NBOME BOARD OF DIRECTORS 2020

ASSESSMENT ACROSS THE CONTINUUM

NBOME PORTFOLIO

PRACTICELICENSUREEDUCATION

OSTEOPATHICALLY DISTINCTIVE EXAMINATIONSCOMLEX-USA

Blueprint based on practice assessment of osteopathic physicians

Content developed utilizing OPP/OMM

Aligns with curriculum of osteopathic medical education

Assessment aligned in the osteopathic profession

Osteopathic

Board

Certification

COMLEX-USA

COMAT

UME

Assessment/

Evaluation

Osteopathic

Continuous

Certification

/CME

OGME In-

training

examinations

L1

L2CE

L3

L2PE

LEVEL 1One-day computer-based

exam. 400 multiple-

choice test questions

LEVEL 2-CEOne-day computer-based

exam. 352 multiple-choice

test questions

LEVEL 2-PEOne-day 12-station standardized

patient performance evaluation of

fundamental clinical skills

LEVEL 3 Two-day computer-based exam.

420 multiple-choice questions, clinical

decision-making cases, novel test item

formats, including 28+ clinical cases

DO Degree

COMLEX-USA

ASSESSMENT OVERVIEW

…a good example of how medical

examiners can update their assessment

systems to stay ahead of the curve of

change…help medical regulators make

sound, balanced decisions as they

continue their work in protecting the

public and ensuring quality in medical

practice, keeping our patients safe.

October 2018, Journal of Medical Regulation

Heidi M. Koenig, MD, Editor-In-ChiefFederation of State Medical Boards

VALIDITY EVIDENCE FOR COMLEX-USA SUPPORT TO THE VALIDITY ARGUMENT THAT COMLEX-USA PERFORMANCE PROVIDES

USEFUL EARLY INFORMATION ABOUT THE LIKELIHOOD OF LICENSURE ACTIONS.

An Investigation of the Relationship Between COMLEX-USA Licensure

Examination Performance and State Licensing Board Disciplinary Actions.

Roberts, W, Gross, GA, Gimpel, JR, Smith, LL. 2020;95:925-930

Higher COMLEX-USA

Level 2-PE Biomedical /

Biomechanical Domain

scores showed significantly

lower odds in receiving

board action.

…well, throw another shrimp on the Barbie…

COMLEX-USADOWN UNDA’

The Medical Board of Australia

announced Sept 10 that they will

recognize NBOME as a Competent

Authority for US DOs to be

registered for medical practice in

Australia!

NBOME has continued to STUDY THE USES OF COMLEX-USA SCORES AND SCORE-

REPORTING as it relates to the primary and intended purposes of the examinations (i.e.,

licensure), as well as secondary uses (most cited one is in residency program applications.)

Further study related to the use of pass-fail as well as numerical scoring has ensued.

STAKEHOLDER SURVEY JULY-AUGUST 2020.

ORGANIZATIONAL POSITION REQUEST SEPTEMBER 2020.

BOARD DECISION ANTICIPATED IN JANUARY 2021.

COMLEX-USA ANNOUNCEMENT | FEB 2020COMLEX-USA

NEW EXAM ENHANCEMENTSCOMLEX-USA UPDATES

M A Y 2 0 2 1

LEVEL 1 ITEM REDUCTION

400 TO 352 TEST ITEMS

J U N E 2 0 2 0

LEVEL 2-CE ITEM REDUCTION

400 TO 352 TEST ITEMS

Still 8 hours of test administration time. No expected impact on validity or reliability

NEW LICENSURE ATTEMPT LIMITSCOMLEX-USA UPDATES

Most MD-

granting and

DO-granting

medical schools

limit attempts

USMLE moving

to 4 attempt

limits

2021

Concerns

about

misclassification

and test

security

COMLEX-USA

and USMLE

implemented

attempt limit

maximums (6)

Many states

limit attempts

to 3

COMLEX-USA 4-Attempt Limit Effective July 1, 2022

NBOME CONTINUITY THROUGH THE PANDEMIC

TESTING AT PROMETRICCOMLEX-USA LEVELS 1, 2-CE AND 3

87%CLASS OF

2022RECEIVED LEVEL

1 SCORE REPORT

90% CLASS OF 2021RECEIVED LEVEL 2-

CE SCORE REPORT

EXAMS

COMPLETED AS OF OCTOBER 12

19,000+

NBOME CONTINUES

WORKING WITH

THE COMS UPDATES

EACH

WEEK

WEEKLY MONITORING OF TESTING CAPACITY

• Available for student testing Aug through Sept, subject to state and local restrictions

• Over 19,000 tested: worked COM-by-COM to get candidates tested and cared for

SATELLITE TESTING CENTER PARTNERSHIPS

• Reduce urgent needs for testing seats in hard-hit areas

• UNTHSC-TCOM University of North Texas Health Science Center Texas College of Osteopathic Medicine, Fort Worth TX

• MSU-COM Michigan State University College of Osteopathic Medicine, East Lansing MI

“EVENT TESTING”

• Contingency planning for simultaneous testing events at multiple locations if needed

REMOTE PROCTORING

• Active investigations; lessons learned (American Board of Surgery, MCC)

AGILITY IN DELIVERING SAFE TESTINGCOMLEX-USA LEVELS 1, 2-CE AND 3

PLANNED AVAILABILITY NOVEMBER 2020 subject to multiple factors

TRAVEL GUIDELINES at time of resumption

COMPREHENSIVE SAFETY MEASURES with input from local ID specialists and Johns Hopkins University

COMLEX-USA LEVEL 2-PECLINICAL SKILLS TESTING

ENHANCED

CLEANING/S

SANITATION

procedures

CLEAR FACE

MASKS

REQUIRED

HAND

SANITIZERLARGER

CAPACITY

rooms;

HVAC

enhancements

STAGGERED

START;

reduces

candidate

volumes

CONTACT

TRACING

HEALTH

SCREENING

of

candidates

and staff; no

rescheduling

fees

Residency

Applications.

STUDENT CONCERNSCOMLEX-USA LEVEL 2-PE

Safety of Exam

Administration.

Quarantines.

Returning home or

to rotations, etc.

Travel

Safety.

Requirements. FLEXIBILITY.

COCA modified graduation requirement for 2020

and 2021 grads. Link

NCCST TRAVEL ANALYSIS | TOTALSCOMLEX-USA LEVEL 2-PE

of students in the

CLASS OF 2021 are within 8 HOURS

of 1 of the 2 PE sites

[ 4,490 STUDENTS ]

1,770 STUDENTS are within a 4 hour drive

of an NCCST Site

2,720 STUDENTS are within a 8 hour drive

of an NCCST Site

56% 56% 56%

NCCST TRAVEL ANALYSIS | TOTALSCOMLEX-USA LEVEL 2-PE

2,891 STUDENTSare within a 8 hour drive

of an NCCST Site

2,209 STUDENTS

are within a

4 hour drive of an NCCST Site

59% of STUDENTS in the CLASS OF 2021

are within 8 HOURS of 1 of the 3 PE sites

*Temporary site

*

COMLEX-USA | LEVEL 2-PE

FUNDAMENTAL CLINICAL SKILLS ASSESSED

BIOMEDICAL / BIOMECHANICAL DOMAIN

History and

Physical

Exam

Osteopathic

Manipulative

Treatment

SOAP

Note

HUMANISTIC DOMAIN

Physician-Patient

Communication

Interpersonal Skills

Professionalism

CANDIDATE ADVOCACY Your credentials matter …

…WITH PROGRAM DIRECTORS,

COALITION, LICENSING

BOARDS…

ALL AROUND THE WORLD:

Advocating with Program Directors to

understand COMLEX-USA

Notation in PD work station and on

transcripts in ERAS

Through PD Organizations (AOGME

and OPDA; shared with Coalition for

Physician Accountability)

Australia, UK, Canada, Africa…

ROAD TO DO LICENSURE

COMLEX-USA

TOOLBOXES

Collected resources

for each level of

COMLEX-USA

CANDIDATE WELLNESS

Editorial series focused on

candidate mental health

STORIES FROM THE ROAD

Peer-to-peer stories and

advice about COMLEX-USA

MYTHS AND

MISCONCEPTIONS

COMLEX-USA, Single GME

APPLYING TO RESIDENCY

Content focused on SUCCESS

with the UME to GME transition

ON THE COM TRAIL

Info on past and

upcoming visits

TRANSITIONING FROM

MEDICAL SCHOOL (UME) TO

RESIDENCY (GME)

OF PROGRAM DIRECTORS REQUIRE

COMLEX-USA TO SCREEN DO APPLICANTS

UME TO GME

2020 NRMP PROGRAM DIRECTOER SURVEY

86%

When asked for DO applicants, do you require COMLEX-

USA when considering which applicants to interview?

USE LEVEL 1

TARGET RESULTSUSE LEVEL 1

P/F RESULTS

Results of the 2020 NRMP Program Director Survey. https://mk0nrmp3oyqui6wqfm.kinstacdn.com/wp-

content/uploads/2020/08/2020-PD-Survey.pdf Figure 4

45%41%

NRMP MATCH TRENDS 2016-2020

DO SENIOR APPLICANTS & MATCHES

MATCH 2020

DO SENIORS- GME PLACEMENT 2020

NRMP MATCH 2020

SPECIALTY FELLOWSHIP MATCH

PERCENTILE SCORE CONVERTERCOMLEX-USA

COMLEX-USA Level 1 Varies by testing cycle

SCORE PERCENTILE

400 7

450 21

500 42

550 64

600 82

650 92

700 98

Converts standard scores into

percentile scores for Level 1,

Level 2-CE, and Level 3.

The value calculated is the

percentile rank in relation to other

candidates who took a particular

Level examination for the first time,

during the same testing cycle.

Link provided in ERAS for PD use.

DO and MD licensing exams

should be viewed equally. As DO

and MD residency programs

come under the same umbrella

for accreditation, their licensing

exams should carry equal weight.

@AmerMedicalAssn | Twitter | 2019

32 | www.NBOME.org | © 2019 NBOME

#DOProud | #NBOME | #COMLEX-USA / #RoadToDOLicensure

THE END