cognitive errors: how great clinicians reach wrong … errors - trauma...modeled on:croskerry p....

43
JAMIE FOX, MD ASSOC PROFESSOR DEPT OF PEDIATRICS DIV HOSP/EMERG MED Cognitive Errors: How Great Clinicians Reach Wrong Conclusions DAVID GORDON, MD ASSOC PROFESSOR DEPT OF SURGERY DIV EMERG MED March 12 th , 2015

Upload: others

Post on 04-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

JAMIE FOX, MDASSOC PROFESSOR

DEPT OF PEDIATRICS

DIV HOSP/EMERG MED

Cognitive Errors:How Great Clinicians Reach

Wrong Conclusions

DAVID GORDON, MDASSOC PROFESSOR

DEPT OF SURGERY

DIV EMERG MED

March 12th, 2015

Page 2: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Overview of Dx Errors

Dual-Process Theory

Prevention Strategies

Cognitive Biases

Page 3: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Medicine Trauma

Mark Graber, MD

Missed, Delayed, or Wrong Diagnosis

Hardeep Singh, MD

Missed opportunities to make a timely or correct diagnosis

James Reason, PhD

The failure of a planned action to achieve its desired goal

What is Diagnostic Error?

Page 4: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

122,577 patients admitted to six trauma centers

Significant preventable errors in 4% of patients

5.9% preventable or potentially preventable trauma deaths

1,295 total deaths

Davis et al., Journal of Trauma, 1992

An Analysis of Errors Causing Morbidity and Mortality in a Trauma: A Guide for Quality Improvement

Page 5: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of
Page 6: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Phases of Care

Resus

53%

OR

26%

CC

21%

CC

50%

Resus

36%

OR

14%

Errors Preventable Deaths

Page 7: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Failure to appropriately evaluate abdomenMost common

Errors in neurologic resuscitation 33% resuscitative and 12% overall preventable death

Critical Careunrecognized intra-abdominal sepsis, ventilator/pulmonary management, head injury management, hemodynamic monitoring failures

Page 8: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Patterns of Errors Contributing to Trauma MortalityLessons Learned from 2594 Deaths

1996-200444, 401 trauma patient admissions 5.8 % deaths2.5% deaths had contributing errors

Gruen et al., Annals of Surgery, 2006

Page 9: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Major Patterns of Error Contributing to Mortality

Hemorrhage Control

Abdomen/Pelvic (16%)

Intrathoracic (9%)

Airway management (16%)

Inappropriate management of unstable patient (14%)

Lengthy initial operative procedure (8%)

Procedure complication (12%)

Inadequate prophylaxis (11%)

Missed or delayed diagnosis (11%)

Overresuscitation with fluids (5%)

Page 10: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Overview of Dx Errors

Page 11: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

How common is diagnostic error?

DiagnosticError

Error-relatedHarm

Up to 80,000 deaths/year 10 deaths/year

1/1000 outpt encounters 1 diagnostic harm/day

US Your Hospital

Adapted from Dr. Mark Graber’s MD, FACP webinar on 12/3/13: “Preventing Diagnostic Error: Where do I start?” Sponsored by National Patient Safety Foundation

1/20 adult outpt12million adults/yr

Page 12: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Graber M et al. Arch Int Med. 2005;1493.

Page 13: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Graber M et al. Arch Int Med. 2005;1493.

0

20

40

60

80

100

120

140

160

FaultyKnowledge

Faulty DataGathering

FaultySynthesis:

Verification

FaultySynthesis:

InfoProcessing

Cognitive Errors

Page 14: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Overview of Dx Errors

Dual-Process Theory

Page 15: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Dual-Process Reasoning

Deliberate

ConsciousUnconscious

Rapid

METACOGNITI

ON

INTUITION

System 2Analytical

System 1Non-analytical

Quirk M. Intuition and Metacognition inMedical Education: Keys to DevelopingExpertise. 2006.

Page 16: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

System 1: Intuition

NON-ANALYTIC

Relies heavily on EXPERIENCE

PatternRecognition

FAST

“Thinking without thinking” LOW

cognitive load

Page 17: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

System 2: Metacognition

ANALYTIC

Deductive reasoning

Logical

SLOW

“Thinking about one’s own thinking”

HIGHcognitive load

Page 18: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

System 1: Intuition

PITFALLS

Strongly influenced by

ambient conditions

Atypical presentations

Pattern mistaken for something else

Page 19: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

System 2: Metacognition

PITFALL

SLOWIMPRACTICAL

Page 20: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Croskerry P. Acad Med. 2009;84:1022-1028.

DUAL PROCESS THEORY

Page 21: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Overview of Dx Errors

Dual-Process Theory

Cognitive Biases

Page 22: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Biases

Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002 Nov;9(11):1184-204.and Lucey C, Winiger D, Shim R. “Towards a More Effective Morbidity and Mortality Conference” APDIM Spring Meeting, 2004

AnchoringTendency to lock onto initial

impressions or pieces of information early in the decision-making process. Once an anchor is set, it can be difficult to move away from and new information

is interpreted around it

CourthouseDaiquiri

“Uncooperative”

Page 23: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Biases

Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002 Nov;9(11):1184-204.and Lucey C, Winiger D, Shim R. “Towards a More Effective Morbidity and Mortality Conference” APDIM Spring Meeting, 2004

ConfirmationTendency to look for and

weight confirming evidence to support a diagnosis

rather than evidence that refutes it

Attempted to hit nurse“Leave me alone”

Page 24: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Biases

Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002 Nov;9(11):1184-204.and Lucey C, Winiger D, Shim R. “Towards a More Effective Morbidity and Mortality Conference” APDIM Spring Meeting, 2004

Premature closureTendency to shut down the

decision-making process prematurely, accepting a

diagnosis before it has been fully verified

Vomiting and Uncooperative d/t

alcohol consumption

Page 25: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Biases

Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002 Nov;9(11):1184-204.and Lucey C, Winiger D, Shim R. “Towards a More Effective Morbidity and Mortality Conference” APDIM Spring Meeting, 2004

Diagnosis momentumOnce diagnostic labels are attached to patients they

tend to stick

He’s drunk

Page 26: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Biases

Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002 Nov;9(11):1184-204.and Lucey C, Winiger D, Shim R. “Towards a More Effective Morbidity and Mortality Conference” APDIM Spring Meeting, 2004

Availability HeuristicJudge things as being more

likely, or frequently occurring, if they more readily come to mind

Alcohol as opposed to head bleed as cause of

vomiting

Page 27: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Biases

Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002 Nov;9(11):1184-204.and Lucey C, Winiger D, Shim R. “Towards a More Effective Morbidity and Mortality Conference” APDIM Spring Meeting, 2004

Gambler’s fallacyThe belief that if a coin is

tossed ten times and is heads each time, the 11th

toss has a greater chance of being tails

“We can’t have 3 kids w/ appy in 1 shift”

Page 28: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Bias

Overattachment

Alternative/

2nd Diagnosis

Inherited

Thinking

Prevalence/

Estimation

Patient

Context

Physician

Attributes

Campbell SG, Croskerry P, and Bond WF. Acad Emerg Med. 2007; 14:743-749.

CATEGORIES

Page 29: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Overview of Dx Errors

Dual-Process Theory

Prevention Strategies

Cognitive Biases

Page 30: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

CHECKLISTS/PROTOCOLS

Gruen et al., Annals of Surgery, 2006

Page 31: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Cognitive Debiasing Strategies

Mental strategies to avoid cognitive error

Forced Thinking

Page 32: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

THE DIAGNOSTIC TIME OUT

Page 33: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Forced Thinking

What else could it be?

Is there anything that doesn’t fit?

Is it possible that I have more than one problem?

Page 34: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

• Adequacy• Are all the patient's findings

(abnormal or normal) accounted for by the diagnostic hypothesis?

Have I explained all the patient’s findings?

• Coherency• Is the diagnostic hypothesis

pathophysiologically consistent with all the clinical findings?

Is there a non-fit?

Diagnostic VerificationCriteria of Validity

Page 35: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Life ThreatsAdequacyConsistency/CoherencyElse (What else could it be?)

Second Problem

Page 36: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Unexplained Symptom(s)

Return visit

At-risk patient population

Critical condition

End of shift

When should we take a time out?

Page 37: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of
Page 38: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Milestones

RAPID SEQUENCE

INTUBATION FIBRINOLYTICFOR ACUTE MI

TX TIMES FOR INVASIVE

INFECTIONS

“NOT YETDIAGNOSED”

Page 39: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Admission Tags

CHEST PAIN – NYD

Not YetDiagnosed SHORTNESS OF

BREATH – TPD

Trying to Prevent Death

VOMITING – PD

Parental Distress

Page 40: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

FEEDBACK LOOP

Page 41: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

“Closing the Loop”

Patient

ED

Night Float

Team

Page 42: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Epidemiology

Classification

FUTUREDIRECTIONS

Challenges

Page 43: Cognitive Errors: How Great Clinicians Reach Wrong … Errors - TRAUMA...Modeled on:Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of

Selected References

1. Berenson RA et al. “Placing Diagnosis Errors on the Policy Agenda.” 2014. http://www.urban.org/UploadedPDF/413104-Placing-Diagnosis-Errors-on-the-Policy-Agenda.pdf (Accessed July 29, 2014)

2. Berner ES and ML Graber. Overconfidence as a cause of diagnostic error in medicine. Am J Med. 2008;121:S2-S23.

3. Crandall B and RL Wears. Expanding Perspectives on Misdiagnosis. Am J Med. 2008;121:S30-33.

4. Graber ML et al. Diagnostic Error in Internal Medicine. Arch Int Med. 2005;165:1493.

5. Graber ML. Taking steps towards a safer future: measures to promote timely and accurate medical diagnosis. Am J Med. 2008;121:S43-46.

6. Schiff GD. Minimizing Diagnostic Error: The Importance of Follow-up and Feedback. Am J Med. 2008;121:S38-42.

7. Davis JW et al. An Analysis of Errors Causing Morbidity and Mortality in a Trauma System: A Guide for Quality Improvement. J Trauma 1992;32:660-666.

8. Gruen RL et al. Patterns of Errors Contributing to Trauma Mortality. Lessons Learned From 2594 Deaths. Ann Surg. 2006;244:371-380.