jon d. duke, md nlm medical informatics fellow regenstrief institute indiana university
DESCRIPTION
Illuminating the Fine Print: Visualizing Medication Side-Effects in Complex Multi-drug Regimens. Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University. The QuARK Project. Quantitative Adverse R eaction Knowledgebase. The Tao of QuARK. The Concept - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/1.jpg)
Illuminating the Fine Print: Visualizing Medication Side-Effects in Complex Multi-drug
Regimens
Jon D. Duke, MDNLM Medical Informatics Fellow
Regenstrief InstituteIndiana University
![Page 2: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/2.jpg)
The QuARK Project
Quantitative Adverse Reaction Knowledgebase
![Page 3: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/3.jpg)
The Tao of QuARK
• The Concept• Building the
Knowledgebase• Clinical Applications• Testing the Model• Future Directions and
Research
QuARK: Quantitative Adverse Reactions Knowledgebase
![Page 4: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/4.jpg)
Part I:The Concept
![Page 5: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/5.jpg)
The primary goal of QuARK is to simplify the process of assessing
adverse drug reactions in patients taking multiple medications.
QuARK: What is it good for?
QuARK: Quantitative Adverse Reactions Knowledgebase
![Page 6: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/6.jpg)
Polypharmacy
![Page 7: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/7.jpg)
Polypharmacy
Kaufman DW, Kelly JP, Rosenberg L, Anderson TE, Mitchell AA. Recent patterns of medication use in the ambulatory adult population of the United States: the Slone survey. JAMA 2002;287: 337-44.
![Page 8: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/8.jpg)
Polypharmacy
• Has increased significantly over past 20 years• Increases risk for adverse drug reactions• Known risk factor for overall morbidity and
mortality• Estimated cost $76B annually
1. Hajjar ER, Cafiero AC, Hanlon JT. Polypharmacy in elderly patients. Am J Geriatr Pharmacother 2007;5: 345-51.2. Nguyen JK, Fouts MM, Kotabe SE, Lo E. Polypharmacy as a risk factor for adverse drug reactions in geriatric nursing home residents. Am J Geriatr Pharmacother 2006;4: 36-41.3. Tam-McDevitt J. Polypharmacy, Aging, and Cancer: Growing Risks. Oncology 2008;9.
1
2
1
3
![Page 9: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/9.jpg)
Side-Effect Complexity
![Page 10: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/10.jpg)
Number of Drugs SE ComplexityX
Physician Time
= The Problem
![Page 11: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/11.jpg)
Side-Effects Interactions
![Page 12: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/12.jpg)
Current Solutions
![Page 13: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/13.jpg)
Goals
• Look up multiple medications simultaneously• Rapidly get to side-effect of interest• Show the relative strength of association
between a drug and its side-effects• Well-integrated into clinical workflow
![Page 14: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/14.jpg)
Origins of QuARK
![Page 15: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/15.jpg)
Hmmmmm….
Zocor
Metformin
Norvasc
Lisinoprol/HCTZ
Azithromycin
Nausea Dizziness Edema Fatigue Cough Palpitations
![Page 16: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/16.jpg)
Part II:Building the Knowledgebase
![Page 17: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/17.jpg)
Which Medications to Include?
• By prescribing volume• By formulary
QuARK
Wishard Top 500Clarian Top 500U.S. Top 300
![Page 18: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/18.jpg)
Coding the Medications
• RxNorm• UNI• NDC• Regenstrief Dictionary
QuARK
RI Dictionary
RxNorm
![Page 19: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/19.jpg)
Sources of Adverse Reaction Data
• FDA Label• MedWatch / AERS• Clinical Repository (eg. RMRS)• Social Networks (eg. patientslikeme.com)
QuARK
FDA Label
![Page 20: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/20.jpg)
Coding the Side-Effects
• MedDRA• CTCAE• SNOMED-CT• ICD-9• UMLS CUI
QuARK
MedDRA
UMLS CUI
SNOMED-CT
![Page 21: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/21.jpg)
Which Side-Effects to Include?
Must select a single unique representation of each
medication / side-effect pair
![Page 22: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/22.jpg)
Which Side-Effect Data to Include?
• Which treatment indication?• Which dose?• Which trial duration?• Pre- / Post-marketing data?
QuARK
Most common indication preferred
Aggregate dosedata preferred, otherwise mostcommon dose
Larger trials withlonger durationpreferred
If duplicate data:
Post-marketingdata included ifnot present in trials
![Page 23: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/23.jpg)
Side-Effect Quantification
The assignment of a numeric score to represent the relative frequency at which a particular medication causes a particular side-effect.
![Page 24: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/24.jpg)
Types of Frequency Data
• Drug vs Placebo– 34% of Neurontin patients experienced nausea vs 12% of
placebo patients• Frequency Range
– Between 3% and 9% of patients taking Lipitor experienced dizziness
• Qualitative Frequency Descriptor– Diarrhea occurred infrequently in patients taking Lisinopril
• Statement of Occurrence– Thrombocytopenia was reported in patients taking Norvasc.
![Page 25: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/25.jpg)
Drug vs Placebo
• Optimal data format• Applied “Absolute Risk
Reduction” approach (ie. treatment incidence – placebo incidence)
• ex. Score = 34 - 12 = 22• Database would include both the
original raw data in addition to the calculated score
QuARK
Drug vs Placebo
Score =
Treatment Incidence
-Placebo
Incidence
eg. 34% of Neurontin pts experienced nausea vs 12% of placebo pts
![Page 26: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/26.jpg)
Frequency Range
• No placebo data given• Study size and duration not
available• Patient population unknown• Conservative score calculation:
Score = x+(y-x)/3 = 3+(9-3)/3 = 5• Original data range preserved in
database
QuARK
eg. Between 3% and 9% of Lipitor patients experienced dizziness
Frequency RangeScoring
Between X% and Y% of patients taking {drug} experienced
{effect}
Score =X+(Y-X)/3
![Page 27: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/27.jpg)
Qualitative Frequency Descriptor
• No placebo or population data• Wide range of terms used (eg. rarely,
occasionally, often)• Quantitative mappings may be
provided (Rarely = “< 1/100”)• Where mappings unavailable,
conservative scores assigned based on interpretation of terms (sometimes = occasionally > infrequently)
QuARK
eg. Diarrhea occurred infrequently in patients taking Lisinopril
QualitativeScoring
Occasionally 0.75Infrequently 0.5Rarely 0.3
![Page 28: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/28.jpg)
Statement of Occurrence
• No frequency information• No placebo or population data• Commonly seen with post-
marketing reports or class effects
• Conservative scoring applied• “Post-Marketing” status noted
in database
QuARK
eg. Thrombocytopenia was reported in patients taking Norvasc.
OccurrenceScoring
Occurs in drug 0.8
Occurs in class 0.7
Occurs more often in placebo 0.1
![Page 29: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/29.jpg)
RI Term IngredientName Effect Drug Placebo Score Code18175 Sertraline HCl Nausea 25 11 14 CALC18175 Sertraline HCl Ejaculation Disorders 14 1 13 CALC18175 Sertraline HCl Diarrhea 20 10 10 CALC18175 Sertraline HCl Insomnia 21 11 10 CALC18175 Sertraline HCl Dry Mouth 14 8 6 CALC18175 Sertraline HCl Nervousness 6 0 6 CALC18175 Sertraline HCl Somnolence 13 7 6 CALC18175 Sertraline HCl Tremor 8 2 6 CALC18175 Sertraline HCl Dizziness 12 7 5 CALC18175 Sertraline HCl Fatigue 12 7 5 CALC18175 Sertraline HCl Dyspepsia 8 4 4 CALC18175 Sertraline HCl Decreased Libido 6 2 4 CALC18175 Sertraline HCl Anorexia 6 2 4 CALC18175 Sertraline HCl Flatulence 3 0 3 CALC18175 Sertraline HCl Paresthesias 3 0 3 CALC18175 Sertraline HCl Vomiting 4 2 2 CALC18175 Sertraline HCl Suicidal Ideation 4 2 2 CALC18175 Sertraline HCl Flushing 2 0 2 CALC18175 Sertraline HCl Headache 25 23 2 CALC18175 Sertraline HCl Agitation 5 3 2 CALC
![Page 30: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/30.jpg)
QuARK Part III:Applications
![Page 31: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/31.jpg)
Rxplore
• Interactive visualization of QuARK data• Allows quick retrieval of most common side-
effects of complex drug regimens• Highlights potential causal agents in the
setting of an adverse drug event• Allows “virtual swapping” of a medication to
assess impact on patient’s side-effect profile
![Page 32: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/32.jpg)
![Page 33: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/33.jpg)
QuARK & Gopher
• Goal: Allow QuARK visualizations to be retrieved directly from Gopher order entry
• Created prototype running on Gopher Dev • Auto-populates medication list directly from
Gopher patient chart
![Page 34: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/34.jpg)
![Page 35: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/35.jpg)
![Page 37: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/37.jpg)
Medication Heat MapAdverse Effects by Organ System Dizziness 24% vs 3%
Headache 11% vs 2%Insomnia 6% vs 3%
Highly Affected
Minimally Affected
Diazepam
![Page 38: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/38.jpg)
QuARK & Clinical Reminders
• Chief Complaint-driven• Trigger Event-driven
![Page 39: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/39.jpg)
QuARK & Clinical Reminders
• Chief Complaint-driven– Which of a patient’s medications are associated
with the Chief Complaint?– At what frequency?“ The patient’s complaint of Dizziness has been
associated with use of:Gabapentin (28% vs. 7% Placebo)Atenolol (13% vs 6% Placebo)Omeprazole (Less than 1%) ”
![Page 40: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/40.jpg)
QuARK & Clinical Reminders
• Trigger Event-driven– Laboratory / EKG change generates reminder– Offers suggestions for possible causal agents“ Neutropenia (WBC 1.4 10/22/08) has been associated with use of:
Valsartan (1.9% vs 0.8% placebo) Amiodarone (Has been reported) Lisinopril (Occurs rarely) ”
![Page 41: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/41.jpg)
QuARK Part IV:Testing the Model
![Page 42: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/42.jpg)
Garbage In / Garbage Out?
• Limitations of the Data• Algorithmic Considerations• Does a Gold Standard exist?• An Approach to Validation
![Page 43: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/43.jpg)
Comparison with AERS
• Adverse Event Reporting System• Captures over 400,000 reports a year• Allows for listing of multiple medications• Records Adverse Reaction and Suspected
Cause• Subset includes “Dechallenge” Data
![Page 44: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/44.jpg)
QuARK vs AERS
• Dechallenge data from 2008 Q2• Evaluated reports of four common reactions
(nausea, edema, insomnia, hyponatremia )• Limited to cases where patient was taking at
least 5 medications• Compared the QuARK “suspected drug” with
actual reported cause
![Page 45: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/45.jpg)
Nausea Edema Insomnia Hyponatremia0
10
20
30
40
50
60
70
80
90
Exact MatchTop Two%
Acc
urac
y
Reported Adverse Reaction
Accuracy of QuARK Ranking for AERS Reports Q2 2008
n=31 n=21 n=14 n=25
![Page 46: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/46.jpg)
Sources of Error
• <10% missed cases due to algorithm error• >90% missed cases due to complete absence
of the adverse reaction from the drug label• Delays in drug label updating• Reflects nature of adverse event reporting– Known side-effects often not reported– New drug mandatory reporting predominates
AERS
![Page 47: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/47.jpg)
QuARK Part V:Future Directions and Research
![Page 48: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/48.jpg)
Evaluation Studies
• Laboratory study of “decision velocity”• Survey of User Satisfaction / Efficiency
![Page 49: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/49.jpg)
Clinical Reminder Study
• Generate QuARK-based reminders for laboratory triggers (eg. LFT’s)
• Intervention group receives reminder noting potential causal agents / frequency data
• Compare drug discontinuation rates as well as time between trigger and discontinuation
![Page 50: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/50.jpg)
Build a Better QuARK
• Additional medications• Expansion of AERS-QuARK analysis• Optimization of scoring algorithm• Additional visualization methods• Potential use in consumer health
![Page 51: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/51.jpg)
Summary
• QuARK is a knowledgebase containing quantitative frequency data for adverse drug reactions
• Potential applications include:– visualization of side-effect data– simplified lookup of multidrug regimens – clinical reminders targeted at adverse drug events
• Opportunities for research collaboration
![Page 52: Jon D. Duke, MD NLM Medical Informatics Fellow Regenstrief Institute Indiana University](https://reader035.vdocument.in/reader035/viewer/2022081505/568166b3550346895ddab4c5/html5/thumbnails/52.jpg)
Thanks!
NLM, Steve Downs, Mike McCoy, Marc Overhage, Shaun Grannis, Gunther Schadow, Siu Hui, Martin Were, Marc Rosenmann, Linas Simonatis, Atif Zafar, Paul Dexter, Mike Weiner, Paul Biondich, Burke Mamlin, Anne Belsito
Pop the QuARK!