dr. watson – a promising student in pursuit of smarter medicine
DESCRIPTION
Dr. Watson – A Promising Student in Pursuit of Smarter Medicine. Eliot Siegel, M.D. Professor and Vice Chair University of Maryland Department of Diagnostic Radiology. Introduction. Thanks for opportunity to participate in this session - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/1.jpg)
1
Eliot Siegel, M.D.Professor and Vice Chair University of
Maryland Department of Diagnostic Radiology
Dr. Watson – A Promising Student in Pursuit of Smarter
Medicine
![Page 2: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/2.jpg)
2
Thanks for opportunity to participate in this session
Cannot think of many “Grander” Challenges than the renaissance of research and applications of “artificial” or computational intelligence in medicineAttempts in the past for a large scale system
have met with very limited success and are not in use in medicine today
The potential for these systems if we can overcome the roadblocks and barriers are enormous
Introduction
![Page 3: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/3.jpg)
3
Mycin- StanfordDoctoral dissertation of Edward Shortliffe designed to
identify bacterial etiology in patients with sepsis and meningitis and to recommend antibiotics
Had simple inference engine and knowledge base of 600 rules
Proposed acceptable therapy in 69% of cases which was better than most ID experts
Never actually used in practice largely due to lack of access and time for physician entry >30 minutes
Caduceus – similar inference engine to Mycin and based on Harry Pope from U of Pittsburgh’s interviews with Dr. Jack Myers with database of up to 1,000 diseases
Previous Attempts at Artificial Intelligence in Medicine
![Page 4: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/4.jpg)
4
Internist I and II – Covered 70-80% of possible diagnoses in internal medicine, also based on Jack Myers’ expertise
Worked best on only single diseaseLong training and unwieldy interface took 30
to 90 minutes to interact with systemWas succeeded by “Quick Medical Reference”
which was discontinued ten years ago and evolved into more of a reference system than diagnostic system
Previous Attempts at Artificial Intelligence in Medicine
![Page 5: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/5.jpg)
5
Initially had opportunity to visit IBM team about a year and a half ago
Engaged Jeopardy team and discussed the potential for medical applications as next steps after Jeopardy Challenge
Began initial research with IBM approximately one year ago
Current grant with IBM for initial exploratory work with physician helping team to understand the medical domain and challenges
Worked together on deeper understanding of the medical domain using multiple resources
Dr. Watson Overview and History
![Page 6: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/6.jpg)
6
Visit to University of Maryland and the VA to see EMR and demonstration and discussion of the EMR
Application for NIH Transformative Research Awards T-R01NIH Common Fund for collaboration and
exceptionally high impact, trans-NIH programs Designed to pursue major opportunities and
gaps in biomedical research that no single NIH institute could tackle alone
![Page 7: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/7.jpg)
7
Although we are collaborators and have been working together on the project, my vision and what IBM does may be very different
Disclaimer
![Page 8: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/8.jpg)
8
Want 3 components similar to medical students educationBook knowledgeSim Human ModelExperiential learning from actual EMR
Taking Watson to Medical School
![Page 9: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/9.jpg)
9
Textbook, journal, and Internet resource knowledge. Quiz materials
Like medical student this alone not enough don’t want to make hypochondriac
Book Learning
![Page 10: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/10.jpg)
10
Continue to develop medical knowledge databaseHarrison’sMerckCurrent Medical Diagnosis and TreatmentAmerican College of Physicians MedicineStein’s Internal Medicinemedical Knowledge Self Assessment ProgramNLM’s Clinical Question Repository
Advancing Deep Q/A’s Medical Knowledge
![Page 11: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/11.jpg)
11
Use New England Journal of Medicine 130 CPC cases and quiz materialAdditional CPC cases at U of Maryland
Begin developing interactive capability to develop hypotheses and refine them depending on the answer to those questions
Develop a tool that allows for physician feedback to the system for various hypotheses so community can interact and teach Watson
Advancing Deep Q/A’s Medical Knowledge
![Page 12: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/12.jpg)
12
SIM Human model of physiology – work done at the University of Maryland School of Medicine and UMBC by Dr. Bruce Jarrell and colleagues
Want to have understanding from model of physiology
Work has been done to create simulations of disease processes and then observe how it affects other physiology in the body
SIM Human
![Page 13: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/13.jpg)
13
Consumption of electronic medical record which is largely just paper represented digitally, cannot search for “rash” for example
Access to records at U of Maryland and VA but also larger repositories from the VA in de-identified manner
Clinical/Hospital “Experience”
![Page 14: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/14.jpg)
14
Epic system at the University of MarylandVA’s VISTA SystemUniversity of Maryland EPIC system
EMRElectronic version of paper recordsReview large number of discharge summariesReview progress notes and structured and
unstructured additional information from EMR
Electronic Medical Record Challenges and Limitations
![Page 15: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/15.jpg)
15
Patient EMR such as VA’s highly publicized and praised VISTA revealed numerous challenges
IBM and VA Team Review of EMR
![Page 16: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/16.jpg)
16
Not possible to search for a term within or among patient records such as “rash”
Majority of data is unstructured and in free text format
Much of the text in progress notes and other types of notes is highly redundant since interns and residents and attending physicians typically cut and paste information from lab and radiology and other studies and other notes
Information is entered with abbreviations that are not consistent and misspellings
Despite the fact that virtually 100% of patient information is available in the electronic EMR with records going back more than 15 years
![Page 17: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/17.jpg)
17
Patient problem list has no “sheriff” and each physician is free to add “problems” but very few delete them for “problems” that are temporaryThe problem lists themselves often have
contradictory information
Patient Problem List
![Page 18: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/18.jpg)
18
Next Steps for Dr. Watson After Medical School
![Page 19: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/19.jpg)
19
Ability to search through information in EMRSummarize EMR and provide view into what
is most pertinent about the EMR – as resident might do that in presenting a case to me
Create problem listPerform electronic “chart review” for patient
to evaluate drug interactions, discrepancies with medications and diagnoses, and screen for recommended guidelines such as diabetic patient who has not had retinal exam
Unsupervised or Semi-supervised Summary and Synthesis and Search of The Electronic Medical Record
![Page 20: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/20.jpg)
20
Interactive and chart reviewChart Review
Watson software would take information from patient outpatient chart and/or hospital inpatient chart
May need to utilize a patient health record Increasing trend in medicine toward patient owning their
EMR so that patient information can be centralized and under patient control
Dr. Watson software would recognize and evaluate patient signs and symptoms and history and current symptoms and make one or more diagnoses in a supervised or semi-supervised fashion including assessment of probability of disease
Medical Diagnosis
![Page 21: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/21.jpg)
21
Emergency Department ScenarioRequires “real-time” decision makingCannot use same model with all
information entered into the chart before Watson makes its assessment and recommendations
Need better systems to capture information at point of careVital signs and lab and signal monitoring Do we need additional methods of
inputting data?Do we need to capture live conversations
with providers and patients?
Interactive
![Page 22: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/22.jpg)
22
Need to give ability of physician to interact with Watson in dynamic fashion to allow refinements with ability of both software to ask additional questions and suggest diagnostic studies and ability of physician to refine diagnostic possibilities and to “educate” Watson about additional medical perspectives
Interactive Dynamic Diagnosis
![Page 23: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/23.jpg)
23
Various databases disconnected and not easily accessibleParkinson’s Johns HopkinsLeukemia MD AndersonTCGA- NIH
Unfortunately these are not made available publically and need to have method to discover them and then standard to understand what they contain and their format etc.
Ingestion of Databases
![Page 24: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/24.jpg)
24
Can’t wait for note to be finishedNeed to acquire information structured and
otherwise in real-time in order to help out with decisions unlike oncology scenario where there is more time to review findings
Emergency Department Scenario
![Page 25: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/25.jpg)
25
Previous systems also included suggestions from “expert systems” for treatment options
Given the proper databases it would be possible to tailor the treatment to specific patients to truly “personalize” medical treatment
Treatment Options
![Page 26: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/26.jpg)
26
Is it possible that machines will replace humans in the doctor-patient relationship?
According to a study done by the Mayo Clinic in 2006, the most important characteristics patients feel a good doctor must possess are entirely human
According to the study, the ideal physician is confident, empathetic, humane, personal, forthright, respectful, and thorough
Watson may have proved his cognitive superiority, but can a computer ever be taught these human attributes needed to negotiate through patient fear, anxiety, and confusion? Could such a computer ever come across as sincere?
Teaching Dr. Watson Bedside Manners
![Page 27: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/27.jpg)
27
Demonstration
![Page 28: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/28.jpg)
![Page 29: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/29.jpg)
![Page 30: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/30.jpg)
![Page 31: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/31.jpg)
![Page 32: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/32.jpg)
![Page 33: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/33.jpg)
![Page 34: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/34.jpg)
![Page 35: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/35.jpg)
![Page 36: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/36.jpg)
![Page 37: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/37.jpg)
37
Fundamental differences between challenge to Jeopardy Quiz team and medical applications include:Information may be incorrect or ambiguousMay be more than one diagnosisNeed to take into strong consideration diseases
that are serious and can cause serious harm despite relative probability of that disease as the most likely diagnosis
Conclusion
![Page 38: Dr. Watson – A Promising Student in Pursuit of Smarter Medicine](https://reader036.vdocument.in/reader036/viewer/2022062521/56816935550346895de0926f/html5/thumbnails/38.jpg)
38
The Watson Q/A technology and Jeopardy demonstration have captured the imagination of many people including those in healthcare and this may provide a critical springboard to revive many of the excellent initiatives on artificial intelligence applications in medicine
The potential of these to revolutionize medicine is tremendous and exciting