reenvisioningthe ehr with a virtual assistant
TRANSCRIPT
![Page 1: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/1.jpg)
Reenvisioning the EHR with a Virtual Assistant
1
Clinical Director HealthIT, Vanderbilt University Medical CenterDepartment of Biomedical Informatics
Yaa Kumah-Crys ta l, MD MS MPH
DISCLAIMER: The views and opinions expressed in this presentation are those of the author and do not necessarily represent official policy or position of HIMSS.
AMDIS August 9, 2021
![Page 2: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/2.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Conflict of Interest
• Yaa Kumah-Crystal MD, MPH
• Discloses the following relevant relationship with commercial interests:
• Research partnership with Nuance Communications
• Use of NLP libraries for research and development
![Page 3: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/3.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Agenda
• What has this year taught us?
• Why do we have a love hate relationship with our technology?
• How does this impact our ability to care for our patients?
• What in the world can we do?
3
![Page 4: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/4.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Learning Objectives • Discuss the value of Artificial Intelligent (AI)-enabled natural language processing and
understanding technologies in the advancement of healthcare delivery
• Describe a framework for the usability design considerations, information request mapping, and artificial intelligence/natural language understanding platform that can be built to process voice requests
• Discuss the implementation considerations for the incorporation of voice user interfaces in a health care setting
• Create a vision for the future of patient-physician interactions where your principal technologies are delightfully reliable, intuitive, and intelligent; they naturally become a trusted partner in patient care
4
![Page 5: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/5.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 6: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/6.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 7: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/7.jpg)
77
“Unprecedented Times”
![Page 8: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/8.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21 8
![Page 9: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/9.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21 9
U Miami
![Page 10: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/10.jpg)
10
![Page 11: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/11.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Deus ex machina
• Latin: “god from the machine”
11
![Page 12: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/12.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Technology
12
![Page 13: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/13.jpg)
1313
1995
![Page 14: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/14.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Love-Hate Relationship With Technology
![Page 15: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/15.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Technology
![Page 16: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/16.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Practical Purpose• “Practical” can be subjective
• Enable• Ability to accomplish a task with greater efficiency
• Empower• Ability to discover new solutions and approaches
![Page 17: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/17.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Practical Purpose: Calculations
• Long Division
23.16666666
![Page 18: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/18.jpg)
Reenvisioning the EHR with a Virtual Assistant
161
![Page 19: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/19.jpg)
Reenvisioning the EHR with a Virtual Assistant
making items represented resemble their real-world counterparts
![Page 20: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/20.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21 20
![Page 21: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/21.jpg)
Reenvisioning the EHR with a Virtual Assistant
Ability to accomplish a task with greater efficiency
![Page 22: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/22.jpg)
Reenvisioning the EHR with a Virtual Assistant
EHR + Skeuomorphism
![Page 23: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/23.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 24: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/24.jpg)
Reenvisioning the EHR with a Virtual Assistant
Chart Review
![Page 25: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/25.jpg)
Reenvisioning the EHR with a Virtual Assistant
Chart Review
Labs
![Page 26: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/26.jpg)
Reenvisioning the EHR with a Virtual Assistant
Chart Review
Labs
![Page 27: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/27.jpg)
Reenvisioning the EHR with a Virtual Assistant
Chart Review
Labs
![Page 28: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/28.jpg)
Reenvisioning the EHR with a Virtual Assistant
Chart Review
Labs
![Page 29: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/29.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 30: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/30.jpg)
Reenvisioning the EHR with a Virtual Assistant
wading through a river of content
![Page 31: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/31.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 32: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/32.jpg)
Reenvisioning the EHR with a Virtual Assistant
“Top of Their Ladder”
![Page 33: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/33.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 34: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/34.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Under The Hood
![Page 35: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/35.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
VEVA Processing
NLP
User Query
Speech to text
Intent Fulfillment Text to speech
Results Display
What is her A1C?
Sally’s A1C is 8.6
![Page 36: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/36.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 37: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/37.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 38: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/38.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
NLP Limita t ions• Humans do not speak like text
• Fragmented, disorganized• Hesitations, corrections, repetitions
• Backchannel noises• Manage turn-taking in conversation
• uh vs uh-huh
![Page 39: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/39.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
NLU Context
“I ran out”
I didn’t take my medication because I ran outI ran out of house and twisted my ankle
![Page 40: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/40.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
How
![Page 41: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/41.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
From Data to Insight• Data ➨ Insight
• Data: Unstructured elements
• Information: Organized and contextualized to convey something specific
• Knowledge: a deeper level of understanding rooted in competence and framework for incorporating new information
• Wisdom: the ability to discern and judge which aspects of that knowledge are true, right, lasting, and applicable to your life
Medical Student
Resident
Fellow
Attending
K= 5.7K= 5.7
K= 5.7Glucose 586
DKA
![Page 42: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/42.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Insight
![Page 43: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/43.jpg)
Reenvisioning the EHR with a Virtual Assistant
There a re two kinds of people in this world.
Thos e who can ext rapola te from incomplete da ta .
![Page 44: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/44.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Problem Solving
![Page 45: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/45.jpg)
I could have sworn we drew a hematocrit last
time
He’s been staring at the screen for a while… am I ok?
![Page 46: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/46.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 47: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/47.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
“The reasonable man
adapts himself to the world.
The unreasonable man persists in
trying to adapt the world to himself.
Therefore all progress depends on the
unreasonable man.”
― George Bernard Shaw
![Page 48: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/48.jpg)
Call to action to The Unreasonable Man
See systems where they don’t exist
![Page 49: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/49.jpg)
Reenvisioning the EHR with a Virtual Assistant
#HIMSS21
Covey these systems into existence
![Page 50: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/50.jpg)
Vision Current State
![Page 51: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/51.jpg)
Reenvisioning the EHR with a Virtual Assistant
![Page 52: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/52.jpg)
Flight Path for Health
![Page 53: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/53.jpg)
It looks like you have a question.
Yes Go away Clippy!
Questions
![Page 54: Reenvisioningthe EHR with a Virtual Assistant](https://reader031.vdocument.in/reader031/viewer/2022012205/61de577803cf07305148bacb/html5/thumbnails/54.jpg)
Reenvisioning the EHR with a Virtual Assistant Contact