vr to transform medicine
TRANSCRIPT
How VR and AR Technology Will Transform Healthcare
Walter Greenleaf, PhD
Transforming HealthCare with Technology
Digital Health Revolution
Mobile Health / eHealth Wearable Sensors Patient Centered Leverages Internet: social, competitive, collaborative
Everymedicaldevicereinvented
Digital Health Platforms deliver interventions to patients parse data for enhanced decision-making
Dashboards
Physician
Payor
Admin
Wearable sensors
Mobile Backend
User auth
Device mgmt
App provisioning
Restful API
Access codes Messaging
Mail service
Batch/scheduling
Push notification
Analytics
Engagement
RT analytics
Content store
Data tracking
Metrics
Storage Transactional store
Real time event store
Data warehouse
Data store
Infrastructure Log aggregation Monitoring Deployment
agents
SDK
Patient Facing Applications
Assessments
Reminders
Badges
Interventions
Graphics
data
direction
data
access/analysis
Medical Applications of Virtual Reality
Technology
Digital Health Revolution
Current technologies and concepts are founded on more than 30 years of research and development
Recent changes in cost and access make VE affordable
VR tech is currently used for prevention, evaluation, treatment and chronic disease management
After years of validation and use by early adopters - VR technology is poised to move to the mainstream
On the horizon: enhanced, ubiquitous, informative and integrated
Virtual Reality Technology For Medicine
Relevance For The Medical Product Industry
Interactive media and VR technology will significantly impact Medical Care
Prevention and Wellness
Objective Assessments
Improved Adherence
Facilitated Behavior Change
Distributed Care Delivery
Management of Chronic Conditions
Current
technologies and protocols
have benefited from more
than 40 years of research
and development
VR Technology Has Evolved
A Personal Journey …
I starting my research in
VR in 1984
First general purpose and commercially available VR
Systems
Now, after more than 30 years of
research and development…
1984
VR Technology Has Evolved
Facebook Purchases Oculus for $2B!
Virtual Reality Technology On the way to becoming a commodity - available at consumer prices
Now is the time for VRVR technology is now affordable, scalable and accessible to the marketplace. The VR category is attracting interest and investments from major players.
Facebook - Oculus
Samsung - GearVR Sony - Project Morpheus
Microsoft - HoloLens
Now is the time for VR
11.3
16.9
27.3
41.5
56.2
68.0
6.6
9.9
16.1
24.4
33.0
40.0
Best Worst
Year1 Year2 Year3 Year4 Year5 Year6
Initial adoption will be driven through game console, PC gaming and mobile phone bundling Within 3 years, VR will likely be adopted by 15-30 million users
*Based on agent based modeling by Lieberman Research Worldwide
Within 6 years, VR will likely be adopted by 40-70 million users
Virtual Reality To Hit $150 Billion by 2020
Augmented Reality – Adjustable Immersion
MUVE Technology
VOIP
Graphic
Processors
Broadband
Movement Tracking
Algorithms for
NVB
Low Cost Computers
Smart Phones
Tablets
Virtual Environments have progressed to the point of acceptable visual realism, believable real-world physics, and adequate sensory immersion.
The acceptance of computers and technology as part of the clinical process has also progressed
The technology is migrating to medicine – directly and indirectly
Virtual Environment Technology
For example : GTA - $800 million in worldwide sales in its first 24 hours. That was the biggest launch day ever for any piece of entertainment-- any movie, any record, anything at all.
The military simulation and the video game industry is huge: $1.2T 2015 In many ways it exceeds all other forms of entertainment – movies, music
Virtual Kitchen created in 3 hours
Commodity Priced VR Platform Facebook
Sony
Samsung
Apple
Microsoft
LG
Zeiss
Commodity Priced TeleMedicine Platform
Mobile Platform -> TeleMedicine
One Example – Telemedicine for Anxiety Disorders
$25 per month!
Medical Applications of Virtual Reality Technology
Although entertainment, social connection and gaming will drive the initial adoption of VR technology, the deepest and most significant market for VR will be in clinical care and in improving health and wellness. The list of clinical interventions made possible by VR is long. VR technology also facilitates clinical assessments and medical training, as well as providing for improved surgical skill training and procedure planning. Personal health and wellness can be improved by using VR to engender better nutrition, promote healthy lifestyles, and to reduce stress and anxiety. As the cost of healthcare rises, VR technology can serve as an effective telemedicine platform to reduce costs of care delivery, and improve clinical efficiency
Academic research has proven Virtual Reality can effectively treat a wide variety of mental health disorders – ranging from addictions to PTSD
MEDICAL APPLICATIONS OF VR
Medical Interventions
Clinical Assessments
Medical Training
Health & Wellness
MEDICAL INTERVENTIONS
• Post Traumatic Stress Disorder
• Physical Therapy and Rehabilitation
• Neurorehabilitaiton - Stroke and Traumatic Brain Injury
• Speech Therapy
• Addictions - Alcohol, Substances of Abuse, Nicotine, Opiates
• Phobias – fear of heights, fear of flying, social phobia
• Obsessive Compulsive Disorder
• Generalized Anxiety Disorder
MEDICAL INTERVENTIONS
• Mood Disorders - Depression
• Mild Cognitive Impairment
• Acute and Chronic Pain
• Autism Spectrum Disorder
• ADHD
• Optical Rehabilitation – Strabismus, Amblyopia
• Resilience Training
• Surgical Planning
DIAGNOSTIC ASSESSMENTS
• Medical Image Review
• Neuropsychological Assessments
• Activities of Daily Living Assessments
• Physical Medicine – OT / PT
• Behavioral Medicine – psychology, psychiatry
MEDICAL TRAINING
Clinical Skill Training
Surgical Skill Training
Interpersonal Skill Training
Use of Equipment and Tools
Team Training - eg: Emergency Department, Surgical Team
Emergency Response Training and Rehearsal
Empathy
HEALTH & WELLNESS• Weight Management
• Cognitive Function Training –
Sequencing, Situational Awareness, Decision Making
• Exercise
• Stress Management
• Disability Solutions
• Addressing Isolation
• Grief Counseling
• Mood and Resilience
Rapidly
becoming the standard for
training…
…and soon to be part of the
standard of care
Surgical Training Preoperative Planning & Image Guided surgery
Virtual Airplane for Fear of Flying
• Patient wears Head-mounted Display – Position Tracker – Covers Entire Field of View – Hears only audio from
earphones (including therapist)
• Sits in Airline Seat
• Simulates – Sitting in plane on runway,
engine on/off – Taxi – Takeoff – Flight in good weather – Flight in bad weather – Landing
PTSD, Phobias, and Anxiety Disorders Exposure-based treatments can be conducted in the safety
and comfort of an office setting Effective tools for treating a variety of clinical problems, in
particular anxiety and addictive disorders Fully immersive environments, with include the use of a
head mounted display, 3D sound, tactile stimulation via shaking platform, and olfactory stimulus are used for PTSD therapy
RISK AVOIDANCE TRAINING
VR for Team Medical Procedure Training
Build physician empathy for patients receiving
difficult diagnoses
Preparation and Training for Difficult Situations
Stress Inoculation – Risk Preparation
Virtual hospital tours could be used to relieve pre-procedure anxiety
VR for Stroke and TBI Rehabilitation
$7.5M Series A
$100M Investment At $1B Valuation
Support Meetings Anonymous And Confidential
New Approaches for Cognitive Assessment
RESET Digitized Neurocognitive Tool Set
RESET aims to restore cognitive skills to improve quality of life and enhance duty performance following mild traumatic brain injury. This product evolves traditional paper and automated evaluations to a more sophisticated level, ultimately reducing costs and improving care. It also produces a robust intervention that challenges cognitive skills.
Virtual Humans For Training, Confidential Interaction, and Telemedicine Support
Sensely: Autonomous System to Monitor and Support Patients
Drug and alcohol abuse
Schizophrenia
Post-traumatic stress disorder (PTSD)
Depression and Mood Disorders
Generalized Anxiety Disorder
Acute and Chronic Pain
Depression and Mood Disorders
ADHD
Virtual environments are used clinically to treat several important behavioral health problems
Phobia and anxiety disorders
Obsessive Compulsive Disorder (OCD)
Developmental disabilities
Conduct disorders
Anger management
Eating disorders
Impulsive disorders
Learning disabilities
Neuro-cognitive disorders
Virtual environments are used clinically to treat several important behavioral health problems
Neuroscience Rationale
It is necessary to activate the associated brain system to enable neuro-plasticity
It is critical to engage the brain's reward systems
Repetition is required
Attention drives Cholinergic system Novelty drives Noradrenergic/Serotonergic system
Reward drives Dopaminergic system
Abilitytochangea7tudesandbehaviora<er“being”one’sfutureself.
Leveraging Mirror Neurons
Your Future Self
Students interacted with 3-D avatars of future self.
Asked to allocate $1K between present expenses, a fun splurge, checking account, & retirement account.
Participants who interacted with future self put more than twice as much money into retirement account.
Successful Intervention Depends On Adherence
Build Empathy for Underserved Populations
VR can increase conservation behaviors.
“Short and long-term effects of embodied experiences in immersive virtual environments on environmental locus of control and behavior” Ahn, Bailenson et al
VR can be used to help train doctors and staff to better understand the patient perspective.
“Virtual Experiences for Social Perspective Taking” Raij et al., University of Florida
Big Data Opportunity
Objective data Behavior and activities Linked to intervention Population trends
Improved Assessments and Diagnostics
Addressing Isolation and Loneliness
Acute and Chronic Pain
Depression and Anxiety Disorders
Physical and NeuroRehabilitation
Design for Disabilities
Post-Discharge Follow-up
Staff Training - not just procedures, but empathy
Virtual Environments and Senior Care
Rendever Health Project
Entertainment Therapy
Family Connectivity
Employee Training
Designed to expand senior living residents’ worlds by
offering immersive…
Travel experiences Bucket list items Family moments Cultural events
Relaxation Memory lane
Live events Educational simulations
Therapy programs Anti-anxiety
Virtual reality systems and 360 video can be used provide mental stimulation, recreation, education, and address isolation
Virtual reality systems and 360 video can be used provide mental stimulation, recreation, education, and address isolation
Virtual Environments for ADL Assessment
Current technologies and concepts are founded on more than 30 years of research and development
Recent changes in cost and access make VE affordable
VR tech is currently used for prevention, evaluation, treatment and chronic disease management
After years of validation and use by early adopters - VR technology is poised to move to the mainstream
On the horizon: enhanced, ubiquitous, informative and integrated
Virtual Reality Technology For Medicine
