human interface technology lab medical applications of vr suzanne weghorst human interface...

human interface technology lab

Medical Applications of VR

Suzanne Weghorst

Human Interface Technology Lab

University of Washington

human interface technology lab

HIT Lab Medical Projects

• broad spectrum of medical applications• tools for clinical practice• medical informatics• therapeutic VR/AR• surgical simulation

• www.hitl.washington.edu

• Medicine Meets VR (www.amainc.com)

human interface technology lab

Virtual Retinal Display

• high resolution• bright enough for see-

through display• small “exit pupil”

produces long depth of focus

human interface technology lab

Optical Tools for Medicine

• True 3D display (Furness/Seibel)

• scanned fiber endoscope (Seibel)

• optical tomography (Seibel)

human interface technology lab

human interface technology lab

Medical Informatics

• virtual ER• distributed tumor

board• virtual anatomy

browser (Campbell)

human interface technology lab

Therapeutic Uses of VR

• pain distraction• phobia desensitization• perceptual prosthesis

(e.g. Parkinson’s Disease)

Meredith Bricken, 1990

human interface technology lab

Parkinson’s Disease

Kinesia Paradoxa• objects/lines in the

subject’s path• transverse lines spaced

about one stride-length apart work best

• learning/imagining cues doesn’t work

human interface technology lab

Virtual Vision Sport

human interface technology lab

human interface technology lab

Surgical Simulation

• suturing simulation using FFE (fast finite element) methods

• ESS (endoscopic sinus surgery) simulator

• TURP (trans-urethral resection of the prostate) simulator

human interface technology lab

Why Surgical Simulation?

• training• credentialing• planning and rehearsal• telesurgery/OR of the future

human interface technology lab

See One, Do One, Teach one

human interface technology lab

Once is Not Enough

human interface technology lab

Big Questions

• What is the objective of the simulation?

• What do you need to simulate to achieve the objective?

human interface technology lab

Core Design Issues

• anatomical detail• graphical realism• haptic realism• instrumental realism• bells and whistles• user (proctor) interface• validation

human interface technology lab

Anatomical Detail

human interface technology lab

Graphical Realism

Type 1

in-vivo

in-vitro

Type 2 Type 3

human interface technology lab

Haptic Realism

human interface technology lab

Instrumental Realism

human interface technology lab

Bells and Whistles

• OR sounds • speech input• intelligent agents• training aids

human interface technology lab

System Integration

human interface technology lab

Proctor Interface

human interface technology lab

Simulator Validation

3.65

3.27

5.2

4.46

3.32

4.93

4.23

0

1

2

3

4

5

6

Visual Realism Tactile Realism Auditory Realism Bleeding/Bubbles Chips Instrumentation Overall

human interface technology lab

Simulator Validation

Non-MD Junior Resident

Senior Resident Staff ENT

human interface technology lab

Collaborators HIT Lab

• Peter Oppenheimer• Jeff Berkley• Chris Airola• Duff Hendrickson• Tim Kowalewsky

UW School of Medicine• Rob Sweet, Jim Porter (Urology)• Dan Berg, Greg Raugi (Dermatological Surgery)• Mika Sinanan (Surgery/CVES)

Others• Chuck Edmond (Madigan Army Hospital - ENT)• Marvin Fried (Montefiore Hospital - ENT)• Rick Satava (Yale Medical School - Surgery)• George Turkiyyah (Civil Engineering)• Mark Ganter (Mechanical Engineering)

human interface technology lab

Thank You