1000 improving visualization and interaction during ... · platform was loaded onto the microsoft...

1
Improving Visualization and Interaction During Transcatheter Ablation Using A Mixed Reality System: First-In-Human Experience Jennifer N. Avari Silva*, Michael Southworth , Aarti Dalal*, George F. Van Hare*, Jonathan R. Silva *Division of Pediatric Cardiology , Department of Biomedical Engineering; Washington University in St. Louis, St. Louis MO, USA Introduction: A novel mixed reality (MxR) based system that displays a real time intraprocedural hologram of cardiac geometry, electroanatomic maps, catheter localization with a controllable via sterile interface was developed. The system improves physician visualization and data interaction, which we expect will improve understanding of patient-specific cardiac anatomy and ultimately improve physician performance resulting in improved patient outcomes. We present the first live case where we have used this system, the Enhanced ELectrophysiology Visualization and Interaction system (ĒLVIS). Methods: Software developed with the Windows Mixed Reality platform was loaded onto the Microsoft HoloLens (HL) augmented reality head mounted display and tested with historic data, prior to use in a live study. Results: During a standard electrophysiology study and transcatheter ablation, ĒLVIS displayed a holographic projection of real time cardiac geometry during its creation and throughout the case. Local activation time (LAT) map, catheter locations and lesion markers were all overlaid onto this model. Two concurrent observers located outside the electrophysiology suite watched the live case and interacted with the model altering the scale, rotation and translating the geometry using gaze/gesture control. Conclusion: Display of real time cardiac geometry, LAT map, catheter localization and lesion data in a single hologram within a MxR environment that facilitates physician visualization, interaction and collaboration is feasible. Future studies will include usability testing and prospective in-human validation. 20 25 30 35 40 45 50 55 60 Frame Rate (fps) 0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 Proportion of Samples 0 200 14K 400 600 800 10K 60 Number of Samples 1000 1200 50 1400 5K 1600 40 30 1K 20 Real-time MxR display of EAMS data feasible Current hardware meets minimum performance requirements More accurate latency characterization Next steps… Quantifying benefits of MxR HMD in EP - Workload distribution - Time to generate high-density geometries and maps - Overall procedure time Jennifer N. Avari Silva, MD ([email protected]) Jonathan Silva, PhD ([email protected]) http://silvalab.bme.wustl.edu JNAS and JRS are founders of SentiAR, Inc. MS holds shares in SentiAR, Inc. SentiAR, Inc is a medical device company pursuing the application of augmented reality in electrophysiology. Funded by Children’s Discovery Institute CH-II-2017-575 - 10 patients undergoing EPS/ablation recruited for observational study - Patients underwent standard procedure - 2 nd EP team to observe study from control room, including geometry creation, map creation and ablations - No feedback to performing physician - No patient decisions made using ĒLVIS - Inclusion criteria: - Structurally normal heart Performance Metrics Polygons .5k-12k Frame Rate 30-60fps Battery Performance 191min Latency <131msec SLCH08: RA, LA and CS geometry with LAT map from LL WPW ablation SLCH01: RA geometry with voltage map from AVNRT ablation ABSTRACT RESULTS SLCH06: RA, LA and CS geometry with LAT map from LL WPW ablation note accuracy of consolidation lesions SYSTEM BACKGROUND METHODS Advanced Cardiac Imaging Electroanatomic Mapping System Patient-specific model Real-time catheter locations Sterile interface TRANSLATOR ĒLVIS VIEWER ĒLVIS SERVER Patient Characteristics # of patients enrolled 10 Age (yrs) 13±4.5 EP Diagnoses AVNRT Right sided AP AVRT Left sided AP AVRT 3 1 6 Geometries Created Right atrium Left atrium 10 6 Maps Created Activation Map Voltage Map 7 5 EAMS Display HoloLens Display CONCLUSIONS ACKNOWLEDGEMENTS First Person Video Capture CONTACT DISCLOSURES

Upload: doanminh

Post on 09-Sep-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

RESULTS

Improving Visualization and Interaction During Transcatheter Ablation Using

A Mixed Reality System: First-In-Human Experience

Jennifer N. Avari Silva*, Michael Southworth†, Aarti Dalal*, George F. Van Hare*, Jonathan R. Silva†

*Division of Pediatric Cardiology , †Department of Biomedical Engineering; Washington University in St. Louis, St. Louis MO, USA

ABSTRACT

Introduction: A novel mixed reality (MxR) based system that

displays a real time intraprocedural hologram of cardiac geometry,

electroanatomic maps, catheter localization with a controllable via

sterile interface was developed. The system improves physician

visualization and data interaction, which we expect will improve

understanding of patient-specific cardiac anatomy and ultimately

improve physician performance resulting in improved patient

outcomes. We present the first live case where we have used this

system, the Enhanced ELectrophysiology Visualization and

Interaction system (ĒLVIS).

Methods: Software developed with the Windows Mixed Reality

platform was loaded onto the Microsoft HoloLens (HL) augmented

reality head mounted display and tested with historic data, prior to

use in a live study.

Results: During a standard electrophysiology study and

transcatheter ablation, ĒLVIS displayed a holographic projection of

real time cardiac geometry during its creation and throughout the

case. Local activation time (LAT) map, catheter locations and lesion

markers were all overlaid onto this model. Two concurrent

observers located outside the electrophysiology suite watched the

live case and interacted with the model altering the scale, rotation

and translating the geometry using gaze/gesture control.

Conclusion: Display of real time cardiac geometry, LAT map,

catheter localization and lesion data in a single hologram within a

MxR environment that facilitates physician visualization, interaction

and collaboration is feasible. Future studies will include usability

testing and prospective in-human validation.

20 25 30 35 40 45 50 55 60

Frame Rate (fps)

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

Pro

po

rtio

n o

f S

am

ple

s

0

200

14K

400

600

800

10K 60

Nu

mb

er

of

Sam

ple

s

1000

1200

50

1400

5K

1600

40301K

20

CONCLUSIONS

✓ Real-time MxR display of EAMS data feasible

✓ Current hardware meets minimum performance requirements

✓ More accurate latency characterization

Next steps…

✓ Quantifying benefits of MxR HMD in EP

- Workload distribution

- Time to generate high-density geometries and maps

- Overall procedure time

CONTACT

Jennifer N. Avari Silva, MD ([email protected])

Jonathan Silva, PhD ([email protected])

http://silvalab.bme.wustl.edu

DISCLOSURES

JNAS and JRS are founders of SentiAR, Inc.

MS holds shares in SentiAR, Inc.

SentiAR, Inc is a medical device company pursuing the application

of augmented reality in electrophysiology.

Funded by Children’s Discovery Institute CH-II-2017-575

METHODS

- 10 patients undergoing EPS/ablation recruited for observational

study

- Patients underwent standard procedure

- 2nd EP team to observe study from control room, including

geometry creation, map creation and ablations

- No feedback to performing physician

- No patient decisions made using ĒLVIS

- Inclusion criteria:

- Structurally normal heart

BACKGROUND

Performance Metrics

Polygons .5k-12k

Frame Rate 30-60fps

Battery Performance 191min

Latency <131msec

SLCH—08: RA, LA and CS geometry

with LAT map from LL WPW ablation

SLCH—01: RA geometry with

voltage map from AVNRT ablation

ABSTRACT RESULTS

SLCH—06: RA, LA

and CS geometry

with LAT map from

LL WPW ablation –

note accuracy of

consolidation lesions

SYSTEM

BACKGROUND

METHODS

Advanced Cardiac Imaging

Electroanatomic Mapping

System • Patient-specific model

• Real-time catheter

locations

• Sterile interface

TRANSLATOR

ĒLVIS

VIEWER

ĒLVIS

SERVER

Patient Characteristics

# of patients enrolled 10

Age (yrs) 13±4.5

EP Diagnoses

AVNRT

Right sided AP AVRT

Left sided AP AVRT

3

1

6

Geometries Created

Right atrium

Left atrium

10

6

Maps Created

Activation Map

Voltage Map

7

5

EAMS DisplayHoloLens Display

CONCLUSIONS ACKNOWLEDGEMENTS

First Person Video Capture CONTACT DISCLOSURES