data-driven healthcare: visual analytics for exploration ... · pdf filedata-driven...

54
Data-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Upload: ngokhue

Post on 09-Mar-2018

218 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Data-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Page 2: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient Clinician

Page 3: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient

Electronic Medical Record Databases

Clinician

Thousands or Millions of Patients • •

10+ Years of Data Per Patient Tens of Thousands of Features • • • • •

Demographics Diagnoses Labs Procedures Claims

Unstructured Physician Notes

Page 4: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient

Search and Analysis

Electronic Medical Record Databases

Clinician

Thousands or Millions of Patients • •

10+ Years of Data Per Patient Tens of Thousands of Features • • • • •

Demographics Diagnoses Labs Procedures Claims

• Unstructured Physician Notes

Page 5: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient

Electronic Medical Record Databases

Expert

ise vi

a Inter

actio

n Clinician

Thousands or Millions of Patients • 10+ Years of Data Per Patient •

Tens of Thousands of Features •••••

Demographics Diagnoses Labs Procedures Claims Unstructured Physician Notes

Page 6: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient Clinician

Page 7: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient Clinician

Page 8: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Patient Clinician

Page 9: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

outline

Visual tools for exploring clinical data support unearthing insights from clinical records

• CareFlow

Beyond exploration, clinical researchers often want predictions, too.

• Coquito, Prospector

Page 10: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

CareFlow

IBM WatsonHealth

Page 11: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

electronic medical records

Time

Patient #1

A B C

Page 12: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Time

Patient #1

AntihypertensiveFebruary 7, 2016

A B C

electronic medical records

Page 13: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

A B C Patient #1

AntihypertensiveFebruary 7, 2016

Beta Blockers February 28, 2016

Time

electronic medical records

Page 14: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

A B C Patient #1

AntihypertensiveFebruary 7, 2016

Beta Blockers February 28, 2016

Diuretics April 1, 2016

Time

electronic medical records

Page 15: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Time

Patient #1

A B C

A B D Patient #2

Patient #3

A D B

Patient #4

A C D B

electronic medical records

Page 16: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Time

Patient #1

A B C

A B D Patient #2

Patient #3

A D B

Hospitalized

Well-Managed

Well-Managed

Well-Managed Patient #4

A C D B

electronic medical records

Page 17: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Heart designed by Catherine Please from The Noun Project

heart failure

• Potentially fatal disease that affects 2% of adults in developed countries

Difficult to manage

No systematic clinical guidelines fortreating Heart Failure

Presence of co-morbidities affectstreatment recommendations.

Page 18: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

population • Hundreds of Thousands of Patients

diagnosed with Congestive Heart Failure

EMR Database

Demographics

Treatments

Lab T ests

Diagnoses

Symptoms

Page 19: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

aggregation •

Start with target patient

Find similar patients

• Using our similarity analytics on relevant data

• Features include medications, symptoms, and diagnoses, and lab tests

• Align all patients by disease diagnosis

What are the treatment pathways

after diagnosis?

Page 20: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

aggregation

Diagnosis Date

[A,B,C]

[A,B]

[A,C]

[A]

[B] [ ]

[C] [B,C] Average outcome = 0.4Average time = 10 daysNumber of patients = 10

Page 21: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

Hospitalized Managed

Page 22: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Hospitalized Managed

[Diuretics]

[ ]

[t1 ,t

3 ][D

iuretics,B

eta Blockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

Page 23: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Hospitalized Managed

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[Cardiontonics]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers][D

iureticds,A

ntianginal][Cardiontonics,

Antihypertensive]

Page 24: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Hospitalized Managed

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive][t

1 ,t3 ]

[Diuretics,

Beta B

lockers][D

iureticds,A

ntianginal]

[ ]

[Diuretics]

[Cardiontonics]

[Cardiontonics,A

ntihypertensive]

Page 25: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Hospitalized Managed

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

[Cardiontonics,A

ntihypertensive][Cardiontonics,

Antihypertensive]

[ ]

[t1 ,t

3 ]

[Diuretics]

[Diuretics,

Beta B

lockers]

[Cardiontonics]

[Diureticds,

Antianginal]

Page 26: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Care Pathways of 300 similar patients

Page 27: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

Optimal Care Pathway among 300 similar patients

Page 28: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

other tools for clinical exploration

Videos and Papers at http://perer.org

Page 29: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

clinical researchers:

Page 30: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

clinical researchers:

Page 31: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

clinical researchers:

Page 32: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

clinical researchers:

Page 33: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

clinical researchers:

Page 34: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

the role of visualization

in prediction

Page 35: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

what can visualization do?

START

Cohort Definition

coquito

END

Model Interpretability

prospector

Page 36: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

coquito cohort queries with iterative overviews

Cohort Construction 1

Josua Krause, Adam Perer, and Harry Stavropolous. SupportingIterative Cohort Construction with Visual Temporal Queries. IEEE Visual Analytics Science and Technology (VAST 2015).

Page 37: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

defining cohorts • Typically, defining cohorts is a slow process:

First, medical researchers define requirements.

Then, Technologists write SQL queries and deliver them to medical researchers.

But, often too many patients or too few patients, and the process must restart.

Page 38: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

defining cohorts with coquito

drag and drop constraints with immediate feedback

and hints for query refinement

supports using complex temporal logic

support for multiple queries side-by-side (for

cases and controls)

Page 39: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research
Page 40: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research
Page 41: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

coquito lessons ▪ Easy and interactive query formulation lets domain experts explore the

data

Visible intermediate results provide critical feedback

Hints for query refinements are helpful in improving queries

Page 42: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

predictive model prospector Model Interpretability

Josua Krause, Adam Perer, and Kenney Ng. Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models. ACM Conference on Human

Factors in Computing Systems (CHI 2016). San Jose, California. (2016).

Page 43: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

typical predictive model report Typically simply a list of top features and their weights

Why? Difficult to summarize complex models

Issues One cannot interpret how the values of each feature impact the prediction

One cannot interact with the model to test hypotheses

Page 44: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

partial dependence

diabetes diagnoses

bmi

glucoselevel

teeth

eyebrows

prediction

0 0 1 1 87 1 7 0

30 30 30 30 30 30 30 30

N N N N N Y N Y

Y Y Y N ? N N N

120 100 140 0 200 140 160 0

H S S S S S S S 7/8 are predicted sick

Page 45: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

partial dependence

15 20 25 30 35

Page 46: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

partial dependence

Page 47: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research
Page 48: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

localized inspection

7

22

N

N

160

diabetes diagnoses

bmi

eyebrows

teeth

glucoselevel

0.95prediction

Page 49: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

localized inspection

7

20

N

N

140

diabetes diagnoses

bmi

eyebrows

teeth

glucoselevel

0.45prediction

Page 50: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

32

Page 51: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

33

predicting onset of diabetes for 4000 patients

4 month long term case study with 5 data scientists

stories of visualization-driven insights in the p aper

Page 52: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research
Page 53: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research
Page 54: Data-Driven Healthcare: Visual Analytics for Exploration ... · PDF fileData-Driven Healthcare: Visual Analytics for Exploration and Prediction of Clinical Data Adam Perer IBM Research

take-aways

Clinical Data is complex and messy.

Exploratory visual analytics tools fill a much needed gap.

However, exploratory tools alone do not address their predictive desires.

There is a strong role for visualization in predictive tasks.

Adam Perer [ papers and videos at http://perer.org ]

CareFlow (CHI 2013)

COQUITO (VAST 2015)

Prospector (CHI 2016)