automated pathology detection system design …...an azure machine learning research 1 presented by:...

27
AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN USING MEDICAL IMAGES: AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering University of Washington, Bothell, WA, USA [email protected]

Upload: others

Post on 20-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN

USING MEDICAL IMAGES:

AN AZURE MACHINE LEARNING RESEARCH

1

Presented By:

Sohini Roy Chowdhury

Assistant Professor, Department of Electrical Engineering

University of Washington, Bothell, WA, USA

[email protected]

Page 2: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

OUTLINE

The Problem: Automated Pathology Detection using Medical Images

Methodology

Motivation for Microsoft Azure Machine Learning Studio (MAMLS) Platform

MAMLS Performance

Results

Conclusions

2

Page 3: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

MEDICAL IMAGE DIAGNOSTICS: THE CHALLENGES

3

Background noise.

Imaging artifacts.

Variations in imaging systems.

Telemedicine.

Biometrics.

Semi-automated ultrasound

analysis system. Source:

http://en.wikipedia.org/wiki/Medical_i

maging

Retinal image analysis

system.

Page 4: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

RETINAL FUNDUS IMAGE ANALYSIS

Fundus: Image of the interior surface of the eye,

opposite the lens.

Pathologies causing acquired blindness:

Non-Proliferative Diabetic Retinopathy

(NPDR).

Proliferative Diabetic Retinopathy (PDR).

Glaucoma.

Age-related Macular Degeneration (AMD).

Retinal Vein Occlusion (RVO).

11/13/2015 4

Fundus image

Source: [Online]

http://www.ucdenver.edu/academics/colleges/medicalschool/departments/Op

hthalmology/research/labresearch/Faculty/PublishingImages/Figure%202%20V1

.jpg

Page 5: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

METHODOLOGY: INFORMATION EXTRACTION FROM

MEDICAL IMAGES

5

Cognitive symptoms of pathology Detection metrics.

The tools:

Domain knowledge- For intuitive understanding.

Image Processing- For segmenting Regions of Interest (ROI).

Machine Learning- For decision making.

Outcome:

Automated algorithms for pathology detection.

Semi-automated algorithms to aid treatment.

Reliable Telemedicine.

translates

Page 6: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

DIABETIC RETINOPATHY ANALYSIS USING MACHINE

LEARNING : THE DREAM SYSTEM1

6

Stage 1:

Background

Detection

Stage 2: Bright Lesion

Classification

Stage 3: Red Lesion

Classification

Foreground segmentation Lesion Classification: Step 1 Lesion Classification: Step 2

Page 7: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

MOTIVATION FOR CLOUD COMPUTING

Existing challenges:

Classification tasks incur high computational time complexities.

Identification of pathology specific medical informatics.

Scalable metrics/methods for large populations for screening tasks.

Motivation for using Microsoft Azure Machine Learning Studio (MAMLS) :

Selection of algorithms and packages in R.

Flow-chart based user interface aids end-users.

Key Contributions:

Automate classification tasks within MAMLS.

Benchmark MAMLS platform.7

Page 8: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

THE MAMLS PLATFORM:

Data set

8

Page 9: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Data set

Split

9

THE MAMLS PLATFORM:

Page 10: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Data set

Split

Train

10

THE MAMLS PLATFORM:

Page 11: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Data set

Split

Train

Test

11

THE MAMLS PLATFORM:

Page 12: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

MAMLS MACHINE

LEARNING PROCESS

Data set

Split

Train

Test

Evaluate

12

Page 13: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Data set

Split

Train

Test

Evaluate

Visualize

13

THE MAMLS PLATFORM:

Page 14: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

MAMLS PERFORMANCE

Public Data Sets:

Telescope2

Wisconsin Breast Cancer3

Local Data Set:

Non Proliferative Diabetic Retinopathy lesions: DIARETDB1

Available at: https://sites.google.com/a/uw.edu/src/useful-links

14

Page 15: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

LOCAL DATA SET –

DIARETDB1

4 lesions for Diabetic Retinopathy-> 6 classes

Bright Lesion: False Positive, 0

Bright Lesion: Hard Exudates, 1

Bright Lesion: Soft Exudates, 2

Red Lesion: False Positive, 3

Red Lesion: Micro-Aneurysm, 4

Red Lesion: Hemorrhage, 5

15

Page 16: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Dataset:User Input

Decision 1:Binary or Multi-

class

Decision 2:Binary

Decision 2:Multi-class

Decision 4:Hierarchical

Binary

Decision 3:Multi-class or

Hierarchical Binary

Result:Flow Output

PROPOSED FLOW

16

Page 17: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Dataset:User Input

Decision 1:Binary or Multi-

class

Decision 2:Binary

Decision 2:Multi-class

Decision 4:Hierarchical

Binary

Decision 3:Multi-class or

Hierarchical Binary

Result:Flow Output

17

PROPOSED FLOW

Page 18: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Dataset:User Input

Decision 1:Binary or Multi-

class

Decision 2:Binary

Decision 2:Multi-class

Decision 4:Hierarchical

Binary

Decision 3:Multi-class or

Hierarchical Binary

Result:Flow Output

18

PROPOSED FLOW

Page 19: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Dataset:User Input

Decision 1:Binary or Multi-

class

Decision 2:Binary

Decision 2:Multi-class

Decision 4:Hierarchical

Binary

Decision 3:Multi-class or

Hierarchical Binary

Result:Flow Output

19

PROPOSED FLOW

Page 20: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Dataset:User Input

Decision 1:Binary or Multi-

class

Decision 2:Binary

Decision 2:Multi-class

Decision 4:Hierarchical

Binary

Decision 3:Multi-class or

Hierarchical Binary

Result:Flow Output

20

PROPOSED FLOW

Page 21: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

Dataset:User Input

Decision 1:Binary or Multi-

class

Decision 2:Binary

Decision 2:Multi-class

Decision 4:Hierarchical

Binary

Decision 3:Multi-class or

Hierarchical Binary

Result:Flow Output

21

PROPOSED FLOW

Page 22: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

RESULTS – TELESCOPE2

22

Page 23: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

RESULTS – WISCONSIN BREAST CANCER3

23

Page 24: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

RESULTS – DIARETDB1

24

Page 25: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

CONCLUSIONS AND FUTURE WORK

MAMLS

Binary, Multi-class, and Hierarchical Binary classification tasks.

Proposed Generalized Flow

Fine-tuned classification models.

Decision-making R scripts.

Future Work

Dimensionality reduction.

Output visualization.

Regression capability.

Benchmark additional public and local data sets. 25

Page 26: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

REFERENCES

[1] S. Roychowdhury, D. Koozekanani, & K. Parhi (2014). “Dream: Diabetic retinopathy analysis using machine

learning.” Biomedical and Health Informatics, IEEE Journal of, 18(5), 1717-1728.

[2] M. Lichman (2013). UCI Machine Learning Repository

[https://archive.ics.uci.edu/ml/datasets/MAGIC+Gamma+Telescope]. Irvine, CA: University of California, School of

Information and Computer Science.

[3] M. Lichman (2013). UCI Machine Learning Repository

[https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+%28Original%29]. Irvine, CA: University of

California, School of Information and Computer Science.

[4] M. Lichman (2013). UCI Machine Learning Repository

[https://archive.ics.uci.edu/ml/datasets/Statlog+(German+Credit+Data)]. Irvine, CA: University of California,

School of Information and Computer Science.

26

Page 27: AUTOMATED PATHOLOGY DETECTION SYSTEM DESIGN …...AN AZURE MACHINE LEARNING RESEARCH 1 Presented By: Sohini Roy Chowdhury Assistant Professor, Department of Electrical Engineering

THANK YOU

Questions??

27