artificial intelligence enables precision diagnostics in

ExperimentalMolecularImaging

Artificial Intelligence Enables Precision Diagnostics in Clinical Medicine

Fabian Kiessling

Experimental Molecular Imaging

ExperimentalMolecularImaging

• Liquid biomarker will replace indications for imaging in cancer screening/therapy monitoring

• Computer-assisted diagnosis will take over major parts of routine image analysis

• Clustered and combined analysis of radiological, pathological and omics data will dissolve the borders between radiology, nuclear medicine, pathology and laboratory medicine

ExperimentalMolecularImaging

Medical image analysis to derive quantitative measures

• Pooling of diagnostic data

• Images are data

• Medical image analysis to extract quantitative information from images

Gillies et al., Radiology, 2016

ExperimentalMolecularImaging

Automation of Lesion Detection

Magnuska, Theek et al., (unpublished)

Detection Edge Refinements Segmentation

Segments Overlap

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 180

102030405060708090

100

Segment

Perc

enta

ge O

verla

p [%

]

Between UsersBetween AS and Users

• Integrate AI into the routine work tocreate user independent analyses

• Automated workflows increase reproducibility and can take over time consuming tasks

ExperimentalMolecularImaging

Advanced Feature Extraction

x

Frame 1 Frame 2 Frame 3 Frame 4 Frame 5

1

2

2

45

Markov Chain Monte Carlo Data Association Algorithm

453

2

1

2

2

45 4

532

• Priori-propability• Motion model• Posteriori-propability

„motion model Ultrasound Localization Microscopy“ (mULM)

Cooperation with G. Schmitz, RUB ; Opacic, Denks et al. Nat Commun 2018

ExperimentalMolecularImaging

0 0 m

/s

2

A431rB

VVe

loci

ty m

apD

irect

ion

map

MLS A549

Intuitive Visualisation

ExperimentalMolecularImaging

Parameterization of dynamic data reduces the number of dimensions and parameters

Theek et al., SciRep 2018

Radiomics: Clustered Analysis

ExperimentalMolecularImaging

Radiomics: Clustered Analysis

Selection of onefeature per imagingbiomarker class

Unsupervised Classification Supervised Classification

Data mining strategy is of highest importance for robust pattern recognition in large amount of data available!

Theek et al., SciRep 2018

ExperimentalMolecularImaging

Clinical Decision Support Systems

U-net

• RSNA Pneumonia Detection Challenge (NIH Cancer Center data set)

• Exploring deep learning solutions to detect pneumonia in chest X-rays

• Making use of “the wisdom of crowds” (1500 teams)

Ronneberger et al.

ExperimentalMolecularImaging

Combination of two key technologies:

• Automated tissue characterization

• Virtual multistaining

Digital Pathology

kindly provided by Fraunhofer Mevis

ExperimentalMolecularImaging

Precision therapy• Assessment of

diagnostic need• Connecting diagnosis

and therapy• SOP

Comprehensive Diagnostics Center Aachen

Founded in 2018 as an entity of the University Clinics Aachen

ExperimentalMolecularImaging

Strategic Alliance: MEVIS

ExperimentalMolecularImaging

Summary

• The future lies in multiparametric diagnosis (imaging, histology, omics)

• Basis for digital disease models (link to Systems Medicine)

– 2 out of 3 medical EU flagship project applications

• Need for computer-assissted data analysis using AI

• Tools for data integration and novel data base concepts required

• Need for „Comprehensive Diagnostic Centers“ and (inter-)national

collaborations and networks

ExperimentalMolecularImaging