tissue characterization by image analysis for diagnosis
TRANSCRIPT
![Page 1: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/1.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Tissue Characterization by Image Analysis for Diagnosis Purposes
Biomedical signal and image processing Master in Medical Informatics
FCUP 2012
J. Miguel Sanches (PhD) Assistant Professor
Institute for Systems and Robotics Bioengineering Department (DBE)
Instituto Superior Técnico / Technical University of Lisbon
email: [email protected] home: www.isr.ist.utl.pt/~jmrs
1
![Page 2: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/2.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Medical Imaging
Different Biomedical Image Modalities are corrupted and distorted by different types of noise
CT MRI LSFCM
(IV)US
MRI/ASL
2
![Page 3: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/3.jpg)
Noise
• Is usually discarded because it is unwanted and purposeless • Is generated during the acquisition process and/or processing • Is stochastic and is usually described from a statistical point of view, e.g., first or
higher order statistics • Is difficult to eliminate • It is usually very difficult to decide what is noise/artifact what what is not
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
But it can contains useful information about the observed
object
3
![Page 4: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/4.jpg)
Image Distortion and Noise Observation model
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
)(xfy =
x
Original
Hxw =
Blurred
)1log( += wz
Non linear distortion
η+= zy
Noise
Typical effects/models
4
![Page 5: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/5.jpg)
(Usual) Goal
Estimate x from y
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
))(())((ˆ 1 xygxyfx == −
x̂
Estimated
y
Noisy and distorted observation
x
Original
5
![Page 6: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/6.jpg)
Ill-posedness
• Estimating x from y is usually an ill-posed inverse problem • A problem is ill-posed if it is not well-posed. • The problem is well-posed, according Hadamard, if
– A solution exists – The solution is unique – The solution depends continuously on the data
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
)(ˆ ygx =
6
![Page 7: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/7.jpg)
Example
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
),(minargˆ xyExx
=
),( yxE
x
),( 1yxE
),( 2yxE
x1x
2x
7
![Page 8: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/8.jpg)
Mathematical Characterization
• Noise Characterization: – Additive/Multiplicative/Other – White / Colored
e.g. White and Gaussian
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
{ }iyYXYpY =≈ )),(,( θ
),())(|(
))(|())(|(
2σθ
θθ
iiii
iiii
xNxyp
xypxYp
≈
=∏
8
White:
Gaussian:
![Page 9: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/9.jpg)
AWGN
Additive White Gaussian Noise
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
),())(|(
),0()(
2
2
σθ
ση
η
iiii
i
iii
xNxyp
Np
xy
≈
≈
+=
9
![Page 10: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/10.jpg)
MWGN
Multiplicative White Gaussian Noise
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
),0())(|(
),0()(
22
2
σθ
ση
η
iiii
i
iii
xNxyp
Np
xy
≈
≈
=
10
![Page 11: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/11.jpg)
MWRN
Multiplicative White Rayleigh Noise
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
)())(|(
),(
)1,()(
2
2
iiii
xy
ii
iii
xRxyp
exyxyR
Rp
xy
≈
=
=
=
−
θ
ηη
η
11
![Page 12: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/12.jpg)
Multiplicative in Wide Sense
• Variance depending on Signal • Not necessarily multiplicative
in the algebraic sense
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
xy
eyxxyPoissonxyp −≈≈
!),())(|( θ
The Variance depends of the observation (signal); it is not constant
12
![Page 13: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/13.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Speckle
Processed by José Seabra (Biomedical PhD student)
• Ultrasound images usually present low quality (low SNR) • Images are corrupted by speckle noise (multiplicative)
13
![Page 14: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/14.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Medical Information
Speckle Pattern (texture) contains relevant medical information
fatty Liver.
14
![Page 15: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/15.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Image Decomposition
• Decompose the image in textural and anatomical/morphological components.
• Characterize the texture/“noise” (speckle).
• Associate the texture characteristics with the disease.
• Classification and Quantification for Detection (Diagnosis) and Quantification (Severity Assessment) of the disease.
15
![Page 16: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/16.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Decomposition Examples
16
![Page 17: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/17.jpg)
Texture Characeterization Rayleigh Mixture Model(RMM)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 17
Seabra, J.C.; Ciompi, F.; Pujol, O.; Mauri, J.; Radeva, P.; Sanches, J. , "Rayleigh Mixture Model for Plaque Characterization in Intravascular Ultrasound," Biomedical Engineering, IEEE Transactions on , vol.58, no.5, pp.1314-1324, May 2011.
![Page 18: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/18.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Speckle Analysis for Diagnostic Purposes
• Liver Steatosis – Ricardo Ribeiro (PhD Student)
• Classification and Staging of Chronic Liver Disease from Multimodal Data
– Ricardo Ribeiro (PhD Student)
• Carotid Atherosclerotic Plaques
– José Seabra (PhD) – David Afonso (PhD Student) – Manya Afonso (PhD, Post-Doc)
18
![Page 19: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/19.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Liver (Steatosis and Cirrhosis)
• Diffuse Liver diseases such as Steatosis and Cirrhosis are mainly textural abnormalities of the hepatic parenchyma
• Today, the assessment is subjectively performed by visual inspection
19
![Page 20: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/20.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Steatosis
• Comparison with histological data
20
![Page 21: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/21.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Liver Steatosis Local Analysis
21
![Page 22: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/22.jpg)
Classification and Staging of Chronic Liver Disease from Multimodal Data
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Normal chronic hepatitis
Cirrhosis compensated decompensated
22
![Page 23: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/23.jpg)
Clinical Based Classifier (CBC)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 23
![Page 24: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/24.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Atherosclerotic Plaques Carotid
24
![Page 25: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/25.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Tissue Characterization from Intra Vascular US (IVUS)
Collaboration with the Centre de Visió per Computador, Universitat Autònoma de Barcelona, Profª Petia Radeva
25
![Page 26: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/26.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Plaque IVUS
Decomposition
Classification
26
![Page 27: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/27.jpg)
Plaque B-Mode
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 27
![Page 28: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/28.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
3D Generalization US Acquisition
• Freehand • Mechanical
28
![Page 29: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/29.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
3D Diagnosis
Global and local analysis
29
![Page 30: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/30.jpg)
Enhanced Activity Index (EAI) Architecture
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 30
![Page 31: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/31.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
Enhanced Activity Index (EAI) Prototype
31
![Page 32: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/32.jpg)
Computer Aided Diagnosis AtherosRiskTM
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 32
![Page 33: Tissue Characterization by Image Analysis for Diagnosis](https://reader033.vdocument.in/reader033/viewer/2022050214/626e40e0f30622345d3b42a4/html5/thumbnails/33.jpg)
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012
THANKS
33