subbarao nikhil narayan - imiimi.ntu.edu.sg/.../subbarao_nikhil_narayan_april_2013.pdfplanimetry...

22
Automatic volume estimation of the thyroid gland using 2D Ultrasound Imaging presented by SUBBARAO NIKHIL NARAYAN School of EEE Supervisor: Assoc. Prof. Pina Marziliano, School of EEE Co-Supervisor: Prof. Nadia Magnenat Thalmann, Institute for Media Innovation Clinical Collaborator: Dr. Christopher Hobbs, Dept. of Otorhinolaryngology, Tan Tock Seng Hospital, Singapore 11-04-2013

Upload: others

Post on 27-Feb-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Automatic volume estimation of the thyroid gland using 2D Ultrasound Imaging

presented by

SUBBARAO NIKHIL NARAYAN

School of EEE

Supervisor: Assoc. Prof. Pina Marziliano, School of EEE

Co-Supervisor: Prof. Nadia Magnenat Thalmann, Institute for Media Innovation

Clinical Collaborator: Dr. Christopher Hobbs, Dept. of Otorhinolaryngology, Tan Tock Seng Hospital,

Singapore

11-04-2013

Page 2: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Outline

β€’ Fundamentals of Thyroid Gland

β€’Volume estimation

β€’Proposed method on 2D US imaging

β€’ Experimental results

β€’ Future work

Page 3: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Fundamentals Anatomy Neck Lumps

*Images taken from the internet

- Hormone Regulation

- Iodine Metabolism - Controls energy

usage in body

Functions Pathophysiology

- Hypothyroidism - Hyperthyroidism - Benign Thyroid Disease - Thyroid Cancer

Confirming Diagnosis

- Fine Needle Aspiration Biopsy

Thyroid Imaging

Normal Thyroid Thyroid with disorders

Page 4: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Thyroid Imaging

*Images taken from : www.thyroidimaging.com

Ultrasound

Radiography

Scintiscanning

CT Scan

MRI

Page 5: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Problem Statement

Accurate volume estimation of the thyroid gland using 2D Ultrasound Image / Image Sequences

Objectives:

1. Segmentation of thyroid gland and nodules for volume estimation

2. To develop a mathematical model for accurate estimation of thyroid gland volume.

Page 6: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Importance of Thyroid Volume Estimates

β€’ Required for differential diagnosis

β€’ Normal gland volume 5-20ml depending age, gender etc..

β€’ Required for therapy using radioiodine 131 (131I) [1]

β€’ Dosage calculation for treatment [1]

𝐷 = 𝑉 βˆ—100

π‘ˆ βˆ— 𝐢

Where, D = 131I dosage (MBq), V = Thyroid volume (ml),

U = 24hr thyroidal 131I uptake(%) and C is a constant

[1]. van Isselt, J.W., et al., Comparison of methods for thyroid volume estimation in patients with Graves' disease. European Journal of Nuclear Medicine and Molecular Imaging, 2003. 30(4): p. 525-531.

Page 7: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Methods to Estimate Thyroid Volume

β€’ Modality based methods

β€’ Ellipsoid Method

β€’ Planimetry Method

β€’ Cavaliari Method

β€’ Anthropometric Methods

β€’ Computer Aided Methods

Page 8: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Ellipsoid Method

β€’ Thyroid modeled as an ellipse

β€’ 𝑉 = πœ‹

6 βˆ— β„Žπ‘’π‘–π‘”β„Žπ‘‘ βˆ— π‘€π‘–π‘‘π‘‘β„Ž βˆ— π‘™π‘’π‘›π‘”π‘‘β„Ž [2-4]

β€’ 𝑉 = 1.24101 βˆ— πœ‹

6 βˆ— β„Žπ‘’π‘–π‘”β„Žπ‘‘ βˆ— π‘€π‘–π‘‘π‘‘β„Ž βˆ— π‘™π‘’π‘›π‘”π‘‘β„Ž + 3.6627[5]

[2]. Kollorz, E.N.K., et al., Quantification of thyroid volume using 3-D ultrasound imaging. Ieee Transactions on Medical Imaging, 2008. 27(4): p. 457-466. [3]. Nygaard, B., et al., Thyroid volume measured by ultrasonography and CT. Acta Radiologica, 2002. 43(3): p. 269-274. [4]. van Isselt, J.W., et al., Comparison of methods for thyroid volume estimation in patients with Graves' disease. European Journal of Nuclear Medicine and Molecular Imaging, 2003. 30(4): p. 525-531. [5]. Ruggieri, M., et al., The estimation of the thyroid volume before surgery - an important prerequisite for minimally invasive thyroidectomy. Langenbecks Archives of Surgery, 2008. 393(5): p. 721-724.

Page 9: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Planimetry Method

β€’ 𝑉𝑝 =πœ‹

6Γ— 𝐷𝑙 Γ— 4

𝐴𝑙

πœ‹Γ—π·π‘™Γ— 4

𝐴𝑑

πœ‹Γ—π·π‘‘ [6]

where, Dl and Dt are the maximum depth in the longitudinal and transverse sections of the scan, Al and At are crosssectional areas in the longitudinal and

β€’ Used frequently with 3D imaging modalities like CT/MRI/3D Ultrasound

[6]. V. Brauer, P. Eder, K. Miehle, T. Wiesner, H. Hasenclever, and R. Paschke, Interobserver variation for ultrasound determination of thyroid nodule volumes, Thyroid, vol. 15, no. 10, pp. 1169{1175, 2005.

At

Dt

Page 10: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Cavaliari Method

β€’ Also known as point counting method [13]:

β€’ 𝑉 𝑃𝐢 = 𝑇 Γ—π‘†π‘ˆΓ—π‘‘

𝑆𝐿

2Γ— βˆ‘π‘ƒ

Where π‘†π‘ˆ and 𝑆𝐿 are scaling parameters, 𝑃 is the number of points hitting the test grid and 𝑇 is the slice thickness

[13]. U. E. Vurdem, N. Acer, T. Ertekin, A. Savranlar, O. Topuz, and M. Keceli, Comparison of three volumetric techniques for estimating thyroid gland volume, Turkish Journal of Medical Sciences, vol. 42, no. 1, pp. 1299-1306, Dec 2012.

Page 11: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Anthropometric methods

β€’ Metrics used [14]:

β€’ π‘Žπ‘”π‘’

β€’ Body Surface Area (𝐡𝑆𝐴)

β€’ log (𝑉) = 0.6089 + 0.832 Γ— 𝐡𝑆𝐴 + 0.0403 Γ— π‘Žπ‘”π‘’

β€’ log 𝑉 = 1.5988 + 0.7965 Γ— 𝐡𝑆𝐴 βˆ’ 0.1755 Γ— π‘”π‘’π‘›π‘‘π‘’π‘Ÿ

where π‘”π‘’π‘›π‘‘π‘’π‘Ÿ = 0 for male and 1 for female

β€’ All constants obtained by statistical models built using software like IBM SPSS etc.

[14]. C. Veres, J. Garsi, C. Rubino, F. Pouzoulet, F. Bidault, J. Chavaudra, A. Bridier, M. Ricard, I. Ferreira, D. Lefkopoulos et al., Thyroid volume measurement in external beam radiotherapy patients using ct imaging: correlation with clinical and anthropometric characteristics, Physics in medicine and biology, vol. 55, no. 21, p. N507, 2010.

Page 12: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

β€’ [11] and [12] are the only papers that address the issue of Automatic Thyroid Segmentation and Volume estimation.

β€’ Segmentation Results in [11]: β€’ Volume estimation done using a new

scheme that makes use of Particle

swarm optimization

β€’ Drawback: Uses information obtained

from CT scans to determine volume

of US image

β€’ Volume Segmentation Results in [12]: β€’ Drawback: Uses biased ellipsoid model

[11] C.Y. Chang, Y. F. Lei, C.H. Tseng, and S.R. Shih, Thyroid Segmentation and Volume Estimation in Ultrasound Images, IEEE Trans. on biomedical engineering, vol. 57, no. 6, June 2010 [12]. Kollorz, E.N.K., et al., Quantification of thyroid volume using 3-D ultrasound imaging. Ieee Transactions on Medical Imaging, 2008. 27(4): p. 457-466.

Computer Aided Methods

Page 13: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Drawbacks of Existing methods

β€’ All volume estimates are lower than the actual volume

β€’ Ellipsoid Method is biased [1-4,7]

β€’ Doctors want new mathematical formulation of volume measurement – NONE FOUND SO FAR!

β€’ Volume calculation inaccurate when a nodule(s) is present [1-4,7]

β€’ Volumes are mostly manually determined and have a high inter-observer variance.

[1]. Nygaard, B., et al., Thyroid volume measured by ultrasonography and CT. Acta Radiologica, 2002. 43(3): p. 269-274. [2]. van Isselt, J.W., et al., Comparison of methods for thyroid volume estimation in patients with Graves' disease. European Journal of Nuclear Medicine and Molecular Imaging, 2003. 30(4): p. 525-531. [3]. Kollorz, E.N.K., et al., Quantification of thyroid volume using 3-D ultrasound imaging. IEEE Transactions on Medical Imaging, 2008. 27(4): p. 457-466. [4]. Ruggieri, M., et al., The estimation of the thyroid volume before surgery - an important prerequisite for minimally invasive thyroidectomy. Langenbecks Archives of Surgery, 2008. 393(5): p. 721-724. [7]. Trimboli, P., et al., A mathematical formula to estimate in vivo thyroid volume from two-dimensional ultrasonography. Thyroid, 2008. 18(8): p. 879-882.

Page 14: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Proposed scheme

β€’ Use 2D of ultrasound images for volume estimation

Validation

Volume estimation

Thyroid gland segmentation

Preprocessing for artifact removal

Page 15: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Preprocessing for Artifact Removal

β€’ Manually Induced artifacts in Ultrasound Images:

β€’ Nodule markings by radiologists

β€’ Gland description

β€’ Machine induced markings

β€’ 150 out of 190 images had artifacts

β€’ Application of POC based methods [8-10].

[8]. P. Marziliano, M. Vetterli, Irregular sampling in approximation subspaces, SampTA, Loen, Norway, August 1999. [9]. Zhu, X., A.T.S. Ho, and P. Marziliano, Image authentication and restoration using irregular sampling for traffic enforcement applications. ICICIC 2006: First International Conference on Innovative Computing, Information and Control, Vol 3, Proceedings, ed. J.S. Pan, P. Shi, and Y. Zhao2006. 62-65. [10]. Zhu, X., A.T.S. Ho, and P. Marziliano, A new semi-fragile image watermarking with robust tampering restoration using irregular sampling. Signal Processing-Image Communication, 2007. 22(5): p. 515-528.

Page 16: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Artifact Removal - Results

Before artifact removal After artifact removal

N. S. Narayan, P. Marziliano and C. G. L. Hobbs, Automatic Removal of Manually Induced Artefacts in Ultrasound Images of Thyroid Gland, 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE EMBC), July 3-7, 2013.

Page 17: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Qualitative Analysis

β€’ Restored image PSNR ~ 40dB

β€’ Algorithm converges within 3 iterations

Convergence of POCS algorithm

Page 18: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Segmentation

β€’ Novelty:

β€’ Developed based purely on tissue echogenicity

β€’ Fully Unsupervised utilizing the state of the art automatic cluster estimation techniques

β€’ Speckle property of the image treated as a feature instead of noise

N. S. Narayan, P. Marziliano and C. G. L. Hobbs, Echogenicity Based Unsupervised Segmentation of Ultrasound Images of the Thyroid Gland, Submitted to The 16th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2013.

Page 19: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Segmentation - Results

N. S. Narayan, P. Marziliano and C. G. L. Hobbs, Echogenicity Based Unsupervised Segmentation of Ultrasound Images of the Thyroid Gland, Submitted to The 16th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2013.

Page 20: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Segmentation Accuracy

β€’ Accurate to a tune of 90%

β€’ Consistent cluster estimation up to very large thresholds

Stability of algorithm

Page 21: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Future work

β€’ Pre-process for image based artifacts like Shadow and Enhancement artifacts

β€’ Upgrade the segmentation algorithm

β€’ Use of cluster validity schemes

β€’ Active Contours to aid in segmentation

β€’ Segment the thyroid gland from the image

β€’ Developing model for volume estimation

β€’ Thyroid Volume Calculation

β€’ Validating the workflow

Page 22: SUBBARAO NIKHIL NARAYAN - imiimi.ntu.edu.sg/.../Subbarao_Nikhil_Narayan_April_2013.pdfPlanimetry Method β€’ 𝑝= πœ‹ 6 Γ— 𝑙×4 𝐴𝑙 πœ‹Γ—π·π‘™ Γ—4𝐴𝑑 πœ‹Γ—π·π‘‘

Questions??