automatic localisation of the brain in fetal mri (miccai 2013 poster)

1
Automatic Localisation of the Brain in Fetal MRI K. Keraudren 1 , V. Kyriakopoulou 2 , M. Rutherford 2 , J.V. Hajnal 2 , D. Rueckert 1 1 Biomedical Image Analysis Group, Imperial College London, 2 Centre for the Developing Brain, King’s College London Background Routine examinations during pregnancy rely on ultrasound imaging. However, when anoma- lies are suspected, an MR scan of the fetus is performed to provide images with a higher resolution and tissue contrast. Due to fetal motion, such scans typically ac- quire data as stacks of 2D slices of real-time MRI, freezing in-plane motion. Moreover, to re- duce the scan time while avoiding slice cross-talk artefacts, contiguous slices are not acquired se- quentially but in an interleaved manner, thus emphasising motion artefacts. Motion correc- tion methods have been developped to correct the misalignement between slices and provide a consistent 3D data 1 . MRI of a fetal brain before and after motion correction. We propose a method to automatically find a precise bounding box around the brain in order to speed-up the pre-processing steps of the mo- tion correction procedure. Brain localisation using bundled SIFT features We propose a method for accurate and robust localisation of the fetal brain in MRI when the image data is acquired as a stack of 2D slices misaligned due to fetal motion. The key components of our method are: Size and shape constraints are defined based on prior knowledge of the fetal brain development. Instead of sliding a window over the image, Maximally Stable Extremal Regions (MSER 2 ) are detected in 2D images as candidate locations for the fetal brain. These regions are then classified using histograms of SIFT features (called bundled SIFT ). Maximally Stable Extremal Regions (MSER 2 ) are characterised by homogeneous intensity distribu- tions and high intensity differences at their boundary. They can be seen as regions stable by floodfill operation with varying intensity thresholds. For every slice Detect MSER regions Filter by size Classify using SIFT features RANSAC Pipeline for the automatic detection of the fetal brain. Proceeding slice by slice, MSER regions 2 are first detected and approximated by ellipses. They are then filtered by size and aspect ratio before being submitted to an SVM classifier using histograms of 2D SIFT features. An expected size of the brain is inferred from the fetal gestational age and prior knowledge of the fetal development. Finally, a 3D bounding cube is fitted to the selected candidates with a RANSAC procedure. Cross-validation experiment We performed a 10-fold cross validation experiment on a database of 59 healthy fetuses (gestational age ranging from 22 to 39 weeks), for a total of 117 sagittal, 113 coronal and 228 transverse scans. As our detection pipeline is based on a Bag-of-Words model, we compared our method against sliding a window of fixed size with a Random Forest classifier on histograms of 2D or 3D SIFT features. Probability map from 3D SIFT histograms. For each stack of slices, we measured the distance between the center of the ground truth bounding box and the detected bounding box. We defined a correct detection as 70% of the brain being included in the detected box. Error (mm) Centiles 2D SIFT 3D SIFT Bundled SIFT 25 th 10.9 14.8 4.0 50 th 15.5 20.8 5.7 75 th 20.5 30.4 8.4 Detection 98% 85% 100% Complete brain 38% 23% 85% References [1] M. Kuklisova-Murgasova, G. Quaghebeur, M. Rutherford, J. Hajnal, and J. Schnabel, “Reconstruction of Fetal Brain MRI with Inten- sity Matching and Complete Outlier Removal,” Medical Image Analysis, 2012. [2] J. Matas, O. Chum, M. Urban, and T. Pajdla, “Robust Wide Baseline Stereo from Maximally Stable Extremal Regions,” in BMVC, pp. 384– 393, 2002. Conclusion & Future work We presented a novel automatic localisation method for the fetal brain in misaligned MR cross-sectional images. 2D candidate regions are selected based on an expected size of the brain and classified using histograms of SIFT features. A RANSAC procedure then removes outliers and fits a bounding box around the fetal brain. Further segmentation to exclude maternal tissues for a better slice to volume registration could start from the detected box and selected MSER regions. Results Automatic localisation in green, ground truth in red. In 85% of cases, the detected bounding box contains entirely the ground truth bounding box. The method is not specific to the orientation of the scan and similar performance was obtained on sagittal, coronal and transverse acquisitions, with a median distance error of 5.7mm from the ground truth. There has been no false detection or missed de- tection in the cross-validation experiment, with a worst case error of 25mm presented on the left, in the bottom right image.

Upload: kevin-keraudren

Post on 16-Feb-2017

39 views

Category:

Science


1 download

TRANSCRIPT

Page 1: Automatic Localisation of the Brain in Fetal MRI (Miccai 2013 poster)

AutomaticLocalisationof theBraininFetalMRI

K. Keraudren1, V. Kyriakopoulou2, M. Rutherford2, J.V. Hajnal2, D. Rueckert11 Biomedical Image Analysis Group, Imperial College London,

2 Centre for the Developing Brain, King’s College London

BackgroundRoutine examinations during pregnancy relyon ultrasound imaging. However, when anoma-lies are suspected, an MR scan of the fetusis performed to provide images with a higherresolution and tissue contrast.

Due to fetal motion, such scans typically ac-quire data as stacks of 2D slices of real-timeMRI, freezing in-plane motion. Moreover, to re-duce the scan time while avoiding slice cross-talkartefacts, contiguous slices are not acquired se-quentially but in an interleaved manner, thusemphasising motion artefacts. Motion correc-tion methods have been developped to correctthe misalignement between slices and provide aconsistent 3D data1.

MRI of a fetal brain before and aftermotion correction.

We propose a method to automatically find aprecise bounding box around the brain in orderto speed-up the pre-processing steps of the mo-tion correction procedure.

Brain localisation using bundled SIFT featuresWe propose a method for accurate and robust localisation of the fetal brain in MRI when the imagedata is acquired as a stack of 2D slices misaligned due to fetal motion. The key components of ourmethod are:

• Size and shape constraints are defined based on prior knowledge of the fetal brain development.• Instead of sliding a window over the image, Maximally Stable Extremal Regions (MSER2) are

detected in 2D images as candidate locations for the fetal brain. These regions are then classifiedusing histograms of SIFT features (called bundled SIFT ).

Maximally Stable Extremal Regions (MSER2) are characterised by homogeneous intensity distribu-tions and high intensity differences at their boundary. They can be seen as regions stable by floodfilloperation with varying intensity thresholds.

For every slice Detect MSER regions Filter by size

Classify using SIFT features

RANSAC

Pipeline for the automatic detection of the fetal brain.

Proceeding slice by slice, MSER regions2 are first detected and approximated by ellipses. They arethen filtered by size and aspect ratio before being submitted to an SVM classifier using histograms of2D SIFT features. An expected size of the brain is inferred from the fetal gestational age and priorknowledge of the fetal development. Finally, a 3D bounding cube is fitted to the selected candidateswith a RANSAC procedure.

Cross-validation experimentWe performed a 10-fold cross validation experiment on a database of 59 healthy fetuses (gestationalage ranging from 22 to 39 weeks), for a total of 117 sagittal, 113 coronal and 228 transverse scans. Asour detection pipeline is based on a Bag-of-Words model, we compared our method against sliding awindow of fixed size with a Random Forest classifier on histograms of 2D or 3D SIFT features.

Probability map from 3DSIFT histograms.

For each stack of slices, we measured the distance between the centerof the ground truth bounding box and the detected bounding box. Wedefined a correct detection as 70% of the brain being included in thedetected box.

Error (mm)

Centiles 2D SIFT 3D SIFT BundledSIFT

25th 10.9 14.8 4.050th 15.5 20.8 5.775th 20.5 30.4 8.4

Detection 98% 85% 100%Complete brain 38% 23% 85%

References

[1] M. Kuklisova-Murgasova, G. Quaghebeur,M. Rutherford, J. Hajnal, and J. Schnabel,“Reconstruction of Fetal Brain MRI with Inten-sity Matching and Complete Outlier Removal,”Medical Image Analysis, 2012.

[2] J. Matas, O. Chum, M. Urban, and T. Pajdla,“Robust Wide Baseline Stereo from MaximallyStable Extremal Regions,” in BMVC, pp. 384–393, 2002.

Conclusion & Future workWe presented a novel automatic localisation

method for the fetal brain in misaligned MRcross-sectional images. 2D candidate regions areselected based on an expected size of the brainand classified using histograms of SIFT features.A RANSAC procedure then removes outliers andfits a bounding box around the fetal brain.

Further segmentation to exclude maternaltissues for a better slice to volume registrationcould start from the detected box and selected

MSER regions.

Results

Automatic localisation in green, groundtruth in red.

In 85% of cases, the detected bounding boxcontains entirely the ground truth bounding box.The method is not specific to the orientation ofthe scan and similar performance was obtainedon sagittal, coronal and transverse acquisitions,with a median distance error of 5.7mm from theground truth.

There has been no false detection or missed de-tection in the cross-validation experiment, with aworst case error of 25mm presented on the left, inthe bottom right image.