Ultrasound Visualization PipelineA Survey

Å. Birkeland, V. Šoltészová, D. Hönigmann, O. H. Gilja, S. Brekke, T. Ropinski and I. Viola

1.University of Bergen,

Norway

2 .n22 Research & Technology

Transfer, Austria

3.Haukeland University Hospital,

Norway

4.University of Münster,

Germany

Motivation for Ultrasound VisualizationFetal examinationCardiacGastro

Åsmund Birkeland, University of Bergen 2

Ultrasound Imaging ModalityNon-invasiveCheapHigh resolution

SpatiallyTemporally

NoiseRandom Speckle

Åsmund Birkeland, University of Bergen 3

Ultrasound Image Modality2D ultrasound3D ultrasound

Dedicated 3D ultrasound probe3D freehand ultrasound

4D ultrasoundBlood flow

DopplerB-flow

Åsmund Birkeland, University of Bergen 4

Ultrasound Visualization – The PipelinePre-processing: Processing ultrasound data prior to segmentation, registration or rendering.Segmentation: Extracting features from ultrasound data.Registration: Combining ultrasound data with other types of medical imaging modalities.Rendering: Presenting ultrasound data.Augmented Reality: Combining ultrasound rendering

Åsmund Birkeland, University of Bergen 5

Ultrasound Visualization - The Pipeline

Åsmund Birkeland, University of Bergen 6

Pre-processingReconstruction of freehand ultrasound

Large volumesData Enhancement

Filltering

Åsmund Birkeland, University of Bergen 7

Gee et al. Processing and Visualizing Three-Dimensional Ultrasound Data

Segmentation

Åsmund Birkeland, University of Bergen 8

Automated assessment of ovarian follicles using a novel three-dimensional ultrasound software

MagiCut – Interactive clipping for 3D ultrasound

RegistrationCombining two or more image modalities in the same reference frameRigid RegistrationNon-Rigid Registration

Åsmund Birkeland, University of Bergen 9

Olesch et al. Matching CT and Ultrasound data of the Liver by Landmark constrained Image Registration

RenderingSurface Rendering3D freehand rendering4D ultrasound

Åsmund Birkeland, University of Bergen 10

Fattal and Lischinski Variational Classification for Visualization of 3D Ultrasound Data

Rendering – Transfer Functions

Åsmund Birkeland, University of Bergen 11

Hönigmann et al. Adaptive Design of a Global Opacity Transfer Function for Direct Volume Rendering of Ultrasound Data

Mapping data to color and opacityNon-uniform data intensities for the same tissue

Rendering – Multi-ModalDopplerMRI / CTIncrease in image clutter

Åsmund Birkeland, University of Bergen 12

Viola et al. Illustrated Ultrasound for Multimodal Data Interpretation of Liver Examinations

Petersch et al. Blood flow in its context: Combining 3D B-Mode and Color doppler Ultrasonic Data

Rendering - Shading

Åsmund Birkeland, University of Bergen 13

Chromatic Depth Coloring

Ropinski et al. Interactive Volumetric Lighting Simulating Scattering and Shadowing

Šoltészová et al. Multi-Directional Occlusion shading

Ultrasound and Augmented Reality

Åsmund Birkeland, University of Bergen 14Åsmund Birkeland, University of Bergen 14

AcknowledgementsIllustrasound Project, VERDIKT, The Norwegian Research CouncilHelwig Hauser – VisGroup, University of Bergen, Norway

Åsmund Birkeland, University of Bergen 15

Questions?Thank you!

Åsmund Birkeland, University of Bergen 16