slicer igt and open igt link nobuhiko hata, phd sandy wells, phd computation core
TRANSCRIPT
![Page 1: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/1.jpg)
Slicer IGT and Open IGT Link
Nobuhiko Hata, PhDSandy Wells, PhDComputation Core
![Page 2: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/2.jpg)
Surgical Planning Lab, Harvard Medical School
National Alliance for Medical Image Computing
National Center for Image-Guided Therapy
www.ncigt.org
Intelligent Surgical Instrument Project, Japan
Surgical Navigation and Robotics Laboratory
![Page 3: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/3.jpg)
Slicer in IGT
• To facilitate application of state-of-art medical image processing in IGT
• IGT specific extension to support this translation
![Page 4: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/4.jpg)
Software Design• To maximize function commonalities
among applications– Brain (biopsy, craniotomy, NdYAG laser ablation)– Prostate (brachytherapy, biopsy)– Liver and kidney (Microwave, Cryo, laser ablation)– Endoscopy (broncho-, neuro-, feto-scopy)
![Page 5: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/5.jpg)
Slide 5
MRg Prostate Therapy
• Segmentation tool for Brachytherapy Planning and Biopsy
• Navigation for Biopsy
• Future FUS and Robot Applications
![Page 6: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/6.jpg)
Role of Slicer in MRg Prostate Therapies
•DICOM image transfer•Planning
•Scanner control•Rigid and non-rigid image registrationPre-op MRI+Pre-procedural MRI+Intra-procedural MRI
Radiology 220(1), 263-268, 2001
![Page 7: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/7.jpg)
Slide 7
MR-guided laser ablation
• MRI Thermal image reconstruction in 3D Slicer
• Guidance with thermal images to minimize “uncooked” lesion
• New 3D temperature mapping from Imaging Core to be implemented in the future
Movie prepared by Hata
![Page 8: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/8.jpg)
Slide 8
MR-guided neurosurgery
• MRI-guided brain tumor surgery guided with fMRI and diffusion tensor tractography
• Toward Spatial Neuroinformatics for Functional Localization (P.I. Wells)
Movie prepared by Hata, Warfield, Golby
![Page 9: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/9.jpg)
Open IGT Link
![Page 10: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/10.jpg)
Slide 10
An example: MRg Prostate interventionDICOM
Server (?)MRIHost
MRIScanner
Raw Data ServerSP
LOT
RSPModifierSP
LOT
Real-TimeImage Controller
• image recon• plane control
SPLO
T
SPLO
T
Commercial SoftwareInterface
• image visualization
• planning• biopsy targets• rad. dose• brachy. seed targets
• image registration• Pre-op ↔ intra-op• multi-parametric (SSM)
• interventional image visualization (in room)
• RT image processing• robot localization• Robot calibration• needle localization• seed localization
SPLO
T
Research InterfaceImage visualizationPlanning (biopsy targets)Image registration (pre ↔ intra)Interventional visualizationRT image processing (fiducial)
?
RobotController
RoboticManipulator
Driver ControlInterface
ImageProcessor (?)
![Page 11: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/11.jpg)
Endorsement by IGT research community
Surgical robotics research community
DelNido BRP
![Page 12: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/12.jpg)
Open IGT Link and IGSTK
– IGSTK is a software interface to commercial trackers• NDI Polaris, NDI Aurora, Ascension Flock of Birds, and
Ascension Microbird– IGSTK has Open IGT Link interface.– Access to all IGSTK supported devices in Slicer 3– Work was done by Kitware, Georgetown, SPL with
funding from NA-MIC collaboration grant (PI Cleary)
![Page 13: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/13.jpg)
Intra-operative Seeding of Tractography
• Use tracking device to– Seed tractography at the
location of neurosurgical lesion
• Internal collaboration with Neurosurgery Core
![Page 14: Slicer IGT and Open IGT Link Nobuhiko Hata, PhD Sandy Wells, PhD Computation Core](https://reader034.vdocument.in/reader034/viewer/2022052414/56649dd35503460f94acadbd/html5/thumbnails/14.jpg)
Conclusion
• 3D Slicer– Useful tool for IGT software development– Facilitates collaboration and dissemination
• Open IGT Link– New development from Year 3– Community building for IGT scientists working with variety
of vendors and applications• Future Plan
– Continuing effort to extend Slicer 3 for new IGT– Service/dissemination