medical imaging simulation and...
TRANSCRIPT
Medical Imaging Simulation and Robotics
[email protected]@imag.fr
Laboratoire TIMC‐IMAG, équipe GMCAO
Course objective• Discover a new scientific domain
– « Computer Assisted Medical Interventions »– Pluridisciplinary, translational (theory<‐>patient’s bedside )– Two project sessions
• Introduction to new scientific fields:– Medical imaging, registration, biomedical imaging
• Application to fields you have learnt about elsewhere– Robotics, computer vision, image processing
Analyzed in terms of physicians’ practice and needs
MISR ‐ 2017‐2018 2 / 24
Why a MISR course in MOSIG?
• A growing field: the MD and medical technologies field represents 100 billion € of turnover, 575.000 jobs and more than 25.000 companies in europe [1]
• Grenoble and the region are very well structured in the field (Medicalps, eccami, I‐care, Biopolis, etc.)
• Students have a future in MD R & D
[1] http://www.medtecheurope.org/sites/default/files/resource_items/files/MEDTECH_FactFigures_ONLINE3.pdf
MISR ‐ 2017‐2018 3 / 24
Why a MISR course in MOSIG?
• Your professional puropose is:– Research?– Industry?– Clinical practice?
• Possibility to pursue a career in:– Research (start with internships in the team or the lab!)– Industry (see our numerous industrial partners at Biopolis)
• You will be interacting with new MD in your clinical practice
MISR ‐ 2017‐2018 4 / 24
Course organization• Course shared between:
– M2 MOSIG– M2 Physique Médicale– M2 MITI (engineers or clinicians)
• Which M2 do you belong to?
MISR ‐ 2017‐2018 5 / 24
Course organization• 12 sessions, including
– 2 project sessions (11/08 and 01/10)
• Courses titles: – Course 1 : General introduction + introduction to medical
imaging– Course 2 : medical imaging (contd) + sensors for the OR– Course 3 : image processing– Course 4 : image visualization– Courses 5 + 6 : biomechanical simulation– Courses 7 + 8 : registration– Course 9 + 10 : applications
MISR ‐ 2017‐2018 6 / 24
Course organization• 3 teachers in 3 specialties
• Pedagogic coherence in the interventions
• 2/3 theory, 1/3 practice
MISR ‐ 2017‐2018 7 / 24
Course organization
• MISR intranet website:
– On Chamillo1– Course pdfs online– Project description online– Teachers’ contact info
MISR ‐ 2017‐2018 8 / 24
The « brainshift » project• 2 parts:
– Image segmentation (1st project session 11/08)•Manipulation of images and concepts seen in the theoricalsessions on the CamiTK software
•A « Getting Started » part to prepare at home before the first project session
•Different segmentation steps to obtain a brain « mesh » usable for biomechanical simulation
– « Conception of an innovative medical device »
MISR ‐ 2017‐2018 9 / 24
Conception of a MD project• General description of the MD:
– Problematic and MD’s objectives– Description of the material components of the
(are they available on the shelf or should they be built from scratch?)– Integration in the clinical workflow
• Functional specifications: – For who is the device helpful?– On what/who does the device act upon?– For what purpose?– List of expected functionalities
• Technical specifications:– Methods and algorithms for the different functionalities– Sketch of the per‐operative (inside the OR) setup
MISR ‐ 2017‐2018 10 / 24
Brain‐shift navigator ®• Objectives: understand the different step and technologies involved in a typical CAMI application
• Context: the brainshift phenomenon
• Usage of classical image processing methods(CamiTK‐imp software http://camitk.imag.fr)
• No programming
MISR ‐ 2017‐2018 11 / 24
Brainshift
Context: neurosurgery
MISR ‐ 2017‐2018 12 / 24
•Definition of the target by the surgeon on pre‐operative MRI images
Planning on pre‐operative images
Images taken from(Ferrant et al, IEEE TMI 2001)
MISR ‐ 2017‐2018 13 / 24
Neurosurgical navigation• Objective: build a medical device helping the surgeon
to localize the target during the surgical intervention
Image tirée de (Chabrerie et al, MICCAI'98)MISR ‐ 2017‐2018 14 / 24
Neurosurgical navigation
• The project must be based on course elements and on the TP
•We will explain the problematic in the case where the OR has an interventional (per‐operative) MRI machine
• You must propose a solution in the case where the OR does not have an interventional MRI→ Final product: BrainShift Navigator
MISR ‐ 2017‐2018 15 / 24
With interventional MRI
• The per‐operative position of the tumor is different from its pre‐operative position
MISR ‐ 2017‐2018 16 / 24
With interventional MRI
•Question 1: how to update the planning between the two MRI exams?
MISR ‐ 2017‐2018 17 / 24
•Opening of the skull
With interventional MRI
MISR ‐ 2017‐2018 18 / 24
• Question2 : how to update the planning taking into account the brainshift?
With interventional MRI
MISR ‐ 2017‐2018 19 / 24
Instruments localization
InterventionalMRI frame
• “Product” question: how to visualize the surgical tools in real‐time on the interventional MRI images?
Navigation system frame
MISR ‐ 2017‐2018 20 / 24
Pre-operatoire : phase de plannification
per-operative phase
BrainShiftNavigator ®
MISR ‐ 2017‐2018 21 / 24
Without interventional MRI• Same questions:
– How to account for patient repositioning.?– How to reposition the planning
Warning: the project constraint is to NOT use interventional imaging to image the brain deformation
+ Use localizers, surface sensors, etc…+ Use intra‐operative navigation
MISR ‐ 2017‐2018 22 / 24
Evaluation• Group presentation (same group as projects group)• Size of groups will be defined later
(probably 2/3 people)• 20 min oral evaluation for each group
15 min presentation 5 min questions
• Define roles for the groups– “Components” expert (hardware + calibration aspects)– “Imaging expert” (segmentation + registration aspects)– “Project manager” (specs, bricks integration)
MISR ‐ 2017‐2018 23 / 24
Evaluation• Expected contents for your presentation:
– Summary and restitution of the 1st “imaging segmentation” project (it’s up to you to decide when you want to talk about it during your oral)
– Presentation of your “brainshift navigator” MD as:• A finalized scientific project• A commercializable product• All elements mentioned in slide 8 must be addressed
MISR ‐ 2017‐2018 24 / 24