julien lenoir ipam january 11 th, 2008. classification human tissues: intestines fallopian tubes...
TRANSCRIPT
![Page 1: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/1.jpg)
Julien Lenoir
IPAM January 11th, 2008
![Page 2: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/2.jpg)
Classification Human tissues:
IntestinesFallopian tubesMuscles…
Tools:Surgical threadCatheter, Guide wireCoil…
2
![Page 3: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/3.jpg)
Soft-Tissue Simulation
3
![Page 4: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/4.jpg)
Intestines simulation [FLMC02]
Goal:Clear the operation field prior to a laparoscopic
intervention Key points:
Not the main focus of the interventionHigh level of interaction with user
4
![Page 5: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/5.jpg)
Intestines simulation [FLMC02]Real intestines characteristics: Small intestines (6 m/20 feet) &
Large intestines or colon (1.5 m/5 feet) Huge viscosity (no friction needed) Heterogeneous radius (some bulges) Numerous self contact
Simulated intestines characteristics: Needed:
Dynamic model with high resolution rate for interactivityHigh viscosity (no friction)
Not needed:Torsion (no control due to high viscosity)
5
![Page 6: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/6.jpg)
Intestines simulation [FLMC02] Physical modeling: dynamic spline model
Previous work○ [Qin & Terzopoulos TVCG96] “D-NURBS”○ [Rémion et al. WSCG99-00]
6
i
i
iiq
EQ
q
E
q
E
dt
d pcc
)(
)(tqi
DOFs = Control points position
pc EE , Kinetic and potential energies
n
ii sbs
1
)()( iqP )(sb Basis spline function (C1, C2…)
○ Similar to an 1D FEM using an high order interpolation function (the basis spline functions)
Lagrangian equations applied to a geometric spline:
![Page 7: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/7.jpg)
Intestines simulation [FLMC02] Physical modeling: dynamic spline model
Using cubic B-spline (C2 continuity)Complexity O(n) due to local property of spline3D DOF => no torsion !
7
Potential energies (deformations) = springs
![Page 8: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/8.jpg)
Intestines simulation [FLMC02] Collision and Self-collision model:
Sphere basedBroad phase via a voxel grid
8
Extremity of a spline segment
Dynamic distribution (curvilinear distance)
![Page 9: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/9.jpg)
Intestines simulation [FLMC02]
9
Dynamic model: Explicit numerical integration (Runge-Kutta 4)
165 control points 72 Hz (14ms computation
time for 1ms virtual) Rendering using
convolution surface or implicit surface
![Page 10: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/10.jpg)
Soft-Tissue Simulation
10
![Page 11: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/11.jpg)
Fallopian tubes
Avoid intrauterine pregnancy Simulation of salpingectomy Ablation of part/all fallopian tube
Clamp the local areaCut the tissue
Minimally Invasive Surgery (MIS)
11
![Page 12: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/12.jpg)
Fallopian tubes
Choice of a predefine cut (not a dynamic cut):3 dynamic splines connected to keep the continuity
12
3 dynamic spline models
Constraintsinsuring C2 continuity
Release appropriate constraints to cut
![Page 13: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/13.jpg)
Fallopian tubes
Physical modeling:Dynamic spline modelConstraints handled with Lagrange multipliers +
Baumgarte scheme:○ 3 for each position/tangential/curvature constraint
=> 9 constraints per junction
Fast resolution using a acceleration decomposition:
13
EA
BλA
L
LM T
EAA
λA
BA
)( ct
Tc
t
L
LM
M
tT
Tc
t
LLLM
LM
M
AEλ
λA
BA
.
.1
1
![Page 14: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/14.jpg)
Fallopian tubes
Collision and Self-collision with spheres
14
![Page 15: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/15.jpg)
Soft-Tissue Simulation
15
![Page 16: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/16.jpg)
Muscles
Dinesh Pai’s workMusculoskeletal strandBased on Strands [Pai02]Cosserat formulation1D model for muscles
16
Joey Teran’s workFVM model [Teran et al., SCA03]Invertible element [Irving et al., SCA04]Volumetric model for muscles (3D)
![Page 17: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/17.jpg)
Tool Simulation
17
![Page 18: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/18.jpg)
Surgical Thread Simulation Complex and complete behavior
StretchingBendingTorsion
Twist control very important for surgeons
Highly deformable & stiff behavior Highly interactive Suturing, knot tying…
18
![Page 19: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/19.jpg)
Surgical Thread Simulation
19
Dynamic spline Continuous deformations energies
Continuous stretching [Nocent et al. CAS01]○ Green/Lagrange strain tensor (deformation)○ Piola Kircchoff stress tensor (force)
Continuous bending (approx. using parametric curvature)
No Torsion
[Theetten et al. JCAD07] 4D dynamic spline with full continuous deformations
![Page 20: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/20.jpg)
Surgical Thread SimulationHelpful tool for Suturing
20
A new type of constraint for suturing:Sliding constraint:
Allow a 1D model to slide through a specific point (tangent, curvature…can also be controlled)
0),(),,( 0 PtsPtqqg A Usual fixed point constraint
0)),((),,,( 0 PttsPtsqqg Sliding point constraint
![Page 21: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/21.jpg)
Surgical Thread SimulationHelpful tool for Suturing
21
s becomes a new unknown: a free variable
0.
λs
g T
P(s,t)
λ = Force ensuring the constraint g
T
sg
Requires a new equation:Given by the Lagrange multiplier formalism
s(t)
![Page 22: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/22.jpg)
Surgical Thread SimulationHelpful tool for Suturing
22
Resolution acceleration:by giving a direct relation to compute
0.
λs
gs
T
s(t)P(s,t)
λT
sg
s
![Page 23: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/23.jpg)
Surgical Thread SimulationHelpful tool for Suturing
23
![Page 24: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/24.jpg)
Surgical Thread SimulationHelpful tool for knot tying
24
Lack of DOF in the knot area:
![Page 25: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/25.jpg)
Surgical Thread SimulationHelpful tool for knot tying
25
Adaptive resolution of the geometry:Exact insertion algorithm (Oslo algorithm):
NUBS of degree d
Knot vectors:
)(sbit it 1it
insertion
)(~sbit~ it
~1~
it 2~
it
i
idjij bb~
,
sinon
~si
0
1 10,
jjjji
ttt
rji
iri
rjrirji
iri
irjrji tt
tt
tt
tt,1
11
1,
1,
~
~
~
01,
0,
1 )1( idiii
diii qqq
Simplification is often an approximation
![Page 26: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/26.jpg)
Surgical Thread SimulationHelpful tool for knot tying
26
Results:
Non adaptive dynamic spline Adaptive dynamic spline
![Page 27: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/27.jpg)
Surgical Thread SimulationHelpful tool for cutting
27
Useful side effect of the adaptive NUBS:Multiple insertion at the same parametric abscissa
decreases the local continuityLocal C-1 continuity => cut
![Page 28: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/28.jpg)
Tool Simulation
28
![Page 29: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/29.jpg)
Catheter/Guidewire navigation
29
Interventional neuroradiology Diagnostic:
Catheter/Guidewirenavigation
Therapeutic:CoilStent…
![Page 30: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/30.jpg)
Catheter/Guidewire navigation
30
Arteries/venous network reconstruction
Patient specific datafrom CT scan or MRI
Vincent Luboz’swork at CIMIT/MGH
![Page 31: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/31.jpg)
Catheter/Guidewire navigation
31
Physical modeling of Catheter/Guidewire/Coil:1 mixed deformable object =>
○ Adaptive mechanical properties○ Adaptive rest position
Arteries are not simulated (fixed or animated)
Beam element model (~100 nodes)○ Non linear model (Co-rotational)○ Static resolution:
K(U).U=F1 Newton iteration = linearization
![Page 32: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/32.jpg)
Catheter/Guidewire navigation
32
Contact handling:Mechanics of contact: Signorini’s lawFixed compliance C during 1 time step
=> Delassus operator:
0.0 fd
THCHW
Solving the current contact configuration:Detection collisionLoop until no new contact
○ Use status method to eliminate contacts○ Detection collision
If algorithm diverge, use sub-stepping
![Page 33: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/33.jpg)
Catheter/Guidewire navigation
33
Arteries 1st test:Triangulated surface for contact
![Page 34: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/34.jpg)
Catheter/Guidewire navigation
34
Arteries 2nd test:Convolution surface for
contact f(x)=0○ Based on a skeleton
which can be animatedvery easily and quickly
○ Collision detectionachieve by evaluatingf(x)
○ Collision responsealong f(x)
![Page 35: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/35.jpg)
Catheter/Guidewire navigation
35
![Page 36: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/36.jpg)
Catheter/Guidewire navigation
36
Coil deployment:Using the same technique
![Page 37: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/37.jpg)
Others 1D model
37
![Page 38: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/38.jpg)
Hair simulation
Florence Bertail’s (PhD06 – SIGGRAPH07) L’Oréal
38
![Page 39: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/39.jpg)
Hair simulation
Dynamic model Animated with Lagrange equations Kircchoff constitutive law
Physical DOF (curvatures + torsion)○ Easy to evaluate the deformations energies○ Difficult to reconstruct the geometry:
Super-Helices [Bertails et al., SIGGRAPH06]39
![Page 40: Julien Lenoir IPAM January 11 th, 2008. Classification Human tissues: Intestines Fallopian tubes Muscles … Tools: Surgical thread Catheter, Guide](https://reader035.vdocument.in/reader035/viewer/2022081515/5697bfc01a28abf838ca3e0e/html5/thumbnails/40.jpg)