medical j. michael fitzpatrick, department of electrical engineering and computer science vanderbilt...
TRANSCRIPT
![Page 1: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/1.jpg)
Medical
J. Michael Fitzpatrick, Department of Electrical Engineering and Computer ScienceVanderbilt University, Nashville, TN
Course on Medical Image Registration, Nov 3-Nov 24, 2008Institute für Robotic, Leibniz UniversitätHannover, Germany
Image RegistrationImage Registration
![Page 2: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/2.jpg)
Schedule
Nov 3: Overview of Medical Image Registration
Nov 10: Point-based, rigid registration
Nov 17: Intensity-based registration
Nov 24: Non-rigid registration
![Page 3: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/3.jpg)
Computed Tomography (1972)
Siemens CT Scanner (Somatom AR)
![Page 4: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/4.jpg)
3D Cross-sectional Image
“voxels” (“volume elements”)
![Page 5: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/5.jpg)
Magnetic Resonance Imaging
GE MR Scanner (Signa 1.5T)
![Page 6: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/6.jpg)
Positron Emission Tomography
GE PET Scanner
![Page 7: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/7.jpg)
Physician has 3 or more views.
CT(bone)
MR(wet tissue)
PET(biologicalactivity)
![Page 8: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/8.jpg)
Combining multiple images requires image registration
![Page 9: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/9.jpg)
Image Registration: Definition
Determination of corresponding points in two different views
![Page 10: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/10.jpg)
Motion relative to the scanners can be three-dimensional.
![Page 11: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/11.jpg)
Slice orientations vary widely. transverse sagittal coronal
![Page 12: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/12.jpg)
Views may be very different.
![Page 13: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/13.jpg)
But all orientations and all views can be combined if we have the 3D
point mapping.
![Page 14: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/14.jpg)
Combining Registered Images = “Image Fusion”
MR + PETCT + MRCT MR PET
![Page 15: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/15.jpg)
Rigid Registration: Definition
Rigid Registration = Registration using a “rigid” transformation
![Page 16: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/16.jpg)
Rigid Transformation
Rigid Non-rigid
Distances between all points remain constant.
6 degrees of freedom
![Page 17: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/17.jpg)
Nonrigid Transformationscan be very complex!
[Thompson, 1996]
![Page 18: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/18.jpg)
Non-rigid example
![Page 19: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/19.jpg)
Registration Dichotomy
• “Retrospective” methods (nothing attached to patient before imaging)
Match anatomical features: e.g., surfaces Maximize similarity of intensity patterns
• “Prospective” methods (something attached to patient before imaging)
Non-invasive: Match skin markers Invasive: Match bone-implanted markers
![Page 20: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/20.jpg)
Most Common Approaches
• Intensity-based* (not for surgical guidance)
• Surface-based (requires identified surfaces)
• Point-based (requires identified points)
• Stereotactic frames (for surgical guidance)
*Sometimes called “voxel-based”
![Page 21: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/21.jpg)
The Most Successful Intensity-Based Method:
Mutual Information
![Page 22: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/22.jpg)
2D Intensity Histogram (Hill94)
CT
MRCT intensity
MR
inte
nsity
![Page 23: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/23.jpg)
Misregistration Blurs It
0 cm 2 cm 5 cm
MR
CT
MR
PET
Hill, 1994
![Page 24: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/24.jpg)
• A measure of histogram sharpness • Most popular “intensity” method • Assumes a search method is available• Stochastic, multiresolution search common• Requires a good starting pose• May not find global optimum• Not useful for surgical guidance
Mutual Information(Viola, Collignon, 1996)
![Page 25: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/25.jpg)
Example: Mutual Information
Studholme, Hill, Hawkes,
1996, “Automated
3D registration of MR and CT images of the head”, MIA,
1996
(Open movie with
QuickTime)
![Page 26: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/26.jpg)
The Most Successful Surface-Based Method:
The Iterative Closest-Point Algorithm
![Page 27: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/27.jpg)
• Minimizes a positive distance function• Assumes surfaces have been delineated• Guaranteed to converge• Requires a good starting pose• May not find global optimum• Can be used for surgical guidance
Iterative Closest-Point Method(Besl and McKay, 1992)
![Page 28: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/28.jpg)
Start with two surfaces
![Page 29: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/29.jpg)
Reorient one (somehow)
![Page 30: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/30.jpg)
Reorient one (somehow)
![Page 31: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/31.jpg)
Reorient one (somehow)
![Page 32: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/32.jpg)
Pick points on moving surface
![Page 33: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/33.jpg)
Pick points on moving surface
![Page 34: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/34.jpg)
Remove moving surface
![Page 35: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/35.jpg)
Points become proxy for surface
![Page 36: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/36.jpg)
Find closest points on stationary surface
![Page 37: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/37.jpg)
Measure the total distance
![Page 38: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/38.jpg)
Remove stationary surface
![Page 39: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/39.jpg)
Points become proxy for surface
![Page 40: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/40.jpg)
Register point sets (rigid)
![Page 41: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/41.jpg)
Register point sets (rigid)
![Page 42: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/42.jpg)
Restore stationary surface
![Page 43: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/43.jpg)
Find (new) closest points
![Page 44: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/44.jpg)
Find (new) closest points
![Page 45: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/45.jpg)
Remove stationary surface
![Page 46: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/46.jpg)
Remove stationary surface
![Page 47: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/47.jpg)
Register Points
![Page 48: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/48.jpg)
Register Points, and so on…
![Page 49: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/49.jpg)
Iterative Closest-Point Algorithm:
• Find closest points• Measure total distance• Register points
Stop when distance change is small.
![Page 50: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/50.jpg)
ICP: Image-to-Image
Dawant et al.
![Page 51: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/51.jpg)
ICP: Image to Patient
• The BrainLab VectorVision surgical guidance system uses surface-based registration.
![Page 52: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/52.jpg)
ICP requires surface delineation, which is a problem in Image Segmentation
Example: Level Set Segmen-
tation (Dawant
et al.)
http://www.vuse.vanderbilt.edu/~dawant/levelset_examples/
![Page 53: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/53.jpg)
The fiducial marker is used in prospective registration for image-guided surgery.
The Most Common Application of The Point-based Method:
The Fiducial Marker
![Page 54: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/54.jpg)
Image-Guided Surgery
...and the other is the patient.
One view is an image....
Just another image registration problem.
![Page 55: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/55.jpg)
Acustar™
Allen, Maciunas, Fitzpatrick, and
Galloway
1988-1995 (J&J Z-Kat)
are implanted into the skull.
Posts
[Maurer, et al., TMI, 1997]
![Page 56: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/56.jpg)
Acustar™
Allen, Maciunas, Fitzpatrick, and
Galloway
1988-1995 (J&J Z-Kat)
[Maurer, et al., TMI, 1997]
Liquid in marker
shows up
in image
Divot cap is localizable
in OR
![Page 57: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/57.jpg)
Acustar™
Allen, Maciunas, Fitzpatrick, and
Galloway
1988-1995 (J&J Z-Kat)
[Maurer, et al., TMI, 1997]
Marker center and cap center occupy the same position relative
to the post
![Page 58: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/58.jpg)
Acustar™
Allen, Maciunas, Fitzpatrick, and
Galloway
1988-1995 (J&J Z-Kat)
[Maurer, et al., TMI, 1997]
Marker center and cap center occupy the same position relative
to the post
![Page 59: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/59.jpg)
Find corresponding
“fiducial” points
Point-based, Rigid Registration
View 2= “Space” 2
View 1= “Space” 1
Rigid transformation
Align corresponding
fiducials“targets” are also aligned
Find all corresponding
“fiducial” points
![Page 60: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/60.jpg)
Measures of Error
View 1
Registered Views
View 2
Fiducial Localization Error (FLE)
Target Registration Error (TRE)Fiducial Registration
Error (FRE)
![Page 61: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/61.jpg)
The Most Successful Point-based Method (by far!):
Minimization of Sum of Squares of
Fiducial Registration Errors
![Page 62: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/62.jpg)
• Minimizes a positive distance function• Most popular point method • Assumes points have been localized• Guaranteed to converge• Does not require a good starting pose• Always finds global optimum• Can be used for surgical guidance
Minimization of Sum of FRE2
(Shönemann, Farrell, 1966)
![Page 63: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/63.jpg)
Accuracy: State of the Art
The best accuracy is probably achieved for the head…
![Page 64: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/64.jpg)
Retrospective Registration of Head: Image-to-Image
Median Maximum
CT-MR : 0.6 mm 3.0 mm
PET-MR: 2.5 mm 6.0 mm
TRE
![Page 65: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/65.jpg)
Prospective Registration of Head: mean TRE ≤ 1 mm (CT)
[Hill, JCAT, 1998, Maurer, TMI, 1997]
![Page 66: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/66.jpg)
Error Theory for Minimization of
Mean-square FRE
![Page 67: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/67.jpg)
End of Overview
![Page 68: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/68.jpg)
How to Do
Minimization of Sum of Squares of
Fiducial Registration Errors
![Page 69: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/69.jpg)
Sum of Squares: Step 1
N
N
i
i
yy
xx
yyyxxx iiii ~ ; ~ :pointsCentered""
Center the points:
Centered
xy
![Page 70: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/70.jpg)
Step 2 (Shönemann, Farrell, 1966)
)det(VU ,1 1 diag
where, D
0
),,diag(Λ
where
,Λ :SVD
~~
t
3 2 1
3 2 1
,D
UVR
IVVUU
VUH
H
t
tt
t
ii
tyx
Determine the Rotation: Centered
Centered and Rotated
![Page 71: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/71.jpg)
Step 3 (Farrell, 1966)
R t y x
Determine the Translation:
Rx
ytx
y
Before rotation After rotation, but before translation
![Page 72: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/72.jpg)
Error Analysis
![Page 73: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/73.jpg)
Start with Assumptions about FLE
Independent, normal, isotropic, zero mean
Space 1 Space 2
![Page 74: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/74.jpg)
“Effective” FLE
22221 FLEFLEFLE
1FLE
FLE
2FLESpace 1 Space 2
![Page 75: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/75.jpg)
FRE Statistics: Sibson 1979
22
2
22
2
FLE)21(FRE
DOF. 63with
square-chi is thewhere
,FRE
:FLE To
/N
N
c
O
Approximate Solution:
Configuration doesn’t
matter!
22
2
222
2
FLE)21(FRE
DOF. 63with
square-chi is thewhere
,3/FLEFRE
:FLE To
/N
N
N
O
![Page 76: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/76.jpg)
2
2 2 22 1 2 3
2 2 21 2 3
1TRE 1 / 3 FLE
d d d
N f f f
Principal axesConfiguration does
matter.
d1d2d3
[Fitzpatrick, West, Maurer, TMI, ’98]
TRE statistics, 1998Approximate Solution:
![Page 77: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/77.jpg)
Got to here Nov 10, 2008
![Page 78: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/78.jpg)
4mm3mm
2mm
1mm
2mm
1mm
FRE = 1mm
TRE for
FLEof
1mm
Marker Placement
[West et al., Neurosurgery, April, 2001]
![Page 79: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/79.jpg)
A distribution would be better
<TRE2>
TRE295% level
Pro
babi
lity
den
sity
![Page 80: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/80.jpg)
And what about direction?
![Page 81: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/81.jpg)
TRE statistics, 2001
.directions
orthogonal along
components
t independen denote
3,2,1 where
,0, TRE i
i
N i
Approximate Solution:TRE1
TRE2TRE3
[Fitzpatrick and West., TMI, Sep 2001]
![Page 82: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/82.jpg)
Some Remaining Problems
![Page 83: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/83.jpg)
Isotropic Scaling
[Actually now solved: Batchelor, West, Fitzpatrick, Proc. of Med. Im. Undstnd. & Anal. ,
Jul 2002]
![Page 84: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/84.jpg)
Anisotropic Scaling
(Iterative Solution Only)
![Page 85: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/85.jpg)
Register M points sets simultaneouslyView 1 View 2
;
View 3 View M
The “Generalized” Procrustes Problem
(Iterative Solution Only)
![Page 86: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/86.jpg)
Anisotropic FLE
(Iterative Solutions Only)
![Page 87: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/87.jpg)
Other Unsolved Problems
• What is the statistical effect on TRE of dropping or adding a fiducial?
• Does anisotropy in FLE always, sometimes, or never makes TRE worse?
• How do we configure markers on a given surface so as to minimize TRE over a given region?
• Is there a correlation between FRE and TRE?It’ solved: There is no correlation!
Fitzpatrick, SPIE Medical Imaging Symposium, to be presented Feb 2009.
![Page 88: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/88.jpg)
• Extension to perspective transformations.
• Extension to surface matching.
Other Unsolved Problems (cont.)
![Page 89: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/89.jpg)
Rigid Registration of the Head
State of the Art
![Page 90: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/90.jpg)
CT MR-T1 MR-T2
Finding Points = “Localization”
![Page 91: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/91.jpg)
Acustar v. Leibinger:Leibinger Grows Up!
![Page 92: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/92.jpg)
Retrospective Registration of Head Images: The State of the Art
Median Maximum (Acustar)
Best CT-MR : 0.6 mm 3.0 mm (0.5 mm)
Poor CT-MR: 5.4 mm 61 mm (0.5 mm)
Best PET-MR: 2.5 mm 6.0 mm (1.7 mm)
Poor PET-MR: 5.3 mm 15 mm (1.7 mm)
And how do we know?…
![Page 93: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/93.jpg)
Retrospective Image Regstration Evaluation
Access: 150+ participants in 20 countries
Evaluation: 57 participants in 17 countries
External siteVanderbilt
1995-2007
![Page 94: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/94.jpg)
End
Additional slides follow
![Page 95: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/95.jpg)
Categories within error prediction
• Number of point sets: Two or more
• Scaling: Isotropic or anisotropic
• Point-wise weighting: equal or unequal
• Anisotropic weighting
• Cost function: squared error or other
• Point-wise FLE: equal or unequal
• Spatial FLE: isotropic or anisotropic...
Key: Approximate, Negligible progress
![Page 96: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/96.jpg)
Anisotropic Scaling
R, t = rotation, translationwi
2= point weightingS = diag( sx , sy , sz )
N
iiii RSwN
22)/1( ytx
Given {xi yi wi} find R, t, S to minimize mean FRE2
.for
),,(FRE min
minimizes
that Sfor Search
i
2
R,
i
i
S
R
xx
xtt
Iterative Algorithm:
sy
sz
sx
Searchspace
Problem Statement:
![Page 97: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/97.jpg)
Scaling: Anisotropic II
R, t = rotation, translationwi
2= point weightingS = diag( sx , sy , sz )
N
iiii SRwN
22)/1( ytx
Given {xi yi wi} find R, t, S to minimize mean FRE2
),(FRE
minimizes
that , ,for Search
:In harder thamuch
gly)(surprisin is II
2 t
t
RS,
RS
Iterative Algorithm:Problem Statement:
![Page 98: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/98.jpg)
Spatial Weighting
R, t = rotation, translationwi
2= point weightingS = diag( sx , sy , sz )A = diag( ax , ay , az )
N
iiii RSAwN
22 )()/1( ytx
Given {xi yi wi} find R, t, S to minimize mean FRE2
[96] vTrendafilo &Chu
[91] Swane &Koschat
Iterative Algorithm:Problem Statement:
Batchelor and
Fitzpatrick [2000]
Partial Solution:
![Page 99: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/99.jpg)
Generalized Procrustes Problem
Cost function Iterative method(only)
![Page 100: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/100.jpg)
Add Isotropic Scaling
Approximate Solution:
22
2
222
FLE3
71FRE
DOF 73 has
.3/FLEFRE
:) To
N
N
N
O( 2
FRE2 = sum of squared fiducial
registration errors
![Page 101: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/101.jpg)
FRE: Generalized + Scaling
Approximate Solution:
22
2
22
2
FLE3
71FRE
DOF. 7)-1)(3N-(M has
.13FLE
FRE :) To
N
MN
O( 2
FRE2 = sum of squared fiducial
registration errors
![Page 102: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/102.jpg)
TRE statistics with scaling
2
To
TRE
West and Fitzpatrick [2001]
2O
Approximate Solution:
TRE2 = target
registration error
![Page 103: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/103.jpg)
Applications of TREStatistics
![Page 104: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/104.jpg)
Surgical Paths
Radiation Isodose
Contours
Error Bounds
![Page 105: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/105.jpg)
Probe Design
Tip = “target”
IREDs are fiducials
FLE
TRE
![Page 106: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/106.jpg)
ix22i TREFLEFRE 2
Fiducial-Specific FRE
1x Poor fiducial alignment tends to occur where target registration is good!!
2x
![Page 107: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/107.jpg)
Four Solution Methods
1/21. Square Root:
2. SVD: , where
3. Quaternion:
(a) Form 4x4 matrix from elements of .
(b) Find eigenvector of with largest eigenvalue.
(c) Elements of
t t
t t
R H HH
R VU H UDV
Q H
Q
R
q
1 2 3 4 are quadratic in , , , .
4. Dual-number quaternion: [Walker91].
q q q q
( All work equally well [Eggert91]! )
.~~on only depends and easy, is tyxt ii2iwHR
![Page 108: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/108.jpg)
Generalized Procrustes Problem
)()()()()(
2)()(2
)()()(
)(
where
minimize to
}1 |,,{ find
},1 1 , |{
each, points of sets For
mmi
mmmi
M
m
M
mk
N
i
ki
mii
mmm
m
SR
w
MmSR
MN,mi
NM
i
txx
xx
t
x
(We’ve already done it for M=2.)
Problem Statement: Illustration:
![Page 109: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/109.jpg)
Generalized Procrustes Problem
neglible. are changes until
. where
,,, 1 ,ˆ
minimize to,, Find
.)/1(ˆ
: thisIterate
. Start with
)()()()()(
2)(2
*)()()(
)(
)()(
mmi
mmmi
N
ii
mii
mmm
M
m
mi
mi
mi
SR
Mmw
SR
Mi
txx
xx
t
xx
xx
Iterative Algorithm: Illustration:
*Subject to S(m) normalization
![Page 110: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/110.jpg)
Approximation Method
.
:0 , if sameoutput that Note 2
., :FLEs small Assume (1)
2
)()(
2)()(
1
21
iii
truetrue
itrue
itrue
i
iii
IR
R
gxy
t
gtzy
fzx
(due to Sibson, 1979)
![Page 111: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/111.jpg)
Approximation Method (cont.)
orderhigher dropping ,in Expand (3)
)(TRE
)(FRE
) (
22
22
)1(
O
O
O
RIR
t
![Page 112: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/112.jpg)
FRE Statistics
N
iii
i
RN
Ni
2
R,
2
21
1min FRE
for Statistics :Find
and
,,1for }{ :Given
ytx
z
t
Problem Statement: Approximate Solution:
22
2
222
21
22
FLE)21(FRE
freedom. of degrees
63 with ddistribute
square-chi is thewhere
,/FRE
:) To
/N
N
N
O( 2
![Page 113: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/113.jpg)
TRE statistics with scaling
N
iii
s
i
RsN
Rs
Ni
2
,R,
2
2
1
1min FRE
when ,TRE
for Statistics :Find
. and ,
,,1for }{ :Given
ytx
ytx
x
t
Problem Statement:
2
To
TRE
West, Fitzpatrick,
and Batchelor [2001]
2O
Approximate Solution:
![Page 114: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/114.jpg)
What do “solved” and “unsolved” mean?
• “Solved”, working definition: Reduced to solving algebraic equations Iterative algorithm that converges to solution Approximate solution accurate to
• “Unsolved”: Not solved
)(O
![Page 115: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/115.jpg)
Point-wise weighting: Equal or Unequal(We’ve just looked at this one.)
R, t = rotation, translationwi
2= point weighting
N
iiii RwN
22)/1( ytx
Given {xi yi wi} find R, t to minimize mean FRE2
Problem Statement:
See previousslides again!
Solution:
![Page 116: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/116.jpg)
1. Performing a Registration
xi = point in “from” set; yi = point in “to” set.t = translation vector.R = 3x3 rotation matrix (therefore RtR = I ).
Rxi + t
N
iiii RwN
22)/1( ytx
Given {xi yi wi } find R, tto minimize mean FRE2 xi yi
( usually wi=1)
a.k.a. The “Orthogonal Procrustes Problem”Problem Statement:
![Page 117: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/117.jpg)
2. Predicting Registration Error
View 1
Registered Views
View 2
Input---•fiducial positions
•target position, r•FLE distribution
Output---statistics for
TRE
r
Output---statistics for
FRE
![Page 118: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/118.jpg)
Isotropic Scaling
iii
iiii
w
Rw
s
R,
s
xx
yx
t
~~
~~
(2)
Find
1Set (1)
2
2
R, t = rotation, translationwi
2= point weightings = isotropic scaling
N
iiii RswN
22)/1( ytx
Given {xi yi wi} find R, t, s to minimize mean FRE2
Problem Statement: Solution:
![Page 119: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/119.jpg)
AcknowledgementsBenoit M. Dawant, PhD, EECS
Robert L. Galloway, PhD, BME
William C. Chapman, MD, Surgery
Jeannette L. Herring, PhD, EECS
Jim Stefansic, PhD, Psychology
Diane M. Muratore, MS, BME
David M. Cash, MS, BME
Steve Hartman, MS, BME
W. Andrew Bass, BME
NSF NIH
Matthew Wang, PhD, IBMJay B. West, PhD, Accuray, Inc.
Derek L. G. Hill, PhD Kings CollegeCalvin R. Maurer, Jr., PhD, Stanford U.
![Page 120: Medical J. Michael Fitzpatrick, Department of Electrical Engineering and Computer Science Vanderbilt University, Nashville, TN Course on Medical Image](https://reader038.vdocument.in/reader038/viewer/2022110320/56649cb85503460f9497f5d6/html5/thumbnails/120.jpg)
What could we choose to optimize?
• Mean-square “Fiducial Registration Error” (FRE2) Known as the “Orthogonal Procrustes Problem” in
statistics since 1950s.
• Robust estimators (median, M-estimators) Less sensitive to “outliers”
Color key: Major problems solved, Much less done