![Page 1: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/1.jpg)
1Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Michael M. Bronstein
Department of Computer ScienceTechnion – Israel Institute of Technologycs.technion.ac.il/~mbron Technion
1 January 2008
Extrinsic and intrinsic similarityof shapesnonrigid
![Page 2: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/2.jpg)
2Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Collaborators
AlexanderBronstein
Ron Kimmel
![Page 3: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/3.jpg)
3Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Welcome to nonrigid world!
![Page 4: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/4.jpg)
4Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
?
SIMILARITYCORRESPONDENCE
Applications
![Page 5: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/5.jpg)
5Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Rock
Paper
Scissors
Rock, scissors, paper
![Page 6: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/6.jpg)
6Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Rock
Paper
Scissors
Hands
Rock, scissors, paper
![Page 7: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/7.jpg)
7Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Extrinsic vs. intrinsic
Are the shapes
congruent?
Invariance to rigid motion
Are the shapes
isometric?
Invariance to inelastic deformations
EXTRINSIC SIMILARITY INTRINSIC SIMILARITY
![Page 8: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/8.jpg)
8Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Metric model
Euclidean metric
Isometry = rigid motion
Geodesic metric
Isometry = inelastic deformation
EXTRINSIC SIMILARITY INTRINSIC SIMILARITY
Similarity = isometry
Shape = metric space
![Page 9: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/9.jpg)
9Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Extrinsic similarity – Iterative closest point (ICP)
Chen & Medioni, 1991; Besl & McKay, PAMI 1992
Find the best rigid alignment of two shapes
Hausdorff distance
In Euclidean space
![Page 10: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/10.jpg)
10Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Extrinsic similarity – limitations
Suitable for nearly rigid shapes Unsuitable for nonrigid shapes
EXTRINSICALLY SIMILAR EXTRINSICALLY DISSIMILAR
![Page 11: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/11.jpg)
11Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Canonical forms
A. Elad, R. Kimmel, CVPR 2001
Multidimensional scaling (MDS)Isometric embedding
![Page 12: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/12.jpg)
12Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Intrinsic similarity – canonical forms
A. Elad, R. Kimmel, CVPR 2001
Compute canonical formsEXTRINSIC SIMILARITY OF CANONICAL FORMS
INTRINSIC SIMILARITY
= INTRINSIC SIMILARITY OF SHAPES
![Page 13: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/13.jpg)
13Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Intrinsic similarity – limitations
Intrinsically similar
Intrinsically dissimilar
Suitable for near-isometric
shape deformations
Unsuitable for deformations
modifying shape topology
![Page 14: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/14.jpg)
14Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Extrinsically dissimilarIntrinsically similar
Extrinsically similarIntrinsically dissimilar
Extrinsically dissimilarIntrinsically dissimilar
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
THIS IS THE SAME SHAPE!
Desired result:
![Page 15: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/15.jpg)
15Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Joint extrinsic/intrinsic similarity
DEFORM X TO MATCH Y
EXTRINSICALLY
CONSTRAIN THE DEFORMATION TO BE AS ISOMETRIC AS POSSIBLE
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
![Page 16: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/16.jpg)
16Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
Glove fitting example
Stretching = Intrinsic dissimilarity
Misfit = Extrinsic dissimilarity
![Page 17: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/17.jpg)
17Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapesIf it doesn’t fit, you must acquit!If it doesn’t fit, you must acquit!
Image: Associated Press
![Page 18: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/18.jpg)
18Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Intrinsic dissimilarity
Ext
rinsi
c di
ssim
ilarit
y
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
![Page 19: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/19.jpg)
19Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Computation of the joint similarity
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
Optimization variable: the deformed shape vertex coordinates
Assuming has the connectivity of
Split into computation of and
Gradients w.r.t. are required for optimization
![Page 20: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/20.jpg)
20Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Computation of the extrinsic term
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
Find and fix correspondence between current and
Can be e.g. the closest points
Compute an L2 variant of a one-sided Hausdorff distance
and its gradient
Similar in spirit to ICP
![Page 21: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/21.jpg)
21Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Computation of the intrinsic term
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
Fix trivial correspondence between and
Compute L2 distortion of geodesic distances
and gradient
is a fixed matrix of all pair-wise geodesic distances on
Can be precomputed using Dijkstra’s algorithm or fast marching
![Page 22: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/22.jpg)
22Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Computation of the intrinsic term
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
is function of the optimization variables and needs to be
recomputed
First option: modify the Dijkstra’s algorithm or fast marching to compute
the gradient in addition to the distance itself
Second option: compute and fix the path of the geodesic
is a matrix of Euclidean distances between adjacent vertices
is a linear operator integrating the path length along fixed path
![Page 23: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/23.jpg)
23Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Computation of the joint similarity
A. Bronstein, M. Bronstein, R. Kimmel, ICCV 2007
Alternating minimization algorithm
Compute corresponding points
Compute shortest paths and assemble
Update to sufficiently decrease
If change is small, stop; otherwise, go to Step
1
2
3
4 1
![Page 24: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/24.jpg)
24Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Numerical example – dataset
= topology changeData: tosca.cs.technion.ac.il
![Page 25: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/25.jpg)
25Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Numerical example – intrinsic similarity
no topological changes
![Page 26: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/26.jpg)
26Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Numerical example – intrinsic similarity
= topology change= topology-preserving
Insensitive to strong
deformations
Sensitive to topological
changes
![Page 27: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/27.jpg)
27Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Numerical example – extrinsic similarity
= topology change= topology-preserving
Insensitive to topological
changes
Sensitive to strong
deformations
![Page 28: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/28.jpg)
28Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Numerical example – joint similarity
= topology change= topology-preserving
Insensitive to topologicalchanges...
…and to strong deformations
![Page 29: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/29.jpg)
29Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Numerical example – ROC curves
0.1 1 10 100
0.1
1
10
100
False acceptance rate (FAR), %
Fal
se r
ejec
tion
rate
(F
RR
), %
Intrinsic
Extrinsic
Joint
Intrinsic,no topological
changes
EER=7.7%
EER=10.3%
EER=1.6%
EER=1.1%
![Page 30: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/30.jpg)
30Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Intrinsic dissimilarity
Ext
rinsi
c di
ssim
ilarit
y
Set-valued joint similarity
Dissi
mila
r
Simila
r
![Page 31: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/31.jpg)
31Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Shape morphing
Stronger intrinsic similarity (larger λ)
Stronger extrinsicsimilarity (smaller λ)
![Page 32: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/32.jpg)
32Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Conclusion
Extrinsic similarity is insensitive to topology changes, but sensitive to
nonrigid deformations
Intrinsic similarity is insensitive to nearly-isometric nonrigid
deformations, but sensitive to topology changes
Joint similarity is insensitive to both nonrigid deformations and topology
changes
Can be thought of as nonrigid ICP
Can be used to produce as isometric as possible morphs
![Page 33: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/33.jpg)
33Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Open issues
Efficient minimization (good initialization, multiresolution)
Only topology of one shape can change: topology of Z = topology of X
Mesh validity not enforced: self intersections may occur (may be
important in computer graphics applications)
![Page 34: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/34.jpg)
34Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Published by Springer
To appear in early 2008
~350 pages
Over 50 illustrations
Color figures
tosca.cs.technion.ac.il
Shameless advertisement
Additional information
![Page 35: 1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute](https://reader038.vdocument.in/reader038/viewer/2022103005/56649d425503460f94a1e297/html5/thumbnails/35.jpg)
35Bronstein2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes
Workshop on Nonrigid Shape Analysisand Deformable Image Alignment
(NORDIA)
June 2008, Anchorage, Alaska
in conjunction with
CVPR’08