1 image matching using local symmetry features daniel cabrini hauagge noah snavely cornell...
TRANSCRIPT
![Page 1: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/1.jpg)
1
Image Matching using Local Symmetry
Features
Daniel Cabrini Hauagge
Noah Snavely
Cornell University
![Page 2: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/2.jpg)
2
Outline
Introduction Local Symmetry Scale Space Local Symmetry Features Experimental Results Conclusion
![Page 3: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/3.jpg)
3
Introduction
Analysis of symmetry :
A long –standing problem in computer vision.
![Page 4: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/4.jpg)
4
Introduction
![Page 5: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/5.jpg)
5
Local Symmetry
Method- takes an image as input, and computes local symmetry scores over the image and across scale space. Scoring local symmetries Gradient histogram-based score
![Page 6: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/6.jpg)
6
Local Symmetry
Bilateral symmetry
2n-fold rotational symmetry
For both symmetry types
![Page 7: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/7.jpg)
7
Local Symmetry
![Page 8: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/8.jpg)
8
Scoring local symmetries
Define our score Symmetry type
If the image f exhibits perfect symmetry types at location p, then f(q) = f(Ms,p(q)) for all q.
Distance function d(q,r)= | f(q)-f(r) |
Weight mask gives the importance of each set of corresponding poi
nt pairs around the center point p in determining the symmetry score at p.
![Page 9: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/9.jpg)
9
Scoring local symmetries
Define a function that we call the local symmetry distance
SS = L*SD
![Page 10: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/10.jpg)
10
Gradient histogram-based score
![Page 11: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/11.jpg)
11
Scale space
For the purpose of feature detection, we choose a different function for
r is the distance to the point of interest A is a normalization constant r0 is the ring radius ψ controls the width of the ring
![Page 12: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/12.jpg)
12
Scale space
![Page 13: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/13.jpg)
13
Local Symmetry Features
By finding local maxima of the score, and feature description, by building a feature vector from local symmetry scores Feature detector Feature descriptor
![Page 14: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/14.jpg)
14
Feature detector
Using the SYM-IR function as a detector. Represent the support of each feature as a ci
rcle of radius s centered at (x,y) in the original image.
![Page 15: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/15.jpg)
15
Feature detector
![Page 16: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/16.jpg)
16
Feature detector
![Page 17: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/17.jpg)
17
Feature descriptor
SYMD encodes the distribution of the three SYM-I scores around a feature location at the detected scale
![Page 18: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/18.jpg)
18
Experimental Results
Evaluate the detector, comparing its repeatability to that of the common DoG and MSER detectors. Evaluating detections Evaluating descriptors
![Page 19: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/19.jpg)
19
Evaluating detections
For each image pair(I1,I2) in the dataset, and each detector, we detect sets of keypoints K1 and K2 , and compare these detections using the known homography H12 mapping points from I1 to I2.
K1 is rescaled by a factor s so that it has a fixed area A ; we denote this scaled detection K1
S also applied to K2. Finally, the relative overlap of the support regions of H12K1
S and K2 gives an overlap score.
![Page 20: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/20.jpg)
20
Evaluating detections
![Page 21: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/21.jpg)
21
Evaluating detections
![Page 22: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/22.jpg)
22
Evaluating descriptors
A precision-call curve that summarizes the quality of the match scores.
![Page 23: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/23.jpg)
23
Evaluating descriptors
We generate two sets of perfectly matched synthetic detections by creating a set of keypoints K1 on a grid in I1 (in our experiments the spacing between points is 25 pixels and the scale of each keypoint is set to 6.25). We then map these keypoints to I2 using H12, creating a matched set of keys K2. We discard keypoints whose support regions are not fully within the image.
![Page 24: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/24.jpg)
24
Evaluating descriptors
![Page 25: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/25.jpg)
25
Evaluating descriptors
![Page 26: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/26.jpg)
26
Conclusion
To evaluate our method, we created a new dataset of image pairs with dramatic appearance changes, and showed that our features are more repeatable, and yield complementary information, compared to standard features such as SIFT.
![Page 27: 1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University](https://reader036.vdocument.in/reader036/viewer/2022062309/5697bf861a28abf838c88476/html5/thumbnails/27.jpg)
27
Thanks for your listening.