optimal features asm texture description based on taylor series grids centered at the landmarks for...
DESCRIPTION
Invariant Optimal Features ASM F.M. Sukno, S. Ordas, C. Butakoff, S. Cruz, and A.F. Frangi IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7):1105–1117TRANSCRIPT
![Page 1: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/1.jpg)
Optimal Features ASM
Texture description based on Taylor series
Grids centered at the landmarks for local analysis
Non linear classifier (kNN) for inside-outside labeling
0
00
0)(
)(!
)()(
xx
xxnxfxf
n
n
inside
outside
1 2
1
B. van Ginneken, A.F. Frangi, J.J. Staal, B.M. ter Haar Romeny, and M.A. Viergever (2002)IEEE Transactions on Medical Imaging, 21(8):924–933
![Page 2: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/2.jpg)
Optimal Features ASM Face is too complex for the proposed
labeling Thin zones generate profile variations Classes unbalance in high curvature
points kNN slow (set dependent) Image features dependent on rotation
1 2
2
![Page 3: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/3.jpg)
Invariant Optimal Features ASM1 2
3
F.M. Sukno, S. Ordas, C. Butakoff, S. Cruz, and A.F. FrangiIEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7):1105–1117
![Page 4: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/4.jpg)
Invariant Optimal Features ASM Distance-based labeling
1 2 3 4 5 6 7-2.5
-2
-1.5
-1
-0.5
0
0.5
1
1.5
2R = 1 L = 18
1 2 3 4 5 6 7-2
-1.5
-1
-0.5
0
0.5
1
1.5R = 1 L = 18
180 profiles of man and women with IOF-ASM
1 2
0 2 4 6 8 10 12 14-0.5
-0.4
-0.3
-0.2
-0.1
0
0.1
0.2
0.3
0.4
0 2 4 6 8 10 12 14-0.25
-0.2
-0.15
-0.1
-0.05
0
0.05
0.1
0.15
0.2
4
![Page 5: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/5.jpg)
Invariant Optimal Features ASM1 2
Multi-valued neuron classifier Single neuron Very fast
Appropriate combination of derivatives allows for invariance to rigid transformations
i q s
q s
i
0
1
k-1
k-2
Z
5
![Page 6: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/6.jpg)
Segmentation tests1 2
6
Experiments on 3400+
images
Point to curve errorPoint to point error
![Page 7: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/7.jpg)
IOFASM vs ASMDataset
Images
Error
AR 532 - 33.2 %
Equinox
546 - 25.2 %
XM2VTS
2360 - 33.8 %
1 2
7
![Page 8: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/8.jpg)
IOFASM vs ASM
ASM IOF-ASM
1 2
8
![Page 9: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/9.jpg)
Identity Verification: TextureBased on texture
Eigenfaces-like approach from the segmentation results
1 2
9
![Page 10: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/10.jpg)
Identity Verification: Texture1 2
10
![Page 11: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/11.jpg)
Related work1 2
11
![Page 12: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/12.jpg)
Conclusions on IOF-ASM1 2
By using more elaborate descriptions of the texture it is possible to increase the accuracy of ASMs IOF-ASM provides a generic framework Features are optimized for every landmark
Allows for a trade off between accuracy and speed Feature selection: –15% error / –50% time
About 30% more accurate than ASM in facial feature localization Derives in better identification rates
Invariant to in-plane rotations 12
![Page 13: Optimal Features ASM Texture description based on Taylor series Grids centered at the landmarks for local analysis Non linear classifier (kNN) for inside-outside](https://reader035.vdocument.in/reader035/viewer/2022070610/5a4d1bad7f8b9ab0599cb3ab/html5/thumbnails/13.jpg)
Out-of-plane Rotations Environment
constraints● Surveillance
systems● Car driver images
ASM:● Similarity does not
remove 3D pose ● Multiple-view
database Other approaches
● Non-linear models● 3D models: multiple
views
AV@CAR Database
1 2 3
13