university of são paulo institute of mathematics and statistics department of computer science
DESCRIPTION
University of São Paulo Institute of Mathematics and Statistics Department of Computer Science Locating and Tracking Facial Landmarks with Gabor Wavelet Networks. Rogério Schmidt Feris Roberto Marcondes Cesar Junior {rferis,cesar}@ime.usp.br. Outline. Motivation - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/1.jpg)
University of São Paulo
Institute of Mathematics and Statistics
Department of Computer Science
Locating and Tracking Facial Landmarks Locating and Tracking Facial Landmarks with Gabor Wavelet Networkswith Gabor Wavelet Networks
Rogério Schmidt Feris
Roberto Marcondes Cesar Junior{rferis,cesar}@ime.usp.br
![Page 2: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/2.jpg)
OutlineOutline
Motivation
Face Representation Using GWNs
Locating and Tracking Facial Landmarks
Experimental Results
Conclusions
![Page 3: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/3.jpg)
MotivationMotivation
Face Recognition from Video Sequences
Problem Assumptions
![Page 4: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/4.jpg)
Gabor Wavelet NetworksGabor Wavelet Networks
)2()2
1exp()( xusinxxx TT
Wavelet Networks
Mother Wavelet: Odd-Gabor Function
f x w xi ni
M
i
~
( ) ( )
1
![Page 5: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/5.jpg)
Face Representation Using GWNsFace Representation Using GWNs
cossin
sin-cos RRotation
ysDilation
0
0sS
x
y
x
c
cc nTranslatio
))(()( cxSRxn
},...,,{21 Mnnn
),,,,( yxyx ssccn
![Page 6: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/6.jpg)
Face Representation Using GWNsFace Representation Using GWNs2
,)(min
i
niiwn
fwfEi
ii
Original Image Wavelet Representation
Wavelet parameters are chosen from the continuous parameters space !!
![Page 7: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/7.jpg)
Face Representation Using GWNsFace Representation Using GWNs
Progressive Attention
Interest32, 52, 100 and 320 wavelets
Direct Calculation of Weights
![Page 8: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/8.jpg)
Face Representation Using GWNsFace Representation Using GWNs
GWN Reparametrization
![Page 9: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/9.jpg)
Face Representation Using GWNsFace Representation Using GWNs
Superwavelet
))(()( cxSRwxi
nin i
),,,,,( xyyxyx sssccn
y
xyx
s
ssS
0
Reparametrization
2min n
ngE
![Page 10: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/10.jpg)
Locating Facial LandmarksLocating Facial Landmarks
Reparametrization in Different Individuals
Optimization Using a Mean Face (Small Databases)
Locating Facial Landmarks
Yale Face Database
![Page 11: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/11.jpg)
Locating Facial LandmarksLocating Facial Landmarks
![Page 12: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/12.jpg)
Tracking Facial LandmarksTracking Facial Landmarks
Reparametrization in each Frame
Overall Face Geometry is Considered
Robustness and Efficiency
2min
tt
ntn
JE
![Page 13: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/13.jpg)
Experimental ResultsExperimental Results
Face Detection Positioning of Facial Landmarks Tracking of Face and Facial Landmarks
http://www.ime.usp.br/~rferis
![Page 14: University of São Paulo Institute of Mathematics and Statistics Department of Computer Science](https://reader030.vdocument.in/reader030/viewer/2022032612/56815461550346895dc27b6d/html5/thumbnails/14.jpg)
ConclusionsConclusions
Method Efficient and Robust
Limitations
Future Work
Improve Positioning of Facial Landmarks
3D Wavelet Model