face recognition & biometric systems, 2005/2006 face recognition process

Face Recognition & Biometric Systems, 2005/2006

Face recognition process


Plan of the lecture

Face recognition processMost useful tools Principal Components Analysis Support Vector Machines Gabor Wavelets Hough Transform

Biometric methods


Face recognition process

Detection Normalisation

Featureextraction

Feature vectorscomparison


Face detection: aims

Find a face in the image independent of image size independent of face size for RGB and GS images fast & effective independent from head rotation angle

Face location passed to normalisation


Face detection: toolsGeneralised Hough Transform ellipse detection

Support Vector Machines (SVM) verification

PCA (back projection) verification

Gabor Wavelets feature points detection

Colour-based face maps


Face detection: algorithm

Detection of ”vertical” ellipses face candidates

Detection of ”horizontal” ellipses eye sockets candidates

Initial normalisation and verificationDetection of feature points


Face tracking

Useful in case of video sequences faster than detection smaller precision

Tool: Optical flowTracking of feature points


Normalisation

Input: image from a camera characteristic points location

Target: generate an image of invariant

parameters eliminate differences within classes


Normalisation: tools

Geometrical transformsImage filteringHistogram modifications histogram fitting to a histogram

of the average face image

Lighting compensation


Normalisation: stages

Rotation of non-frontal facesGeometrical normalisationLighting compensationHistogram fitting


Feature extraction

Input: normalised image

Target: generate a key which describes the

face algorithm of comparing the keys


Feature extraction: tools

Principal Component Analysis Linear Discriminant Analysis Local PCA Bayesian Matching

Gabor Wavelets


Feature vectors comparison

Coherent with feature extractionEigenfaces geometric distances SVM

Dual Eigenfaces image difference classified

Elastic Bunch Graph Matching correlation based


Multi-method fusion

Many feature extraction methods

S1

S2

Sn

... S

K1

K2

Kn

...

Two images Feature vectors Similarities

K1

K2

Kn

...


Multi-method fusion

Average similarity weighted mean

SVM with polynomial kernelSVM for finding optimal weights


Tools: PCA

Applications: feature extraction – the Eigenfaces

method detection (back projection) Dual Eigenfaces

Stages: training feature extraction feature vectors comparison


Tools: SVM

Applications: face detection – verification feature vectors comparison detection of lighting direction estimation of head rotation angle multi-method fusion image quality assessment


Tools: SVM

Stages: training classification

Main idea: data mapped into higher dimension to

achieve linear separability mapping performed by application of

kernels

Problems with training setParameters must be selected properly


Tools: Gabor Wavelets

Applications: feature extraction (EBGM method) feature points detection face tracking (the detected points are

tracked)

Properties: local frequency analysis set of various wavelets prepared comparison: correlation with displacement

estimation


Tools: GHT

Useful for face detectionProperties: directional image generated (set of

segments) probable ellipse centre for every

segment (based on templates) accumulation of the results for all

the segments in the image


Biometric methods

Types of the methods: static dynamic (behavioural)

Requirements: universality distinctiveness permanence collectability performance acceptability circumvention


Face recognitionAdvantages: low invasiveness high speed identification support system

Drawbacks: relatively low effectiveness changeability of a face face is not always visible


Fingerprint recognition

Advantages: high effectiveness useful for forensic applications

Disadvantages: long acquisition time low acceptability


Iris recognition

Advantages: high distinctiveness universality

Drawbacks: high quality image required low permanence in young age


Behavioural methods

Gait recognitionVoice recognitionSignature analysis


Thank you for your attention!

face recognition & biometric systems, 2005/2006 face recognition process

Documents

face detection

face recognition process

face algorithm

face tracking useful

normalisation slide

biometric methods

feature extraction input

eigenfaces method detection