![Page 1: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/1.jpg)
Anil K. Jain
Michigan State University
http://biometrics.cse.msu.edu December 19, 2013
Biometrics Technology for Human Recognition
![Page 2: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/2.jpg)
Mehrangarh Fort
![Page 3: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/3.jpg)
“Issue a unique identification number (UID) to Indian
residents that can be verified and authenticated in an
online, cost-effective manner, and that is robust to
eliminate duplicate and fake identities.”
UIDAI has issued ~400 million Aadhaar numbers as of Aug 2013
Aadhar
Name
Parents
Gender
DoB
PoB
Address
1568 3647 4958 Basic demographic data and
biometrics stored centrally
UID = 1568 3647 4958
10 fingerprints, 2 iris & face image
Central UID database
![Page 4: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/4.jpg)
Over 1 billion people have been covered by biometric identification programs in the Low Middle Income Countries
*Identification for Development: The Biometrics Revolution, A. Gelb and J. Clark, Center for Global Development, NW, Washington
DC, Working Paper 315, Jan. 2013, http://www.cgdev.org/sites/default/files/1426862_file_Biometric_ID_for_Development.pdf
Identification for Development: The Biometrics Revolution
![Page 5: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/5.jpg)
Mobile Phones
Joseph Van Os / Getty Images
By 2014, more cell phone accounts than people; $1 Trillion in mobile payments
http://www.siliconindia.com/magazine_articles/World_to_have_more_cell_phone_accounts_than_people_by_2014-
http://blog.unibulmerchantservices.com/mobile-payments-volume-to-total-nearly-1-trillion-by-2014/
![Page 6: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/6.jpg)
Mobile Phone Security iPhone 5s: Touch ID
![Page 7: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/7.jpg)
Security Concerns
We now live in a society where people
cannot be trusted based on credentials
• Something you have: ID card, passport
• Something you know: PIN, password
![Page 8: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/8.jpg)
• Two of the Sept. 11 attackers used stolen Saudi Arabian passports
• Spanish police arrested seven men, connected to al Qaeda, tasked with stealing 40 passports per month (Dec 2, 2010)
Fake Passports
http://press.homeoffce.gov.uk/press-releases/passport-warning?version=1
http://www.pbs.org/wgbh/pages/frontline/shows/trail/etc/fake.html
http://www.lonelyplanet.com/thorntree/thread.jspa?threadID=2071874
![Page 9: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/9.jpg)
Most common passwords: 123456, password,12345678..
Too Many Passwords!
![Page 10: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/10.jpg)
The Edible Password Pill
• Swallowed once daily, pill contains a chip that uses stomach acid to power it on
• Once activated, it emits a specific 18-bit EKG-like signal, detected by your mobile or computer, turning your body into a password
The 25 Best Inventions of the Year 2013, Time, Nov. 13, 2013
![Page 11: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/11.jpg)
Biometric Technology Takes Off By THE EDITORIAL BOARD, NY Times, September 20, 2013
“The use of biological markers like
fingerprints, faces and irises to identify people is rapidly moving from science fiction to reality.”
![Page 12: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/12.jpg)
Multifactor Authentication
For a device to be secure, it should support multifactor authentication-- a combination of at least two of three components
something users have (token)
something users know (password)
something users are (biometrics)
![Page 13: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/13.jpg)
Trauring publishes paper on fingerprint matching in Nature
Goldstein et al. publish face recognition paper in Proc. IEEE (1971)
Next Generation Identification
Fingerprint as a personal mark
Biometric Milestones
300
B.C. 1839 1869 1883 1900 1905 1924 1972 1999 1963
Courtesy: John D. Woodward, RAND Corporation
2001
Galton / Henry fingerprint system adopted by
Scotland Yard
US Congress authorizes DOJ to collect fingerprints
and arrest information
Habitual Criminals Act
2008
9/11 terrorist attacks lead to govt. mandates
to use biometrics in regulating intl. travel
FBI inaugurates full operation
of “IAFIS” Criminal Booking
State AFIS
State AFIS IAFIS
Forensics Other Operations
State AFIS
Identimat: First commercial use of
biometrics
First use of fingerprints in
British criminal case
Bertillonage invented
A Chinese deed of sale with a
fingerprint
![Page 14: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/14.jpg)
Uniqueness
Identical twins
![Page 15: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/15.jpg)
Persistence
1881, age 7 1890, age 17 1913, age 40
Herschel’s fingerprints
W. J. Herschel, “The Origin of Finger-printing”, Oxford University Press, 1916
Similarity values: Age 7 vs. Age 17 = 6,217; Age 7 vs. Age 40 = 5,032; Age 17 vs. Age 40 = 5,997
(Maximum score between fingerprints from two different fingers = 3,300)
15
![Page 16: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/16.jpg)
Most Popular Traits
• Legacy database • 1:N search • NIST evaluation
• Legacy database • 1:N search • NIST evaluation • Covert capture
• Gaining popularity • 1:N search • NIST evaluation
![Page 17: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/17.jpg)
Traits Capable of 1: N search
17
• Trace evidence • Innocence project • Real-time DNA matching
• ~30% of latents are of palmprints
• FBI’s NGI will have latent palmprint matching capability
![Page 18: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/18.jpg)
Traits in Commercial Systems Primarily used for 1:1 match
18
![Page 19: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/19.jpg)
Traits in Laboratory Stage
19
![Page 20: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/20.jpg)
Rejected Traits
![Page 21: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/21.jpg)
Applications
• Security: Does the applicant have prior criminal record?
• Convenience: No need to carry credentials
• Audit trail: Who accessed the bank vault?
• Fraud: Is the credit card holder the rightful owner?
• De-duplication: One person, one document!
In the Houston hospital system 2,488 women (among ~3.5 M patients) are named Maria Garcia and 231 of them have the same birth date!
![Page 22: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/22.jpg)
10 print
Fingerprints in Forensics
• Repeat Offenders: Compare rolled or slap tenprints
• Crime Scene evidence: Compare latents to tenprints
![Page 23: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/23.jpg)
Border Security
US-VISIT UAE border crossing
Australia’s SmartGate HK smart ID card
![Page 24: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/24.jpg)
Meijer supermarket, Okemos Time & Attendance
MSU Federal Credit Union Cashless payment, Todholm primary school
Access Control & Transactions
Palmvein ATM Bradesco bank
![Page 25: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/25.jpg)
Disney Parks
![Page 26: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/26.jpg)
Personalization
Billboard displays ad only when women are watching!
http://www.engadget.com/2012/02/24/face-recognizing-billboard-ad-identifies-gender-no-boys-allowed/
![Page 27: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/27.jpg)
Enrolment vs. Recognition
Biometric Recognition System
![Page 28: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/28.jpg)
Fingerprint Matching
Match score =38 on a scale of [0, 999]
![Page 29: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/29.jpg)
Matching Performance
Match Score Distribution ROC Curve
False Accept vs. False Reject
![Page 30: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/30.jpg)
Matching Errors
• Noise & distortion
• Small overlap between template & query
False Reject False Accept
![Page 31: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/31.jpg)
Challenges
• Uncooperative users
• Unconstrained imaging conditions
• Image quality
• Intra-class variation
• Inter-class similarity
• Attacks on biometric systems
• User privacy
Salient representation and robust matching
![Page 32: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/32.jpg)
From Constrained to Unconstrained
Users
Imag
ing
Co
nd
itio
ns
Cooperative
Co
nst
rain
ed
100% TAR @ FAR=0.1%
99.4% TAR @ FAR=0.01%
97.8% TAR @ FAR=0.01%
FRGC, Exp. 1 IREX III
Un
con
stra
ined
Uncooperative
FVC2004 MBGC CASIA.v4-distance
54% TAR @ FAR=0.1%
72% Rank-1 accuracy
NIST SD27 LFW UBIRIS.v2
66.8% TAR @ FAR=10%
32
FpVTE 2003 FERET IIITD alcoholic iris User distorted image FVC2006
![Page 33: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/33.jpg)
Latent Fingerprint Enhancement
* Latent G063 from NIST SD27; 27,258 reference prints from NIST 14 & 27 ; Neurotechnology VeriFinger SDK 4.2
Latent
Enhanced Latent
Mated Rolled
Mated Rolled
# Matched Minutiae = 13
Matching Score = 38
# Matched Minutiae = 2
Match Score = 3
![Page 34: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/34.jpg)
Cameras Everywhere
1M CCTV cameras in London & 4M in U.K.; average Briton is seen by 300 cameras/day; 400K cameras in Beijing provide 100% coverage of public places; 150K cameras in Seoul
34
![Page 35: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/35.jpg)
Face Recognition in A Crowd
S. Liao, A. K. Jain, and S. Z. Li, "Partial Face Recognition: Alignment-Free Approach", IEEE Trans. PAMI, 2013
![Page 36: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/36.jpg)
Face Recognition in Video
36 How to detect “persons of interest in a video” and then identify them?
![Page 37: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/37.jpg)
37
![Page 38: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/38.jpg)
Top Retrieval Ranks for Tsarnaev Brothers (with demographic filtering)
38 http://www.cse.msu.edu/rgroups/biometrics/Publications/Face/KlontzJain_CaseStudyUnconstrainedFacialRecognition_BostonMarathonBombim
gSuspects.pdf
![Page 39: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/39.jpg)
Intra-class Variability
![Page 40: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/40.jpg)
Inter-class Similarity
Haircuts help to avoid confusion among the four identical six-year-old twins
http://www.cbsnews.com/8301-503543_162-57508537-503543/chinese-mom-shaves-numbers-on-quadruplets-heads/
![Page 41: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/41.jpg)
Provide some information about an individual, but
lack the distinctiveness and permanence
Ethnicity, Skin Color, Hair color
Periocular
Height
Weight
Soft Biometrics
Birthmark Tattoos
![Page 42: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/42.jpg)
Tattoos for Suspect Identification
CBS 6 News: Investigators seek shirtless, heavily-tattooed suspect, May 4, 2012
http://wtvr.com/2012/05/04/pictures-investigators-seek-shirtless-heavily-tattooed-suspect/
![Page 43: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/43.jpg)
Klare, Paulino, and Jain, "Analysis of Facial Features in Identical Twins", IJCB, 2011
Face Marks for Distinguishing Identical Twins
![Page 44: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/44.jpg)
44
Securing Biometric Systems
SensorFeature
Extractor MatcherApplication Device
(e.g.,cash dispenser)
StoredTemplates
1. FakeBiometric
2. ReplayOld Data
3. OverrideFeature Extractor
Yes/No
8. Override Final Decision
5. OverrideMatcher
4. SynthesizedFeature Vector
7. Interceptthe Channel
6. ModifyTemplate
![Page 45: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/45.jpg)
Dummy finger
Fake or Spoof Biometric Input
Fake eyeball
Face disguise
Fake hand
![Page 46: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/46.jpg)
Fingerprint Forgery
• Time and attendance systems fooled by fake fingerprints
• Employees give spoofs of their fingerprints to colleagues
• Fine for being late ~$30; price of fake print ~$15
http://www.dailystar.co.uk/playlist/view/107571/Give-your-boss-the-finger/
![Page 47: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/47.jpg)
Fingerprint Alteration
Double-loop changed to left loop
Gus Winkler (1933)
![Page 48: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/48.jpg)
Spoof Face Detection
![Page 49: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/49.jpg)
Just Switch on the LEDs to foil Facial Recognition
http://www.theregister.co.uk/2013/01/22/infrared_specs_foil_facial_recognition/
These nifty goggles upset cameras with outward-facing infrared lights
![Page 50: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/50.jpg)
Biometric Template Protection
Feature Extraction
Matcher
Enrollment
Verification
Stored Templates
Stored Templates
Application A
Application B
Non-linkable (Enhances Privacy
by preventing cross-matching)
Non-invertible (Enhances System Security
by preventing intrusion attacks)
X X
Can we generate a non-invertible AND non-linkable biometric template without compromising the matching accuracy?
Template Protection
![Page 51: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/51.jpg)
51
User Concerns
• Will biometric recognition be used for
• tracking citizens?
• the intended purpose alone?
• linking multiple databases?
• What to do in case of misidentification?
![Page 52: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/52.jpg)
GPS Fingerprint: Identification Without Biometric Data
De Montjoye, Hidalgo, Verleysen & Blondel, “Unique in the Crowd: The Privacy Bounds of Human Mobility”, Scientific Reports, vol. 3, 2013
With just the anonymous location data, one can figure out “who you are” by tracking your smartphone. Patterns of our movements, when traced on a map, create something akin to a fingerprint, unique to every person.
52
![Page 53: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/53.jpg)
3D Fingerprint Phantom
Sunpreet S. Arora, Kai Cao, Anil K. Jain (MSU) and Nicholas G. Paulter Jr. (NIST)
2D Synthetic Fingerprint Image with
known characteristics
Generic 3D Finger Surface
![Page 54: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/54.jpg)
Summary
• Biometric recognition is indispensable in efforts
to enhance security and eliminate fraud
• Fingerprint matching has been successfully used
in forensics for over 100 years
• New deployments for civil registration, border
crossing, financial transactions
• Market for mobile devices is emerging
• Seamless integration, recognition under non-
ideal conditions, user privacy, system integrity
![Page 55: Technology for Human Recognitionbiometrics.cse.msu.edu/...TechnologyforHumanRecognitionNCVPRIP… · paper in Proc. IEEE (1971) Next Generation ... • Innocence project ... Sensor](https://reader031.vdocument.in/reader031/viewer/2022022607/5b82f9b27f8b9adc698c1559/html5/thumbnails/55.jpg)
Security v. Privacy