University at Buffalo

Center for Unified Biometrics and

Sensors

March 2011

Overview

• Unique Capabilities

• Sponsors – Biometrics projects at CUBS

• Technology Transfer Record

• Current Leveraged Projects

• People – Faculty, Staff, Students

• Biometrics Community Leadership

Unique Capabilities

• Faculty strengths in multiple disciplines

• Behavioral Sciences, Social Issues

• Computer Vision, Visualization

• Chemical and Biological Sensors

• Pattern Recognition, Machine Learning

• Smart Environments, Pervasive Computing

• Spectroscopy

• Solid record of transferring of technology to field

• Large pool of current PhD students

• Growing pool of PhD alumni in industry

• Several current projects with industry

Sponsors(last 5 years)

• ACIS, Buffalo, NY

• Applied Media Analysis, College Park, MD

• BBN Technologies, Cambridge, MA

• Buffalo Computer Graphics, Blasdell, NY

• CUBRC, Cheektowaga, NY

• Fujitsu, Sunnyvale, CA

• HP Labs, India

• Health Transaction Network, Williamsville, NY

• Matrix, Niagara Falls, NY

• Ultra-Scan, Amherst, NY

• Army Research Labs

• Defense Intelligence Agency (DIA)

• Directorate of Central Intelligence (DCI)

• National Endowment of Humanities (NEH)

• National Science Foundation (NSF)

• NYSTAR

• Oishei Foundation

Technology Transfer

"USPS issued a contract to SUNY Buffalo to develop the handwriting recognition technology. ….. an estimated 400 million pieces of mail were automatically routed ….. saved the Postal Service at least $90 million in its first year in the field.

4 US patents awardedBiometric convolution; Handwriting comparisons; Diagnosis of physiological states; Handwriting recognition

4 US patents pending

Licensed technology to industry

Fingerprint hashing; Deceit and verity; Document classification; Document Imagecapture

Kyos Systems, Xact Data, Buffalo Computer Graphics, Lockheed Martin

USPS 1999 Annual Report

Current ProjectsLeveraged

1. Anthropometry

2. Cryptography

3. Fingerprint Indexing

4. Fusion

5. Handwriting Forensics

6. People Tracking

7. Lip Reading, Gaze Tracking

8. Sensors

9. Soft Biometrics

10.Web Security

Anthropometrics

Type

Description Hair and eye color

I very light, also "Celtic" Tends to have freckles, red or blond hair, blue or green eyes.

II light, or light-skinned European Tends to have light hair, blue/green or brown eyes.

III light intermediate, or dark-skinned European or "average Caucasian"

Tends to have brown hair and eyes.

IV intermediate, also Mediterranean or Olive

Tends to have dark brown eyes and hair.

V dark or Brown Often has dark brown eyes and hair.

VI very dark, or Brown-Black Usually has black-brown eyes and hair.

SKIN TONE

CryptographyCancelable Biometrics

Fingerprint verification

Image

Image

Fingerprint enrollment

Minutiae

Minutiae

h , h11 12

h , h21 22

h' , h'11 12

h' , h'21 22

Hashes

Hashes

FingerprintHash

Database

Store

Match

Fingerprint Indexing

Enrollment PhaseSearching Phase

Fusion

Handwriting Forensics

Lip Reading, Gaze Tracking

Did Bob and Frank meet at the library yesterday?Given building map, occupants, schedules, sensor locations

Unobtrusive People TrackingFreedom from Continuous Surveillance

RECOGNIZE

RETRIEVE

REASON Evolutiona

ryRecognitio

n

SensorsSkin spectroscopy and “liveness”

Soft BiometricsAge Estimation

Soft BiometricsExpressions

Facial Expression Manifold

FACS

FEAR

HAPPY

ANGER

SAD

+ + =

AU 1 AU 2 AU 4 AU 1, 2 & 4

+ =

AU 6 AU 12 AU 6 & 12

+ + =

AU 1 AU 4 AU 15 AU 1, 4 & 15

FEAR

HAPPY

SAD

Soft BiometricsEmotional States

Soft BiometricsSemantic Face Retrieval

Original Set Q: The suspect is male 1st

Iteration

Pruned SetQ: The suspect has a beard 2nd

Iteration

Pruned Set 3rd Iteration

SUSPECT

Q: The suspect wears spectacles

Soft Biometrics

Crash scene analysis

Web SecurityVerify humanness

English!

MACHINES FAIL

HUMANS SUCCEED

Synthetic handwriting generator poses questions in varying writing styles

PeopleFaculty

Venu GovindarajuSUNY Distinguished

ProfessorMachine LearningDirector

Atri RudraAssistant ProfessorCryptography, Coding theory

Raymond FuAssistant

ProfessorComputer Vision,

Visualization

Mark FrankProfessorBehavioral Sciences

Frank BrightSUNY Distinguished ProfessorBiological, Chemical Sensors

Alex CartwrightProfessorSpectroscopy, Photonics

PeopleStaff

• Amal HarbCommunications SpecialistInformatics, Psychology

• Ifeoma NwoguResearch Scientist

Computer Vision, Ontology

• Zhixin ShiSenior Research ScientistMathematics

• Philip KilinskasSoftware Engineer

Systems

• Ranga SetlurPrincipal Research ScientistPattern Recognition Systems

• Sergey Tulyakov Research Scientist

Biometrics Fusion

PeopleCurrent PhD students; Research topics

• Xi Cheng Biometric Fusion

• Gaurav Kumar Mobile Device Apps

• Utkarsh Poruwal People Tracking

• Chetan Ramaiah Writer Identification

• Manavender Reddy Gesture Recognition

• Ricardo N. Rodriguez Multimodal Fusion

• Arti Shivaram Mobile Device Apps

• Safwan Wshah Arabic Handwriting Recognition

• Daekeun You Medical Analytics

• Yingbou Zhou Image Segmentation

Ph.D. Alumni (20)2010 X. Peng   Raytheon - BBN Technologies, MA

2010 A. Bhardwa Ebay, CA

2010 A. O. Thomas Yahoo! Research, CA

2009 I. Nwogu University of Rochester, NY

2009 J. Li University of Memphis, TN

2008 Z. Zhang IBM, NY

2008 H. Cao Raytheon - BBN Technologies

2008 R. V. Yampoliskiy University of Louisville, KY

2008 F. Farooq Siemens Medical Solutions, PA

2008 P. Mansukhani L1 Biometrics, NJ

2007 A. Rusu Fairfield University, CT

2007 C. Wu Digital Persona, CA

2007 S. Kompalli HP, India

2006 R. Milewski Tokyo University, Japan

2006 S. Tulyakov University at Buffalo, NY

2005 T. Jea IBM, NY

2005 H. Lei University of N. Texas, Brownsville, TX

2003 A. Teredesai   University of Washington, Tacoma, WA

2002 H. Xue   IBM, NY

2001 I. Krassimir Fair Isaac Inc.

Leadershipin Biometrics Community

Program ChairCVPR Biometrics Workshop Series 2006-2011

Program Co-ChairBiometrics: Theory, Applications, and Systems, BTAS 2007-2008

General ChairAutomatic Identification Advanced Technologies AutoID 05

Program CommitteeBTAS 2008-10, Biometric Symposium 2006-08, International Conference on Biometrics, 2007, SPIE Biometric Technology for Human Identification2009-10, International Joint Conference on Biometrics, 2011

IEEE Biometric Council Website Initiative 2011 Website Design, Construction, Hosting, and Maintenance

Contact

Venu Govindaraju

venu@cubs.buffalo.edu

University at Buffalo

State University of New York