license plate identification amir ali ahmadi jonathan neville justin sobota mehmet ucal

27
License Plate License Plate Identification Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Upload: angel-eustacia-adams

Post on 15-Jan-2016

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

License Plate IdentificationLicense Plate Identification

Amir Ali AhmadiJonathan Neville

Justin SobotaMehmet Ucal

Page 2: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Outline

• Motivation

• Previous Work

• Approach

• Algorithms– Character Identification– Plate Extraction

• Results

• Conclusion/Future Work

Page 3: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Motivation

• Traffic Control

• Automated Ticketing

• Finding Stolen Cars

• High Speed Pursuit

Page 4: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Previous Work

• License Plate Identification/Recognition (LPI/R)– http://www.photocop.com/– Retrieves Plate Numbers for All States– Determines Speed– Several vendors

• Three algorithms for license number extraction

Page 5: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Previous Work

• Template Matching– Compares extracted characters to a set of

templates– Very reliable under standard conditions– Viewing angle, Lighting, plate size, etc. can

cause errors

Page 6: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Previous Work

• Structural Analysis– Uses geometric features and a decision tree to

determine character

– Very complex time-consuming analysis

Loops?# of Loops

Location of Loop?

Left Side Straight?B

8

yes

1

2 yes

no

no

top

bottom

middle

6

D

Page 7: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Previous Work

• Neural Networks– Trained by example– Adapt to characters’ distinctive feature– Performs well in bad conditions

Page 8: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Our Approach

• Template Matching

• Assumptions– Only white Maryland Plates– Camera angle directly behind car– 2 types of MD plates

• 6 characters with MD logo in center• 7 characters

Page 9: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Approach

Plate Extraction

Character Extraction

Template Matching

CharacterIdentification

Page 10: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Character Identification

Char. Extract

Support Set Extract

Comparison

Char.Filtering

TemplateFiltering

TemplateImages

LicensePlate

PlateNumber

Page 11: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Template Filtering

• Templates obtained from actual plates• Template Filtering

– RGB2Gray– Threshold (Black/White)– Resize

• Output array of templates

Page 12: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Character Extraction

• Plate resized to predetermined dimensions• Output array of extracted characters

Page 13: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Character Filtering

• RGB2Gray• Threshold (Black/White)• Median Filtering

Page 14: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Character Identification

Char. Extract

Support Set Extract

Comparison

Char.Filtering

TemplateFiltering

TemplateImages

LicensePlate

PlateNumber

Page 15: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Support Set Extraction

• Row sums• Column sums• Exclude low sums• Extract largest

continuous region• Resize to

template size

Page 16: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Comparison

?

?

Page 17: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Approach

Plate Extraction

Character Extraction

Template Matching

CharacterIdentification

Page 18: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Plate Extraction

• RGB2Gray• Threshold(Black/White)

• Row/Columnmeans

• Extract largestcontinuous whiteregion

Page 19: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Results for Character Identification

Input OutputLicense Identification

License Identification

License Identification

Page 20: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Results for Character Identification

Input OutputLicense Identification

License Identification

Page 21: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Results for Plate Extraction

Input OutputPlate Extraction

Page 22: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Results for Plate Extraction

Input OutputExtracted “M”

Page 23: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Failed Plate Extractions

Input OutputPlate Extraction

Page 24: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Failed Plate Extractions

Input OutputPlate Extraction

No Extracted Plate

No Extracted Plate

No Output

No Output

Page 25: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Conclusion

• Template matching approach was taken• Algorithm

– Plate Extraction– Character Identification

• Given the plates, we were able to identify almost all of the characters

• Plate extraction was limited to darker cars

Page 26: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Future Work

• Improve templates to better accommodate the plate characters

• Refine threshold levels for determining the whiteness in the picture

• Eliminate issues regarding glare, dirtiness of the plate, shadows, and white regions in the picture

• Dynamic character extraction – Character position found by the algorithm

Page 27: License Plate Identification Amir Ali Ahmadi Jonathan Neville Justin Sobota Mehmet Ucal

Demonstration