license plate recognition (lpr) auto-gate system april 14 th, 2009 danny choi (president and ceo)...
TRANSCRIPT
![Page 1: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/1.jpg)
License Plate Recognition (LPR) Auto-gate System
April 14th, 2009
Danny Choi (President and CEO)Jaehoon Shin (CMO and CFO)
Wook Sun Shim (CTO and COO)
![Page 2: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/2.jpg)
• Introduction• Motivation• System Overview• Hardware
– Metal Detector– Microcontroller
• Communication Module• LPR System
– Camera Module– License Plate Locator– Letter Recognition
• Finances• Timeline• Final Thoughts• Questions and Answers
![Page 3: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/3.jpg)
License Plate Recognition System Convert the license plate number to ASCII
245 AFC
License Plate uniquely identifies vehicle. Various police forces
Electronic toll Collection Pay per use roads Monitoring traffic activity
![Page 4: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/4.jpg)
![Page 5: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/5.jpg)
Auto Theft◦ On an average day in B.C.
37 vehicles are stolen 62 vehicles are broken into
One third occurred in the private residences◦ Underground parking lots with Auto gate
“Stop until the gate close” No physical barrier !
![Page 6: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/6.jpg)
Auto-gate Parking Lot◦ Must carry key entry devices
Could be lost, stolen, or no battery
◦ RF signals can be stolen RF (radio frequency) remote control analyzer
Following after vehicles Walk-ins
No Physical barrier !
![Page 7: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/7.jpg)
LPR Auto-gate system: Virtual Barrier◦The system recognizes the vehicle and
checks for verification◦Following-after vehicles or walk-ins are
controlled ◦Alerting a trespassing and save the image
for further crime investigation and enforcement.
![Page 8: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/8.jpg)
Conveniences◦Eliminating the use of key entry device.◦Simply “come and enter”
No need to wait for the gate to close!◦Registering for guest vehicles:
Type in the plate number
![Page 9: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/9.jpg)
Block Diagram
Metal Detector
LPR System
MicrocontrollerBoard (LCD & LED)
![Page 10: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/10.jpg)
Logic Diagram
Capture&
ImageProcessing
GreenLED
Start
Vehicle? Verified?
Green?RedLED
RedLED & Alarm
YY
Y N
N
N
![Page 11: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/11.jpg)
![Page 12: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/12.jpg)
The Concept of Mutual Inductance
Main Components◦ TL072 (Dual Operational Amplifier), NE555
(Timer), a couple of Inductors
![Page 13: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/13.jpg)
![Page 14: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/14.jpg)
Microcontroller (Atmel ATmega168)◦ High density of various features (ADC, PWM,
LCD driver, and etc)◦ GNU Complier Collection (GCC) supported
Voltage Regulator (L7805)◦ 9V battery to 5V
LCD◦ 2x24 characters display◦ HD44780 protocol
Outputs (piezoelectric buzzer and LEDs)
![Page 15: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/15.jpg)
Vehicle detection◦ Road tube, Magnetometer sensor, Weigh-In-
Motion (WIM) , Piezoelectric sensor, and etc Microcontroller
AtmelATmega168
ZilogZ86E3416VSC
Speed 20MHz 16MHz
Memory 16K 16K
Ram 1Kb 512b
I/O pin 23 24
ADC Yes No
Package DIP-28 DIP-28
Price $4-5 $11
![Page 16: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/16.jpg)
RS232 serial I/O port◦ Cheaper and Simpler solution than USB!
Use CSerial source code
Baud Rate 115200
Data Bits 8
Parity None
Stop Bits 1
Flow Control None
![Page 17: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/17.jpg)
![Page 18: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/18.jpg)
Brain of the overall system. OpenCV – Computer Vision library by Intel. Module:
◦ Camera Module◦ License Plate Locator◦ (Skew Correction Module)◦ Letter Recognition Module◦ Verification Module
![Page 19: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/19.jpg)
![Page 20: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/20.jpg)
Grab a frame from a webcam Refresh the frame every 0.5 seconds If signal comes in from microcontroller, save
current frame.
![Page 21: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/21.jpg)
![Page 22: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/22.jpg)
Erosion:
Dilation:
Original:
![Page 23: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/23.jpg)
Erosion after Dilating the image:
Dilation:
Original:
![Page 24: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/24.jpg)
Dilation:
Grey Scaled:
![Page 25: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/25.jpg)
Erosion after Dilation:
Dilation:
![Page 26: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/26.jpg)
Subtract:
Threshold and Noise Filter
![Page 27: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/27.jpg)
![Page 28: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/28.jpg)
![Page 29: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/29.jpg)
Canny Edge Detection
![Page 30: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/30.jpg)
![Page 31: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/31.jpg)
Not integrated with the overall system.◦ Not every input image had detectable edges.◦ Assumption: the camera is in its fixed position,
almost perfectly parallel to the ground.◦ System can also recognize the letters from license
plate with tilt angle of ~10°
Other Possible Solutions:◦ Hough Transform◦ Radon Transform
![Page 32: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/32.jpg)
Localized Plate Invert Image Paint out margins Binary Image
![Page 33: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/33.jpg)
Cropped plate
![Page 34: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/34.jpg)
Character Segmentation
![Page 35: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/35.jpg)
Character Segmentation
Template Matching !
![Page 36: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/36.jpg)
![Page 37: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/37.jpg)
Not a character !
Ratio is not valid
![Page 38: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/38.jpg)
~
~
Template Matching
I, O, Q, U, Y, Z
![Page 39: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/39.jpg)
Identification
…SIX
![Page 40: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/40.jpg)
Identification
…B!
![Page 41: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/41.jpg)
616BBL_
![Page 42: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/42.jpg)
EquipmentEquipment Estimated CostEstimated Cost Actual CostActual Cost
CameraCamera $100 $0
Microcontroller & development kitMicrocontroller & development kit $300 $20
Metal detectorMetal detector $50 $0
Miscellaneous (LCD, cable, case, alarm, Miscellaneous (LCD, cable, case, alarm, etc)etc)
$50 $80
TotalTotal $500 $100
![Page 43: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/43.jpg)
EquipmentEquipment Market priceMarket priceProject Project
CostCost
CameraCamera $150 $0
Microcontroller & development kitMicrocontroller & development kit $20 $20
Metal detectorMetal detector $800 $0
Miscellaneous (LCD, cable, case,Miscellaneous (LCD, cable, case,alarm, etc)alarm, etc)
$400 $80
TotalTotal $1370 $100
![Page 44: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/44.jpg)
![Page 45: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/45.jpg)
![Page 46: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/46.jpg)
We learned:◦ Team dynamics◦ Digital Image Processing techniques◦ Programming in C/C++◦ Circuitry◦ Microcontroller
Challenges◦ A group of three members ◦ Localization
![Page 47: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/47.jpg)
Possible Future Works◦ Improve skew correction◦ Implement with actual gate (or motor)◦ Finer resolution camera◦ User Interface◦ More accurate LPR algorithm
“The complexity of each of these subsections of the program determines the accuracy of the system” (en.wikipedia.org/wiki/Automatic_number_plate_recognition)
![Page 48: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/48.jpg)
Dr. Parvaneh Saeedi Jun Kim Steve Whitmore Patrick Leung, P. Eng Jamie Westell Jason Lee
![Page 49: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/49.jpg)
Insurance Corporation of British Columbia (ICBC). 2008. Stop Auto Crime in Multi-Residential and Mixed-Use Buildings.
Insurance Corporation of British Columbia (ICBC). 2007. Auto Crime and Fraud.
Mia Dauvergne. Statistics Canada. 2008. Motor Vehicles Theft in Canada, 2007.
Statistics Canada. 2008. Motor Vehicle Theft. G. Baridski and A. Kaehler. 2008. Learning OpenCV:
Computer Vision with the OpenCV Library. C. WU, L. C. ON, C. H. WENG, T. S. KUAN, K. NG.
August 2005. A Macao License Plate Recognition System.
![Page 50: License Plate Recognition (LPR) Auto-gate System April 14 th, 2009 Danny Choi (President and CEO) Jaehoon Shin (CMO and CFO) Wook Sun Shim (CTO and COO)](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ea15503460f94ba4bc2/html5/thumbnails/50.jpg)