planar vehicle tracking using a monocular based multiple camera visual position system anthony...
TRANSCRIPT
![Page 1: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/1.jpg)
PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE
CAMERA VISUAL POSITION SYSTEM
Anthony HinsonApril 22, 2003
![Page 2: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/2.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 2 of 97
Overview
• Introduction• Image Processing
– Primitive– Statistical
• Planar Visual Positioning – Fundamentals– Application
![Page 3: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/3.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 3 of 97
Overview
• Testing and Results– Simulation– Actual
• Conclusions• Graphical User Interface• Future Work
– Surface Positioning– Time Based Models
• Demonstration and Questions
![Page 4: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/4.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 4 of 97
Link Page
IntroductionPrimitive Image
ProcessingStatistical Image
Processing
TestingPlanar Positioning
FundamentalsPlanar Positioning
Application
![Page 5: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/5.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 5 of 97
Link Page
Conclusions Future WorkGraphical User
Interface
![Page 6: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/6.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 6 of 97
Introduction
• Simple Monocular Vision Based Position System for Tracking of Indoor and Outdoor Vehicles
Concept
![Page 7: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/7.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 7 of 97
Introduction
• Uses Single or Multiple Cameras to Determine Vehicle Position and Orientation
Concept
![Page 8: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/8.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 8 of 97
Introduction
• Vehicle Position and Orientation Determined Via Tracking Features On Top of the Vehicle
Concept
![Page 9: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/9.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 9 of 97
Introduction
• Advantages– Well Suited for Indoor Vehicles– Accurate Position Information– Easy to Implement– Non-Intrusive to Environment or Vehicle– Not Specific to Certain Hardware– One-Time Setup
Concept
![Page 10: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/10.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 10 of 97
Introduction
• Advantages– Video Feed Can
Be Used for Monitoring and Positioning Simultaneously
Concept
![Page 11: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/11.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 11 of 97
Introduction
• Disadvantages– Reliability is Dependent on Environmental
Conditions– Accuracy Decreases with Range– Planar Positioning System (2D Only)
Concept
![Page 12: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/12.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 12 of 97
Image Processing
• Initial Image Processing Work– Some Routines Good for Basic Image
Enhancement– Largely Ineffective for Feature Extraction
Primitive
![Page 13: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/13.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 13 of 97
Image Processing
• ColorBias– Process – Shifts Individual Color Channel Values– Usage – Used for Hue Correction – Synopsis – Reasonably Fast and Effective
Primitive
Modified ImageOriginal Image
ColorBias
![Page 14: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/14.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 14 of 97
Image Processing
• ProgressiveSmooth– Process – Performs Weighted Averaging with
Neighboring Pixels– Usage – Used for Noise Removal and Anti-Aliasing– Synopsis – Effective but Slow
Primitive
Modified ImageOriginal Image
ProgressiveSmooth
![Page 15: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/15.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 15 of 97
Image Processing
• ColorDistinguish– Process – Removes Pixels that Are not Within the
User-Specified Range – Usage – Color Feature Extraction– Synopsis – Limited Functionality / No Longer Used
Primitive
Modified ImageOriginal Image
ColorDistinguish
![Page 16: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/16.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 16 of 97
Image Processing
• ColorRemove– Process – Removes Pixels that Are not Within the
User-Specified Range – Usage – Removes Unwanted Colors– Synopsis – Limited Functionality / No Longer Used
Primitive
Modified ImageOriginal Image
ColorRemove
![Page 17: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/17.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 17 of 97
Image Processing
• Threshold– Process – Removes Pixels with Values Less Than User-
Specified Boundary– Usage – Removes Dark Pixels / Was Typically Used to
Enhance Edge Information– Synopsis – No Longer Used
Primitive
Modified ImageOriginal Image
Threshold
![Page 18: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/18.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 18 of 97
Image Processing
• EdgeDetect– Process – Calculates Color Discrepancy Between
Adjacent Pixels – Usage – Finds Edges of Color Boundaries– Synopsis – Relatively Fast and Effective
Primitive
Modified ImageOriginal Image
EdgeDetect
![Page 19: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/19.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 19 of 97
Image Processing
• ScreenText– Process – Writes Alphanumeric Characters to a Video
Pixel Array– Usage – Currently Used to Display Range Data in
Video Stream– Synopsis – Works Very Well
Primitive
Modified ImageOriginal Image
ScreenText
![Page 20: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/20.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 20 of 97
Image Processing
• Primitive Image Processing Functions Insufficient for Visual Positioning – Work Reasonably Well on Simulated Images– Work Poorly on Experimental Images
Primitive
![Page 21: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/21.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 21 of 97
Image Processing
• Desired Capabilities of Feature Classifier– Capable of Handling Simulated Data– Capable of Handling Experimental Data– Fast Processing Speed
Statistical
![Page 22: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/22.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 22 of 97
Image Processing
• Color Space (RGB Space)– All Possible
Digital Colors Represented by Cube with Dimension of 256
– Each Axis Represents Color
Statistical
![Page 23: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/23.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 23 of 97
Image Processing
• In RGB Space– Color Distributions Have Physical Meaning– Distributions Can be Represented by 3D
Shapes in RGB Space
Statistical
![Page 24: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/24.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 24 of 97
Image Processing
• In RGB Space– Data from an
Image Can be Displayed as Data Points in RGB Space
Statistical
![Page 25: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/25.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 25 of 97
Image Processing
• Color Classifiers Used in This Research– Color Range– Normalized Color Direction– 3D Gaussian Color Distribution– 2D Normalized Gaussian Color Distribution
Statistical
![Page 26: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/26.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 26 of 97
Image Processing
• Color Range– Basically Same as
ColorDistinguish – Distribution Defined
by High & Low Values for Each Color Channel Separately
– Distribution is Represented by a Box in RGB Space
Statistical
![Page 27: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/27.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 27 of 97
Image Processing
• Color Range– High/Low Values Determined
By 1-D Gaussian Distributions for Each Color Channel
• High Value = + n• Low Value = – n
– Pixels Located Inside the Box are Considered to be Target Color
Statistical
![Page 28: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/28.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 28 of 97
Image Processing
• Color Range– Advantages
• Very Fast
– Disadvantages• Not Very Precise• Typically Yields High Error
Statistical
![Page 29: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/29.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 29 of 97
Image Processing
Color Range Sample Image
Statistical
Processed ImageOriginal Image
![Page 30: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/30.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 30 of 97
Image Processing
• Color Range in RGB Space– Black: Correctly
Classified Non-Feature pixels
– White: Correctly Classified Feature Pixels
– Blue: Missed Feature Pixels
Statistical
![Page 31: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/31.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 31 of 97
Image Processing
• Color Direction– Searches for Pixels
Using Color Vectors in RGB Space
– Distribution is Defined as a Target Color and Range
– Resulting Distribution Shape is a Conic Section
Statistical
![Page 32: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/32.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 32 of 97
Image Processing
• Color Direction– Color Normalization Equations
• Converts Discreet Color Value to Normalized Color Direction Vector
Statistical
![Page 33: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/33.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 33 of 97
Image Processing
• Color Direction– Distribution Defined By:
• Target Color (Mean of Normalized Feature Pixels)
Statistical
![Page 34: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/34.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 34 of 97
Image Processing
• Color Direction– Distribution Defined By:
• Color Direction Variance (Each Color Separate)
Statistical
![Page 35: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/35.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 35 of 97
Image Processing
• Color Direction– Distribution Defined By:
• Any Pixel with a Color Direction Between + nand – nis Considered to be Feature Pixel
Statistical
![Page 36: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/36.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 36 of 97
Image Processing
• Color Direction– Advantages
• Discards Brightness Information• Can Find Colors in the Light or Shadows• Inherently Compensates for Scattered Color Data
– Disadvantages• More Likely to Have False Hits on Similar Colored
Objects in Scene
Statistical
![Page 37: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/37.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 37 of 97
Image Processing
Color Direction Sample Image
Statistical
Processed ImageOriginal Image
![Page 38: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/38.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 38 of 97
Image Processing
• Color Direction RGB Space – Black: Correctly
Classified Non-Feature pixels
– White: Correctly Classified Feature Pixels
– Blue: Missed Feature Pixels
– Red: False Hit Pixels
Statistical
![Page 39: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/39.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 39 of 97
Image Processing
• 3D Gaussian Distribution– Classifies Data
According to a Normal Distribution
– Classifier is Represented by a 3D Ellipsoid in RGB Space
Statistical
![Page 40: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/40.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 40 of 97
Image Processing
• 3D Gaussian Distribution– Classifier’s Shape and Position are Defined
By:• Mean Color of Feature Data• Variance Within Each Color Channel• Covariance Between Color Channel
Statistical
![Page 41: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/41.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 41 of 97
Image Processing
• 3D Gaussian Distribution– Probability Density Function (PDF)
– Where
Statistical
![Page 42: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/42.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 42 of 97
Image Processing
• 3D Gaussian Distribution– Variance Calculations
Statistical
![Page 43: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/43.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 43 of 97
Image Processing
• 3D Gaussian Distribution– Exponential Part of PDF Can be Used to
Assess Membership of Pixel to the Distribution
– r is known as Mahalanobis Distance
Statistical
![Page 44: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/44.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 44 of 97
Image Processing
• 3D Gaussian Distribution– Mahalanobis Distance
• The Number of Standard Deviations The Current Pixel is from the Mean
• Any Pixel with an r of Less Than User-Specified Value is Considered Member of Distribution
Statistical
![Page 45: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/45.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 45 of 97
Image Processing
• 3D Gaussian Distribution– Advantages
• Very Accurate for Most Distributions• Compensates for Data Clusters at Any Location
and Orientation in RGB Space
– Disadvantages• Color Distribution Must Be Relatively Gaussian in
Distribution
Statistical
![Page 46: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/46.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 46 of 97
Image Processing
3D Gaussian Distribution Sample Image
Statistical
Processed ImageOriginal Image
![Page 47: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/47.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 47 of 97
Image Processing
• 3D Gaussian RGB Space – Black: Correctly
Classified Non-Feature pixels
– White: Correctly Classified Feature Pixels
– Blue: Missed Feature Pixels
– Red: False Hit Pixels
Statistical
![Page 48: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/48.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 48 of 97
Image Processing
• 2D Normalized Gaussian Distribution– Hybrid of 3D
Gaussian and Color Direction
– Converts 3D Color Cube to 2D Color Triangle
Statistical
![Page 49: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/49.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 49 of 97
Image Processing
• 2D Normalized Gaussian Distribution– Color Data Reduced to 2 Dimensions
• Removes Brightness Information• Bivariate Gaussian Classifier
– Classifier Shape is an Ellipse within the Color Triangle
Statistical
![Page 50: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/50.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 50 of 97
Image Processing
• 2D Normalized Gaussian Distribution– Color Data Flattening (Convert RGB
Coordinates to XY Coordinates)
Statistical
![Page 51: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/51.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 51 of 97
Image Processing
• 2D Normalized Gaussian Distribution– Multivariate Distribution
– Where
Statistical
![Page 52: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/52.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 52 of 97
Image Processing
• 2D Normalized Gaussian Distribution– Advantages
• Same As Color Direction Classifier • Allows for Better Classification Than Color
Direction
– Disadvantages• Same As Color Direction Classifier • Slower Than Color Direction
Statistical
![Page 53: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/53.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 53 of 97
Image Processing
2D Normalized Gaussian Distribution Sample Image
Statistical
Processed ImageOriginal Image
![Page 54: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/54.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 54 of 97
Image Processing
• RGB Space 2D Normalized Gaussian Distribution– Black: Correctly
Classified Non-Feature pixels
– White: Correctly Classified Feature Pixels
– Blue: Missed Feature Pixels
– Red: False Hit Pixels
Statistical
![Page 55: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/55.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 55 of 97
Planar Positioning
• Planar Positioning Concepts– Camera View Compresses 3D View to 2D– Each Pixel Represents a Vector to an Object
in Space– Distance to the Object is Unknown– Point at Where Pixel Vector Intersects Object
in Space Must be Found
Concepts
![Page 56: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/56.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 56 of 97
Planar Positioning
• Planar Positioning Concepts– Intersection Can be Found if Pixel Vector
Intersects a Plane– Each Pixel Will Represent a Finite Area on
the Plane
Concepts
![Page 57: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/57.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 57 of 97
Planar Positioning
• Quantities Needed For Reconstruction of 3D Data– Extrinsic Camera Properties
• X, Y, and Z Coordinates of Camera• Pan, Tilt, and Slant Angles of Camera
– Intrinsic Camera Properties• Field of View in Horizontal and Vertical
– Video Capture Device Properties• Resolution of Video Capture
– Planar Properties• Coordinates of Plane (D;A,B,C)
Concepts
![Page 58: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/58.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 58 of 97
Planar Positioning
• Determining Required Input Data– Tracking Plane Must be Defined (Typically Parallel or
Coincident with Ground)– Camera Must be Placed in Position to Be Able to See
Plane– Video Capture Hardware Must be Initialized to
Determine Capture Resolution
Procedure
![Page 59: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/59.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 59 of 97
Planar Positioning
Creating Tracking Data Lookup Table (LUT)
Procedure
• Define Pixel Grid– Camera Placed at
Home Location– Image Plane
Assumed to be at Unit Distance from Origin in Y-Direction
![Page 60: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/60.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 60 of 97
Planar Positioning
Creating Tracking Data Lookup Table (LUT)
Procedure
• Define Pixel Grid– Image Plane
Boundaries Determined Trigonometrically Using Fields of View in Horizontal and Vertical
![Page 61: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/61.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 61 of 97
Planar Positioning
Creating Tracking Data Lookup Table (LUT)
Procedure
• Define Pixel Grid– Image Plane Area
Divided Into Pixel Grid Corresponding to Capture Resolution
– Intersections of Gridlines are Referred to as Pixel Grid Nodes
![Page 62: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/62.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 62 of 97
Planar Positioning
Creating Tracking Data Lookup Table (LUT)
Procedure
• Define Pixel Grid– Pixel Grid Node
Locations are Recorded in Homogenous Coordinates Format
(w;x,y,z)
![Page 63: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/63.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 63 of 97
Planar Positioning
• Translate & Rotate Pixel Grid – Pixel Grid Points
Translated to Camera XYZ Location By Multiplying Each Point by Translation Matrix
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 64: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/64.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 64 of 97
Planar Positioning
• Translate & Rotate Pixel Grid – Pixel Grid Points
Rotated to Camera Orientation By Multiplying Each Point by Three Rotation Matrices
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 65: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/65.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 65 of 97
• Translation and Rotation Matrices
Planar PositioningProcedure
Creating Tracking Data Lookup Table (LUT)
![Page 66: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/66.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 66 of 97
Planar Positioning
• Create Pixel Node Vectors – Vectors Created
Between Focal Point of Camera and Pixel Grid Nodes
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 67: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/67.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 67 of 97
Planar Positioning
• Create Pixel Node Vectors – Vectors Represented
in Terms of Plücker Line Coordinates
or
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 68: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/68.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 68 of 97
Planar Positioning
• Create Planar Intersection Points– Intersection Between
All Vectors and Plane Can be Found
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 69: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/69.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 69 of 97
Planar Positioning
• Projective Geometry – Intersection of Line and Plane Determine a Point
Equation of Line Equation of Plane
Intersection of Line and Plane=
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 70: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/70.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 70 of 97
Planar Positioning
• Determine Pixel Areas– Each Pixel Node
Intersection Point Corresponds to the Corner of a Pixel Area
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 71: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/71.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 71 of 97
Planar Positioning
• Calculate Pixel Centroids– Pixel Centroid is the
Average of the Four Corners of Pixel Area
– The Centroid Represents the Coordinates that the Pixel Represents in Space
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 72: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/72.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 72 of 97
Planar Positioning
• Calculate Pixel Centroids– Error Represented by
Maximum Distance from Centroid to Area Vertex
Procedure
Creating Tracking Data Lookup Table (LUT)
![Page 73: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/73.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 73 of 97
Planar Positioning
• Environment Setup for Planar Positioning– Vehicle Drive Path Must be Planar– Cameras Must Cover All Drive Areas
Application
![Page 74: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/74.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 74 of 97
Planar Positioning
• Vehicle Setup for Planar Positioning– Vehicle Must Have 2 Tracking Features
Distinguishable from Rest of Image Residing in a Plane Parallel to Ground
Application
![Page 75: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/75.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 75 of 97
Planar Positioning
• Setup for Planar Positioning– Camera Properties Must be Precisely Defined
• Intrinsic• Extrinsic
– Environment Must be Accurately Mapped• Boundaries • Obstacles
– Tracking Plane Must be Defined as the Plane the Tracking Features are in
Application
![Page 76: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/76.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 76 of 97
Planar Positioning
• Using Planar Positioning– Tracking
Information is Displayed for Allowed Areas
Application
![Page 77: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/77.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 77 of 97
Testing & Results
• Test #1: Simulated Warehouse
Test #1
– Three Camera Views• Camera2• Camera3• Camera6
![Page 78: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/78.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 78 of 97
Testing & ResultsTest #1
• Initial Test– Gridline
Match up• Check to See
if Grid Lines Up With Walls
![Page 79: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/79.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 79 of 97
Testing & Results
• Test #1: Simulated Warehouse
Test #1
– Initial Test• Gridline
Match up
![Page 80: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/80.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 80 of 97
Testing & Results
• Results– Red:
Measured– Green:
Camera2– Blue:
Camera3– Magenta:
Camera6
Test #1
![Page 81: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/81.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 81 of 97
Testing & ResultsTest #1
• Results– Error Typically Less Than 1%– Some Feature Classifier Break-Down at Far Distances
![Page 82: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/82.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 82 of 97
Testing & Results
• Test #2: Desktop Rover
Test #2
– Miniature Remote Control Tank-like Vehicle
![Page 83: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/83.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 83 of 97
Testing & ResultsTest #2
• Test Setup– 2 Cameras– Poster board
grid • 4x4 Major
Gridlines• 1x1 Minor
Gridlines
![Page 84: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/84.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 84 of 97
Testing & ResultsTest #2
• Initial Gridline Test– Software Gridlines
Overlay Match Existing Gridlines Well
![Page 85: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/85.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 85 of 97
Testing & ResultsTest #2
![Page 86: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/86.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 86 of 97
Testing & ResultsTest #2
• Results– Blue:
Camcorder– Magenta:
Sony CCD– Yellow:
Calculated Position
– Red: Measured Position
![Page 87: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/87.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 87 of 97
Testing & ResultsTest #2
• Results– 1% to 2% Error Typically– Slightly Higher Error from Sony CCD Camera at More
Distant Locations– Vehicle Location Lost Occasionally from Camcorder
Video
![Page 88: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/88.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 88 of 97
Testing & ResultsTest #3
• Test #3: Remote Controlled Truck– Inexpensive
Radio Controlled Truck
![Page 89: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/89.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 89 of 97
Testing & ResultsTest #3
• Test Setup– 3 Camera Test
• Panasonic Camcorder• Sony XC711 Industrial Camera• X10 Wireless Camera (Onboard)
– Vehicle Tested on Tiled Floor Space• 8x8 Inch Floor Tiles Used as External Reference
Point for Analyzing Tracking Data
![Page 90: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/90.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 90 of 97
Testing & ResultsTest #3
• Initial Gridline Test– Gridlines
Match Tile Grid Well
![Page 91: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/91.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 91 of 97
Testing & ResultsTest #2
![Page 92: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/92.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 92 of 97
Testing & ResultsTest #3
• Results– Blue:
Camcorder– Magenta:
Sony CCD– Yellow:
Calculate Position
– Red: Measured Position
![Page 93: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/93.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 93 of 97
Testing & ResultsTest #3
• Results– Significant Classifier Breakdown with Distance or
Lighting Changes– Problematic Camera Model for Sony CCD Camera– Data from Sony CCD Camera Stayed Within 3% Error
![Page 94: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/94.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 94 of 97
Testing & ResultsTest #4
• Test #4: Warehouse Test– Lighting
Conditions Very Poor
– Feature Color Information Washed Out
– Test had to be Discarded
![Page 95: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/95.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 95 of 97
Conclusions
• Planar Visual Position System Works Well When:– Vehicle and Environment are Measured Well– Camera Properties are Known – Classifiers are Well-Defined
• Classification Technique Needs to Be Improved – Works Well with Simulations and Controlled
Environments– Classifier Breaks Down when Conditions Become Bad
![Page 96: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/96.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 96 of 97
Future Work
• Adapt Live Video Capabilities• Surface Positioning
– Extend to Non-Planar Surfaces
![Page 97: PLANAR VEHICLE TRACKING USING A MONOCULAR BASED MULTIPLE CAMERA VISUAL POSITION SYSTEM Anthony Hinson April 22, 2003](https://reader038.vdocument.in/reader038/viewer/2022110211/56649ef65503460f94c0a67e/html5/thumbnails/97.jpg)
Cen
ter
for
Inte
llig
en
t M
ach
ines a
nd
Rob
oti
cs
Slide 97 of 97
Questions & Demo
Questions ?