video tracking g. medioni, q. yu edwin lei maria pavlovskaia
TRANSCRIPT
![Page 1: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/1.jpg)
Video Tracking
G. Medioni, Q. Yu
Edwin LeiMaria Pavlovskaia
![Page 2: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/2.jpg)
Goal
Track moving objects in a video stream
![Page 3: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/3.jpg)
Linking frames
Each frame registered with a satellite image
![Page 4: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/4.jpg)
Detecting Moving Regions
• A sliding window with the center frame as the reference
• Register each frame in the window to the reference
• A region is moving if it differs from the registered frames
• Moving regions are grouped into tracklets
![Page 5: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/5.jpg)
Tracklet Association
Motion
• Target remains within a reasonable distance between frames
Appearance
• Target has similar color distribution between frames
![Page 6: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/6.jpg)
Tracklet Evolution
Temporal moves• Change labels
Spatial moves• Change rectangles
at one instant
![Page 7: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/7.jpg)
Merge
![Page 8: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/8.jpg)
Pre-processing
Goal• Enhance given video before tracking
Methods• Auto levels• Adaptive auto levels
![Page 9: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/9.jpg)
Auto Levels
![Page 10: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/10.jpg)
Auto Levels
Histogram of pixel values
![Page 11: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/11.jpg)
Auto Levels
Modified histogram
![Page 12: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/12.jpg)
Auto Levels in Video
Concerns
• Algorithm should be fast
• Do not need to perform histogram computations for each frame
• Can not treat each channel separately
![Page 13: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/13.jpg)
Adaptive auto levels
![Page 14: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/14.jpg)
Adaptive auto levels
![Page 15: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/15.jpg)
Adaptive auto levels
![Page 16: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/16.jpg)
Minima cutoffs Maxima cutoffs
![Page 17: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/17.jpg)
Adaptive Auto Levels
![Page 18: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/18.jpg)
Post-processing
• Identify tracklets that are too short
• Highlight tracklets of interest
• Renumber tracklets
• Display tracklet labels
![Page 19: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/19.jpg)
Highlighting Tracklets
• Identify tracklets that are too short
• Highlight tracklets of interest
![Page 20: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/20.jpg)
Renumber tracklets
![Page 21: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/21.jpg)
Displaying Tracklet Labels
Goal: intelligently display a label next to every tracklet box
![Page 22: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/22.jpg)
Displaying Tracklet Labels
Desired specifications for label placement:
– Label must be near corresponding box
– Labels must be inside image boundary
– Labels should not overlap
– Labels should be far from other boxes
– Labels should be far from box corners
– Labels should not jump from frame to frame
– Algorithm must be fast
![Page 23: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/23.jpg)
Final Result
![Page 24: Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia](https://reader035.vdocument.in/reader035/viewer/2022070414/5697c00b1a28abf838cc8181/html5/thumbnails/24.jpg)
Thanks!