![Page 1: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/1.jpg)
Tools for Efficient Object Detection
Organizers:
ICCV 2015 Tutorial
Santiago, Chile, December 2015
![Page 2: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/2.jpg)
Rogerio Feris Classification Versus Detection
Slide Adapted from Ross Girshick
Classification: WHAT Detection: WHAT and WHERE
![Page 3: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/3.jpg)
Rogerio Feris
Efficient Object Detection
Object detection is arguably a harder problem than image classification
Usually a large number of image sub-windows need to be scanned in order to localize objects, leading to heavy computational processing
Challenge: In many real-world applications, running a fast object detector is as critical as running an accurate object detector.
![Page 4: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/4.jpg)
Rogerio Feris Applications MobilEye Forward Collision Warning [Click for video demo]
![Page 5: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/5.jpg)
Rogerio Feris Applications Funny Nikon ad: “"The Nikon S60 detects up to 12 faces."
Slide credit: Lana Lazebnik
![Page 6: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/6.jpg)
Rogerio Feris Applications IBM Intelligent Video Analytics [Click for video demo]
![Page 7: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/7.jpg)
Rogerio Feris Applications Body-worn Cameras [Click for video demo] (using Fast R-CNN)
![Page 8: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/8.jpg)
Rogerio Feris Applications Many more applications require real-time object detection…
Augmented Reality
Robotics
Wildlife Monitoring Self-Driving Cars
Mobile
![Page 9: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/9.jpg)
Rogerio Feris
Tutorial Overview
![Page 10: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/10.jpg)
Rogerio Feris
Goals:
Cover tools for speeding-up object detection while maintaining high accuracy
Focus on the state of the art
Focus on software tools instead of hardware acceleration
Provide pointers to publicly available source code
![Page 11: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/11.jpg)
Rogerio Feris How to design a detector running at 100 Hz (CPU only), step by step (Rodrigo Benenson)
What makes strong rigid templates Integral Channels and Aggregated Features Feature Approximation Across Scales Cascades Geometric Prior
Figure credit: Rodrigo Benenson and Piotr Dollar
![Page 12: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/12.jpg)
Rogerio Feris Region Proposals (Jan Hosang)
Grouping proposal methods Window scoring proposal
methods Metrics and in-depth analysis
Towards generic object detection: candidate region generation
Figure credit: Jan Hosang
![Page 13: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/13.jpg)
Rogerio Feris Regionlets for Generic Object Detection (Xiaoyu Wang)
Regionlet representation for handling object deformations Classification of region proposals based on boosted detector cascades Integration with CNN features
Figure credit: Xiaoyu Wang
![Page 14: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/14.jpg)
Rogerio Feris Tools for fast CNN-based Detection
Figure credit: Kaiming He
Kaiming He (Inference) Ross Girshick (Training)
“Slow” R-CNN Fast R-CNN
Faster R-CNN
![Page 15: Tools for Efficient Object Detection - IBMmp7.watson.ibm.com/ICCV2015/slides/FerisIntroduction.pdf · 2015-12-16 · Tools for Efficient Object Detection Organizers: ICCV 2015 Tutorial](https://reader034.vdocument.in/reader034/viewer/2022052320/5f0a41897e708231d42ac48f/html5/thumbnails/15.jpg)
Rogerio Feris Schedule
14:00 Introduction (Rogerio Feris)
14:15 Detecting objects at 100 Hz with rigid templates (Rodrigo Benenson)
15:00 Coffee Break
15:30 Region proposals (Jan Hosang)
16:00 Regionlet Object Detector with Hand-crafted and CNN Features (Xiaoyu Wang)
16:30 Convolutional Feature Maps: Elements of efficient CNN-based object detection (Kaiming He)
17:15 Training R-CNNs of various velocities: Slow, fast, and faster (Ross Girshick)
18:00 Concluding Remarks