object detection20170930... · what is an object detection? find a target object in an given image....

23
Presenter: Dae-Yong Object Detection Part1

Upload: others

Post on 17-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Presenter: Dae-Yong

Object Detection

Part1

Page 2: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Contents

1. What is an Object Detection?

2. Traditional Object Detector

3. Deep Learning-based Object Detector

Page 3: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

What is an Object Detection?

Subset of Object Recognition

Page 4: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

What is an Object Detection?

Scene Categorization

Urban/Intersection

Object Segmentation

Object Categorization(Classification)

Car Pedestrian Bus Tree

Object Detection

CarCar

Car

Bus

Ped

Object Recognition

Page 5: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

What is an Object Detection?

Find a target object in an given image.

Input Output

Image Sequence

Car Car

Car

Bus

Ped

- Object Class- Object Location(x, y, width, height)

3 Channels, 2D matrices

x

y 1. Car, (0, 250, 120, 125)2. Car, (80, 256, 60, 40)3. Car, (140, 245, 130, 120)4. Pedestrian, (400, 247, 20, 70)5. Bus, (520, 0, 110, 320)

R

G

B

Page 6: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

How can we know where objects are and what they are?

- Traditional approach

- Deep Learning-based approach

Object Detection

Input Image

Feature Extraction

Candidate Generation

ClassificationDetection Output

Deep Neural NetworkInput Image

Detection Output

Page 7: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Page 8: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

Feature Extraction

Candidate Generation

ClassificationDetection Output

Target Object

Page 9: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

Feature Extraction

Candidate Generation

ClassificationDetection Output

Target Object

Page 10: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

Feature Extraction

Candidate Generation

ClassificationDetection Output

Target Object

Page 11: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

Feature Extraction

Candidate Generation

ClassificationDetection Output

Sliding window

“Image Pyramid”Siz

eScale

Page 12: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

Feature Extraction

Candidate Generation

ClassificationDetection Output

Pedestrian

Page 13: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

ClassificationDetection Output

Candidate Generation

Feature Extraction

[Candidate Generation]

- Sliding Window Search

- Selective Search

- Multiscale Combinatorial Grouping (MCG)

- Edge-Box

- Binarized Normed Gradient (BING)

[Feature Extraction]

- Color / Brightness / Gradient

- Haar Feature

- Scale Invariant Feature Transform(SIFT)

- Local Binary Pattern(LBP)

- Histogram Oriented Gradient(HOG)

HOG

Gradient

Object Proposal

Page 14: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection

Input Image

ClassificationDetection Output

Candidate Generation

Feature Extraction

[Classification]

- AdaBoost

- Random Forest

- Support Vector Machine (SVM)

- Latent Support Vector Machine (L-SVM)

Page 15: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Traditional Object Detection (Demo)

Target Object: REAR Vehicle

Feature: LBP Classifier: Cascade Classifier

Page 16: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Deep Learning-based Object Detection

Page 17: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Deep Learning-based Object Detection

Input Image

Deep Neural Network(Classification)

Detection Output

Candidate Generation

Apply image classification network to each object candidates

Input image

Generate object candidates

Image Classification (AlexNet)

Car

BusDetection Output

1

2

3

4

Regions with CNN features (R-CNN), 2013

Page 18: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Deep Learning-based Object Detection

How convolutional neural network is worked on the image?

Conv. Filter

Input Image

1st Feature Map

2nd Feature Map

Conv. Filter

Page 19: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Deep Learning-based Object Detection

Fast Region-based Conv. Neural Net. (Fast R-CNN), April, 2015

Computational cost is proportionally increasedaccording to the number of candidates.

Input image

Generate object candidates

Image Classification (AlexNet)

Car

BusDetection Output

1

2

3

4

ROI Projection

Deep Conv Net. ROI PoolingFully Conn.

Input Image

Deep Neural Network(Classification)

Detection Output

Candidate Generation

Page 20: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Base model: AlexNet / VGG

Deep Learning-based Object Detection

Input Image

Deep Neural NetworkDetection Output

Input image

Car

BusDetection Output1

2

3

Deep Conv Net.

ROI Pooling Fully Conn.

Faster Region-based Conv. Neural Net. (Faster R-CNN), June, 2015

Feature Maps

Region Proposal Net.

Page 21: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Deep Learning-based Object Detection

You Only Look Once (YOLO)

Single Shot MultiBox Detector (SSD)

Page 22: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,

Design Basic Object Detector- Feature: HOG Features- Classification: SVM- Practice with toy example

Next Presentation

Part2: Traditional Object Detection from Scratch

Part3: Deep Learning-based Object Detection I

?

Part4: Deep Learning-based Object Detection II

?

Page 23: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,