object recognition 2cvlab.khu.ac.kr/cvlecture20.pdf · 2018-11-27 · vgg net 4 vgg “very deep...

37
Object Recognition 2 Computer Vision

Upload: others

Post on 07-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Object Recognition 2

Computer Vision

Page 2: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 3: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Alex Net

3

“ImageNet Classification with Deep Convolutional Neural Networks”, 2012

- ImageNet - ReLU, Dropout, Data augmentation

Page 4: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

VGG Net

4

VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015

- ILSVRC 2014 Winner (localization and classification) - 3x3 conv, 2x2 pooling and deeper layers

Page 5: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

GoogLeNet

5

GoogleNet “Going deeper with convolutions”, 2014

- ILSVRC 2014 - Inception modules, more than 100 layers

Page 6: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

ResNet

6

MS ResNet “Deep Residual Learning for Image Recognition”, 2015

- ILSVRC 2015 Winner - Residual Block, 152 layers

Page 7: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

R-CNN

7

R-CNN “Rich feature hierarchies for accurate object detection and semantic segmentation”

- Object detection including classification

Page 8: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 9: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 10: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 11: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 12: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 13: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 14: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 15: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 16: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 17: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 18: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Object Recognition in 3D

Computer Vision

Page 19: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 20: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 21: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 23: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Introduction to the Literature

23

Page 24: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Top Conference in Computer Vision

1. CVPR

2. ICCV

3. ECCV

Top Journal in Computer Vision

1. IEEE TPAMI (IF: 9.455, JCR Ranking 2nd ~0.8%)

2. Springer IJCV (IF: 11.541, JCR Ranking 1st ~1.5%)

h-index: a scholar with an index of h has published h papers

each of which has been cited in other papers at least h times

Page 25: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 26: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 27: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 28: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

https://scholar.google.com/citations?view_op=top_venues&hl=en&vq=eng_computervisionpatternrecognition

Page 29: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

https://www.thecvf.com/ http://ieeexplore.ieee.org/

Page 30: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Oral presentation

Spotlight presentation

Poster presentation

CVPR 2018 conference

2 column < 9 pages

Peer Review by

AC & 3 Reviewers

~ 3300 submissions ~ 970 accepted papers

Page 31: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 32: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 33: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 34: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 35: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner
Page 36: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Final Project

Computer Vision

Page 37: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner

Topics 1. Stereo Matching Improvement

- 수업시간에 배운 방식으로 최적의 성능 내기 + Dynamic Programming 추가

- 기타 새로운 문제 해결 방식 추가: Occlusion, Hole filling, Boundary noise, thin object, non-textured region

Dataset: http://vision.middlebury.edu/stereo/data/scenes2014/

2. Panorama using Homography

- 신뢰도 높고 더 많은 Matching point pair 찾기: ex) SIFT, etc

- Homography 계산 정확도 향상, tone mapping

Dataset: use your own pictures (more than 10 images)

3. Change Detection

- 개선된 Detection Result

- 노이즈 제거, Clutter 제거, Morphological post procession

Dataset: http://jacarini.dinf.usherbrooke.ca/static/dataset/badWeather/skating.zip

4. CNN based Classification using Tensorflow and MNIST

- 개선된 Classification Result on distorted (affine, occlusion, noisy) test images

제출 내용: Commented Source Code, Result Images, Report Document

Pick one!!!!