![Page 1: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/1.jpg)
1
Towards Weakly- and Semi- Supervised Object Localization and Semantic
Segmentation
Lecturer: Yunchao WeiImage Formation and Processing (IFP)
Grouphttps://weiyc.github.io
University of Illinois at Urbana-Champaign
![Page 2: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/2.jpg)
2
Fully Supervised Semantic Segmentation
Masks
…
Hard to Collect
![Page 3: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/3.jpg)
3
![Page 4: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/4.jpg)
4
100/C 5min/I
![Page 5: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/5.jpg)
5
Weakly Supervised Annotations
horse personhorse
person
scribbles points image-level labelsbounding boxes
The simplest and the most efficient one
![Page 6: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/6.jpg)
6
person
horsetable
images
annotations
…
…
Loc
Seg
Object Localization Maps
Our Targets
![Page 7: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/7.jpg)
7
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 8: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/8.jpg)
8
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 9: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/9.jpg)
9
Proposal-based Localization
Learning to Segment with Image-level Annotations. PR 2016
![Page 10: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/10.jpg)
10
Proposal-based Localization
Hypotheses-CNN-Pooling Localization Map Generation
o Exhaustedly examine each proposal to generate localization
o Introducing false negative pixels(background)
Weakness
Pascal VOC
43.2%
Learning to Segment with Image-level Annotations. PR 2016
![Page 11: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/11.jpg)
11
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 12: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/12.jpg)
12
Simple to Complex
Simple Images Complex Images
STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI 2017
![Page 13: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/13.jpg)
13
Simple images with the corresponding saliency maps
Simple to Complex
STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI 2017
![Page 14: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/14.jpg)
14
o Initial-DCNN
o Enhanced-DCNN
o Powerful-DCNN
Simple to Complex
STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI 2017
![Page 15: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/15.jpg)
15
Flickr-Clean (40K)
Simple to Complex
STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI 2017
![Page 16: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/16.jpg)
16
Networks Training Set mIoU
I-DCNN Flickr-Clean 44.1
E-DCNN Flickr-Clean 46.8
P-DCNN Flickr-Clean+VOC 49.8
Ablation Analysis on Pascal VOC12 val
o Collecting a large number of simple images
o Time consuming for training
Weakness
Simple to ComplexPascal VOC
43.2%
51.2%
STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI 2017
![Page 17: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/17.jpg)
17
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 18: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/18.jpg)
18
Adversarial Erasing
Small and sparse object localization maps Dense and integral object localization maps
dog bird cow
Previous works Our target
Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral)
![Page 19: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/19.jpg)
19
Adversarial Erasing
headconf: 1.0
body
conf: 0.8
foot
conf: 0.5
Motivation
Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral)
![Page 20: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/20.jpg)
20
Adversarial Erasing
Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral)
Our Solution Visualizations
![Page 21: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/21.jpg)
21
Adversarial Erasing
Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral)
The pipeline of weakly semantic segmentation based on AE
![Page 22: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/22.jpg)
22
Weakness of Adversarial Erasing
o Time consuming to learn several classification networks.
o Hard to determine how many AE steps should be conducted.
0 150
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
Epoch
Loss
AE-step4
AE-step3
AE-step2
AE-step1
Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral)
Pascal VOC
43.2%
51.2%
55.7%
![Page 23: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/23.jpg)
23
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 24: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/24.jpg)
24
Adversarial Complementary Learning
Imag
esC
AM
Ou
rs
…
Classification
…
GAP FC
Conv 1x1 GAP
CA
MO
urs
Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR 2018
Revisiting CAM
![Page 25: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/25.jpg)
25
Adversarial Complementary Learning
Detailed Framework
Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR 2018
Erasing
Thresholding
![Page 26: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/26.jpg)
26
Adversarial Complementary Learning
Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR 2018
![Page 27: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/27.jpg)
27
Adversarial Complementary Learning
Localization Comparison
Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR 2018
![Page 28: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/28.jpg)
28
Methods Top-1 err. Top-5 err.
Backprop on GoogleLeNet 61.31 50.55
GoogLeNet-GAP (CVPR 2016) 56.40 43.00
GoogLeNet-HaS-32 (ICCV 2017) 54.53 -
GoogLeNet-ACoL(Ours) 53.28 42.58
GoogLeNet-ACoL*(Ours) 53.28 35.22
Backprop on VGGnet 61.12 51.46
VGG-GAP (CVPR 2016) 57.20 45.14
VGGnet-ACoL(Ours) 54.17 40.57
VGGnet-ACoL*(Ours) 54.17 36.66
Adversarial Complementary Learning
Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR 2018
Localization error on ILSVRC validation set
Pascal VOC
43.2%
51.2%
55.7%
58.8%
![Page 29: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/29.jpg)
29
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 30: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/30.jpg)
30
Multi-dilated Convolution
Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight)
3x3
In
Out
Motivation
kernel
![Page 31: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/31.jpg)
31
o Multi-dilated Convolutional Network for Object Localization
Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight)
Multi-dilated Convolution
![Page 32: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/32.jpg)
32
Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight)
Multi-dilated Convolution
![Page 33: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/33.jpg)
33
o Weakly- and Semi- Supervised Semantic Segmentation
Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight)
Multi-dilated Convolution
![Page 34: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/34.jpg)
34
Multi-dilated Convolution
Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight)
Pascal VOC
43.2%
51.2%
55.7%
58.8%
60.8%68.5%
![Page 35: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/35.jpg)
35
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Achievements
![Page 36: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/36.jpg)
36
Transferable Semi-supervised Network
In-category Semi-supervised Semantic Segmentation (I3S)
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 37: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/37.jpg)
37
100/C 5min/I
![Page 38: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/38.jpg)
38
Transferable Semi-supervised Network
In-category Semi-supervised Semantic Segmentation (I3S)
Cross-category Semi-supervised Semantic Segmentation (C3S)
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 39: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/39.jpg)
39
Label Transfer Network(L-Net)
Prediction Transfer Network(P-Net)
Transferable Semi-supervised Network
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 40: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/40.jpg)
40
denotes the standard element-wise binary cross-entropy loss
Transferable Semi-supervised Network
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 41: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/41.jpg)
41
Classification Activation Map
Transferable Semi-supervised Network
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 42: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/42.jpg)
42
Random Walk based self-diffusion algorithm
Transferable Semi-supervised Network
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 43: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/43.jpg)
43
Transferable Semi-supervised Network
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 44: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/44.jpg)
44
Transferable Semi-supervised Network
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 45: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/45.jpg)
45
Transferable Semi-supervised NetworkPascal VOC
43.2%
51.2%
55.7%
58.8%
60.8%68.5%
64.6%
![Page 46: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/46.jpg)
46
Transferable Semi-supervised Semantic Segmentation. AAAI 2018
![Page 47: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/47.jpg)
47
CVPR 2017PR 2016 PAMI 2017
CVPR 2018 CVPR 2018 AAAI 2018
Proposal-based Localization Simple to Complex Adversarial Erasing
Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network
Summary
person
horsetable
images
annotations
…
…
Loc
Seg
Object Localization Maps
![Page 48: Towards Weakly- and Semi- Supervised Object Localization and …ice.dlut.edu.cn/valse2018/ppt/2018ValseYWei.pdf · 2019-04-03 · 1 Towards Weakly- and Semi- Supervised Object Localization](https://reader031.vdocument.in/reader031/viewer/2022040918/5e93f8e5b275df6a6202d3d0/html5/thumbnails/48.jpg)
48
Thanks