Upload File

convolutional deep belief networks for scalable...

  • Home
  • Documents
  • Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
91

Upload: others

Post on 16-Aug-2020

2 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 2: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical RepresentationsHonglak Lee, Roger Grosse, Rajesh Ranganath, Andrew Y. Ng

http://web.eecs.umich.edu/~honglak/icml09-ConvolutionalDeepBeliefNetworks.pdf
Page 3: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Playing Atari with Deep Reinforcement Learning. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, DaanWierstra, Martin Riedmiller

http://arxiv.org/pdf/1312.5602v1.pdf
Page 4: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Robot Learning ManipulationAction Plans by “Watching” Unconstrained Videos from the World Wide Web.Yezhou Yang, Cornelia Fermuller, Yiannis Aloimonos

http://www.umiacs.umd.edu/~yzyang/paper/YouCookMani_CameraReady.pdf
Page 5: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X or OCNN

A two-dimensional

array of pixels

Page 6: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

CNN X

CNN O

Page 7: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 8: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 9: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 10: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 11: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 12: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 13: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

CNN X

CNN O

Page 14: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

?

Page 15: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 1 -1 -1 -1

-1 -1 1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 1 -1 -1

-1 -1 -1 1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

?

Page 16: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 X -1 -1 -1 -1 X X -1

-1 X X -1 -1 X X -1 -1

-1 -1 X 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 X -1 -1

-1 -1 X X -1 -1 X X -1

-1 X X -1 -1 -1 -1 X -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 17: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 1 -1 -1 -1

-1 -1 1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 1 -1 -1

-1 -1 -1 1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

x

Page 18: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

=

=

=

Page 19: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

Page 20: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

Page 21: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

Page 22: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

Page 23: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

Page 24: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

Page 25: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 26: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 27: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 28: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

11 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 29: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 11 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 30: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 11 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 31: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 1

1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 32: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 1

1 1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 33: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 1

1 1 1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 34: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 1

1 1 1

1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 35: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 1

1 1 1

1 1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 36: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 1

1 1 1

1 1 1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 37: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1

1 1 1

1 1 1

1 1 1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 38: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

11 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 39: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 -11 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 40: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 1 -1

1 1 1

-1 1 1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 41: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

1 1 -1

1 1 1

-1 1 1

55

1 1 -1

1 1 1

-1 1 1

Page 42: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 43: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

=

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 44: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1 -1 -1

-1 1 -1

-1 -1 1

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

=

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.11 0.33 -0.77 1.00 -0.77 0.33 -0.11

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

=

=

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 45: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

1 -1 -1

-1 1 -1

-1 -1 1

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-1 -1 1

-1 1 -1

1 -1 -1

1 -1 1

-1 1 -1

1 -1 1

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.11 0.33 -0.77 1.00 -0.77 0.33 -0.11

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 46: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.11 0.33 -0.77 1.00 -0.77 0.33 -0.11

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

Page 47: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 48: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 49: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 50: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33 0.55

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 51: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33 0.55 0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 52: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33 0.55 0.33

0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 53: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33 0.55 0.33

0.33 1.00 0.33 0.55

0.55 0.33 1.00 0.11

0.33 0.55 0.11 0.77

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 54: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33 0.55 0.33

0.33 1.00 0.33 0.55

0.55 0.33 1.00 0.11

0.33 0.55 0.11 0.77

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.11 0.33 -0.77 1.00 -0.77 0.33 -0.11

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

0.33 0.55 1.00 0.77

0.55 0.55 1.00 0.33

1.00 1.00 0.11 0.55

0.77 0.33 0.55 0.33

0.55 0.33 0.55 0.33

0.33 1.00 0.55 0.11

0.55 0.55 0.55 0.11

0.33 0.11 0.11 0.33

Page 55: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.33 0.55 0.33

0.33 1.00 0.33 0.55

0.55 0.33 1.00 0.11

0.33 0.55 0.11 0.77

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.11 0.33 -0.77 1.00 -0.77 0.33 -0.11

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

0.33 0.55 1.00 0.77

0.55 0.55 1.00 0.33

1.00 1.00 0.11 0.55

0.77 0.33 0.55 0.33

0.55 0.33 0.55 0.33

0.33 1.00 0.55 0.11

0.55 0.55 0.55 0.11

0.33 0.11 0.11 0.33

Page 56: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 57: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

0.77

Page 58: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.77 00.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 59: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.77 0 0.11 0.33 0.55 0 0.330.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 60: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.77 0 0.11 0.33 0.55 0 0.33

0 1.00 0 0.33 0 0.11 0

0.11 0 1.00 0 0.11 0 0.55

0.33 0.33 0 0.55 0 0.33 0.33

0.55 0 0.11 0 1.00 0 0.11

0 0.11 0 0.33 0 1.00 0

0.33 0 0.55 0.33 0.11 0 0.77

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

Page 61: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

0.77 0 0.11 0.33 0.55 0 0.33

0 1.00 0 0.33 0 0.11 0

0.11 0 1.00 0 0.11 0 0.55

0.33 0.33 0 0.55 0 0.33 0.33

0.55 0 0.11 0 1.00 0 0.11

0 0.11 0 0.33 0 1.00 0

0.33 0 0.55 0.33 0.11 0 0.77

0.33 0 0.11 0 0.11 0 0.33

0 0.55 0 0.33 0 0.55 0

0.11 0 0.55 0 0.55 0 0.11

0 0.33 0 1.00 0 0.33 0

0.11 0 0.55 0 0.55 0 0.11

0 0.55 0 0.33 0 0.55 0

0.33 0 0.11 0 0.11 0 0.33

0.33 0 0.55 0.33 0.11 0 0.77

0 0.11 0 0.33 0 1.00 0

0.55 0 0.11 0 1.00 0 0.11

0.33 0.33 0 0.55 0 0.33 0.33

0.11 0 1.00 0 0.11 0 0.55

0 1.00 0 0.33 0 0.11 0

0.77 0 0.11 0.33 0.55 0 0.33

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

0.77 -0.11 0.11 0.33 0.55 -0.11 0.33

-0.11 1.00 -0.11 0.33 -0.11 0.11 -0.11

0.11 -0.11 1.00 -0.33 0.11 -0.11 0.55

0.33 0.33 -0.33 0.55 -0.33 0.33 0.33

0.55 -0.11 0.11 -0.33 1.00 -0.11 0.11

-0.11 0.11 -0.11 0.33 -0.11 1.00 -0.11

0.33 -0.11 0.55 0.33 0.11 -0.11 0.77

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.11 0.33 -0.77 1.00 -0.77 0.33 -0.11

0.11 -0.55 0.55 -0.77 0.55 -0.55 0.11

-0.55 0.55 -0.55 0.33 -0.55 0.55 -0.55

0.33 -0.55 0.11 -0.11 0.11 -0.55 0.33

Page 62: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 63: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

1.00 0.33 0.55 0.33

0.33 1.00 0.33 0.55

0.55 0.33 1.00 0.11

0.33 0.55 0.11 0.77

0.33 0.55 1.00 0.77

0.55 0.55 1.00 0.33

1.00 1.00 0.11 0.55

0.77 0.33 0.55 0.33

0.55 0.33 0.55 0.33

0.33 1.00 0.55 0.11

0.55 0.55 0.55 0.11

0.33 0.11 0.11 0.33

Page 64: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

1.00 0.55

0.55 1.00

0.55 1.00

1.00 0.55

1.00 0.55

0.55 0.55

Page 65: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

1.00 0.55

0.55 1.00

0.55 1.00

1.00 0.55

1.00 0.55

0.55 0.55

1.00

0.55

0.55

1.00

1.00

0.55

0.55

0.55

0.55

1.00

1.00

0.55

Page 66: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

1.00

0.55

0.55

1.00

1.00

0.55

0.55

0.55

0.55

1.00

1.00

0.55

Page 67: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.55

1.00

1.00

0.55

0.55

0.55

0.55

0.55

1.00

0.55

0.55

1.00

Page 68: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 69: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 70: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 71: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 72: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 73: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 74: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 75: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

X

O

0.9

0.65

0.45

0.87

0.96

0.73

0.23

0.63

0.44

0.89

0.94

0.53

Page 76: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Page 77: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 78: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Page 79: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Right answer Actual answer Error

X 1

O

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Page 80: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Right answer Actual answer Error

X 1 0.92

O

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Page 81: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Right answer Actual answer Error

X 1 0.92 0.08

O

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Page 82: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Right answer Actual answer Error

X 1 0.92 0.08

O 0 0.51 0.49

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Page 83: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

-1 -1 -1 -1 -1 -1 -1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 -1 -1 1 -1 -1 -1 -1

-1 -1 -1 1 -1 1 -1 -1 -1

-1 -1 1 -1 -1 -1 1 -1 -1

-1 1 -1 -1 -1 -1 -1 1 -1

-1 -1 -1 -1 -1 -1 -1 -1 -1

X

O

Right answer Actual answer Error

X 1 0.92 0.08

O 0 0.51 0.49

Total 0.57

Page 84: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 85: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 86: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 87: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 88: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 89: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 90: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical
Page 91: Convolutional Deep Belief Networks for Scalable ...cv.znu.ac.ir/afsharchim/lectures/ML/CNNExample.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical

Caffe

CNTK

Deeplearning4j

TensorFlow

Theano

Torch

Many others

http://caffe.berkeleyvision.org/
https://github.com/Microsoft/CNTK
https://en.wikipedia.org/wiki/Deeplearning4j
http://www.tensorflow.org/
https://en.wikipedia.org/wiki/Theano_(software)
https://en.wikipedia.org/wiki/Torch_(machine_learning)
http://deeplearning.net/software_links/

CDC: Convolutional-De-Convolutional Networks for Precise ...zs2262/files/research/cvpr17_CDC... · CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND …blei/papers/ChenPolatkanSapiroBleiDunsonCarin2013.pdfworks [1], convolutional networks [2], deep belief networks (DBNs) [3], hierarchies

Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Unsupervised feature learning for audio classification using convolutional deep belief networks

Convolutional Neural Network Application in Biomedical Signalsjcsitnet.com/journals/jcsit/Vol_6_No_2_December_2018/5.pdf · 2019. 1. 15. · learning such as Auto-encoders, Deep Belief

Bidirectional Recurrent Convolutional Networks for …papers.nips.cc/paper/5778-bidirectional-recurrent-convolutional... · Bidirectional Recurrent Convolutional Networks for Multi-Frame

Convolutional Networks: Motivationsrihari/CSE676/9.2 CNN-Motivation.pdf · Deep Learning Srihari Overview of Convolutional Networks • Convolutional networks, also known as Convolutional

Natalia Neverova, Christian Wolf, Graham Taylor and ... · time deep belief networks [38] produce high-level repre-sentations of video sequences using convolutional RBMs. Vanilla

SC-DCNN: Highly-Scalable Deep Convolutional Neural Network ... · SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing Ao Ren yJi Li Zhe Li Caiwen

Accelerating Convolutional Neural Network Systemshgrg1/publications/honours.pdf · 2015-07-29 · Accelerating Convolutional Neural Network Systems ... Convolutional Neural Networks

Prof. - Jorge Espinosa - PCJIC UNAL Prof. Sergio A. Velastin Prof. …€¦ · [8] H. Lee, R. Grosse, R. Ranganath, y A. Y. Ng, ^Convolutional deep belief networks for scalable unsupervised

Preserving differential privacy in convolutional deep belief networks · 2017-09-06 · Mach Learn (2017) 106:1681–1704 1683 privacy (Dwork et al. 2006). A differential privacy

RESTRICTED BOLTZMANN MACHINESafb/classes/CS7616-Spring... · Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. Honglak Lee, Roger

Scalable Convolutional Neural Network for Image Compressed ...openaccess.thecvf.com/content_CVPR_2019/papers/Shi_Scalable... · coding [28, 15], medical imaging [31], and wireless

Because religious belief,. Because religious belief, or non-belief,

SC-DCNN: Highly-Scalable Deep Convolutional Neural Network ...alchem.usc.edu/portal/static/download/sc_dcnn.pdf · Stochastic Computing 3.1 DCNN Architecture Overview Deep convolutional

CONVOLUTIONAL DEEP BELIEF NETWORKS - Home | Computer Science …cseweb.ucsd.edu/~dasgupta/254-deep/emanuele.pdf ·  · 2012-02-01Computer Science Department, Stanford University,

SECOMO Documentation · Convolutional Deep Belief Networks for scalable unsupervised learning of hierarchical representations. Proceedings of the 26 th International Confefence on

A probabilistic model for recursive factorized image features.sergeykarayev.com/files/cvpr2011_slides.pdf · Convolutional Deep Belief Nets Stacked layers, each consisting of feature

CSL+: Scalable Collective Subjective Logic under Multidimensional Uncertaintyfxc190007/pdml/Papers... · 2019-11-04 · uncertainty, including probability models, belief models, and

S-Net: A Scalable Convolutional Neural Network for JPEG ... · 1 S-Net: A Scalable Convolutional Neural Network for JPEG Compression Artifact Reduction Bolun Zheng,a Rui Sun,b Xiang

Wrong Belief- Right Belief

Convolutional Neural Networks · 2017-10-10 · Convolutional? –Pruning Convolutional Neural Networks for Resource Efficient Inference –FILTER SHAPING FOR CONVOLUTIONAL NEURAL

Perception-link Behavior Model€¦ · [1] H. Lee et al, “Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations,” in Proceedings

Knowledgeable Independent Focused · Source: Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations, Honglak Lee, Roger Grosse, Rajesh

Very Deep Convolutional Neural Networks for Noise …...convolutional layers with carefully tuned architecture. •ASR: Very Deep Convolutional Neural Networks uses up to 10 convolutional

Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

NVIDIA GPU 深度学习平台 - HPC Advisory Council · 2020. 1. 14. · Image source: “Unsupervised Learning of Hierarchical Representations with Convolutional Deep Belief Networks”

CONVOLUTIONAL DEEP BELIEF NETWORKSdasgupta/254-deep/emanuele.pdf · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations probabilistic

Bildverarbeitung beim Laserstrahlschweißen · [2] Lee et al. - Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations [3] Springenberg

Belief that vs. belief in

Scalable and Modularized RTL Compilation of Convolutional ... · Scalable and Modularized RTL Compilation of Convolutional Neural Networks onto FPGA ... Design Entry RTL C-language

L15 how CNNs BrandonRohrer - GitHub Pages · Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations Honglak Lee, Roger Grosse, Rajesh

Convolutional*Deep*Belief*Networks*for*Scalable ...swadhin/reading_group/... · Convolutional*Deep*Belief*Networks*for*Scalable*Unsupervised*Learning*of*Hierarchical*Representations

Robust Graph Convolutional Networks Against Adversarial ...pengcui.thumedialab.com/papers/RGCN.pdf · convolutional networks and graph adversarial attacks. 2.1 Graph Convolutional