deep learning - bigskyearth › wp-content › uploads › 2018 › 12 › dl_intro.pdf · nov...
TRANSCRIPT
![Page 1: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/1.jpg)
Nov 2018, Tuorla
Deep Learning
Nima SedaghatUniversity of Freiburg
![Page 2: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/2.jpg)
Nov 2018, Tuorla
Outline
● Classical Machine Learning vs. Deep Learning
● The Rapid Evolution of Deep Learning
● Deep Learning and Types of Supervision
![Page 3: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/3.jpg)
Nov 2018, Tuorla
Classical Machine Learning vs. Deep Learning
![Page 4: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/4.jpg)
Nov 2018, Tuorla
From Hand-Crafted Features to Representation Learning
![Page 5: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/5.jpg)
Nov 2018, Tuorla
Why didn’t we do it before?
We needed to go deeper: more parameters, more sophisticated features
It would take forever to tell a cat from a dog!
![Page 6: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/6.jpg)
Nov 2018, Tuorla
What made it possible?
Convolutional Layers
![Page 7: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/7.jpg)
Nov 2018, Tuorla
GPU: Graphical Processing Unit
https://www.wikihow.com/Connect-an-External-TV-Tuner-Card-to-a-Desktop
![Page 8: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/8.jpg)
Nov 2018, Tuorla
GPU: Graphical Processing Unit
![Page 9: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/9.jpg)
Nov 2018, Tuorla
Convolutional Layers
https://www.analyticsindiamag.com/convolutional-neural-network-image-classification-overview
![Page 10: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/10.jpg)
Nov 2018, Tuorla
Why Convolutional Layers help?
“Shared Weights”
Seongwon Hwang, “Convolutional Neural Network (CNN) presentation from theory to code in Theano”
![Page 11: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/11.jpg)
Nov 2018, Tuorla
Deep ConvNets
![Page 12: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/12.jpg)
Nov 2018, Tuorla
Hierarchical Representation Learning
![Page 13: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/13.jpg)
Nov 2018, Tuorla
On the Importance of Data
![Page 14: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/14.jpg)
Nov 2018, Tuorla
On the Importance of Dataover-fittingSmall Dataset
It’s a cat
![Page 15: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/15.jpg)
Nov 2018, Tuorla
The Rapid Evolution of Deep Learning
![Page 16: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/16.jpg)
Nov 2018, Tuorla
Classification
https://becominghuman.ai/building-an-image-classifier-using-deep-learning-in-python-totally-from-a-beginners-perspective-be8dbaf22dd8
![Page 17: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/17.jpg)
Nov 2018, Tuorla
● Question: examples from other domains?
(E.g. Astronomy)
Classification
https://github.com/EdwardJKim/dl4astro/
![Page 18: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/18.jpg)
Nov 2018, Tuorla
Regression
Sedaghat, Brox, “Unsupervised Generation of a Viewpoint Annotated Car Dataset from Videos”
![Page 19: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/19.jpg)
Nov 2018, Tuorla
● Question: What examples can you think of in Sky/Earth?
Regression
![Page 20: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/20.jpg)
Nov 2018, Tuorla
Encoder-Decoder Networks
![Page 21: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/21.jpg)
Nov 2018, Tuorla
E.g. Auto-Encoder
![Page 22: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/22.jpg)
Nov 2018, Tuorla
Why an Auto-Encoder?
![Page 23: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/23.jpg)
Nov 2018, Tuorla
E.g. De-noising
Question: How would you train this?
![Page 24: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/24.jpg)
Nov 2018, Tuorla
E.g. Segmentation
![Page 25: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/25.jpg)
Nov 2018, Tuorla
E.g. Optical Flow (Motion) Estimation
![Page 26: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/26.jpg)
Nov 2018, Tuorla
Generative Adversarial Network (GAN)
https://towardsdatascience.com/understanding-generative-adversarial-networks-4dafc963f2ef
![Page 27: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/27.jpg)
Nov 2018, Tuorla
GAN Use-case example
Antreas Antoniou et al., “Data Augmentation Generative Adversarial Networks”
![Page 28: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/28.jpg)
Nov 2018, Tuorla
Deep Learning and Types of Supervision
![Page 29: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/29.jpg)
Nov 2018, Tuorla
Deep Learning and Types of Supervision
● Fully Supervised Learning
● Unsupervised/Self-Supervised Learning
● Reinforcement Learning
● (Imitation Learning)
![Page 30: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/30.jpg)
Nov 2018, Tuorla
Fully Supervised Learning
● During Training: Input AND Output
Labels
Annotations
![Page 31: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/31.jpg)
Nov 2018, Tuorla
Unsupervised/Self-supervised Learning
● No Labels● No “unsupervised task” such as clustering● Use self-supervision instead
– Auto-encoder
– Denoising
– Jigsaw-puzzle
– ...
![Page 32: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/32.jpg)
Nov 2018, Tuorla
Reinforcement Learning
![Page 33: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/33.jpg)
Nov 2018, Tuorla
Reinforcement Learning
Google DeepMind’s RL
![Page 34: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/34.jpg)
Nov 2018, Tuorla
Covariate Shift and Domain Adaptation
![Page 35: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/35.jpg)
Nov 2018, Tuorla
Covariate Shift and Domain Adaptation
Hybrid Learning of Optical Flow and Next Frame Prediction to Boost Optical Flow in the Wild. Nima Sedaghat, Zolfaghari M., Brox T.
![Page 36: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/36.jpg)
Nov 2018, Tuorla
Probabilistic Networks
https://medium.com/@joeDiHare/deep-bayesian-neural-networks-952763a9537
![Page 37: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution](https://reader034.vdocument.in/reader034/viewer/2022050719/5f1461f610185d7b5450b417/html5/thumbnails/37.jpg)
Nov 2018, Tuorla
Application Example: TransiNet
Reference Image Science Image Ideal output