deep data-driven astronomyrvanderb/kes/sedaghat/dl_eso.pdfneural network... nima sedaghat, sep....
TRANSCRIPT
![Page 1: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/1.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Deep Data-driven Astronomy
Nima Sedaghat
![Page 2: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/2.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Outline
● Basic Ideas behind Machine Learning● Classical Machine Learning vs. Deep Learning● Rapid Evolution of Deep Learning
→ Encoder-Decoder Architectures
● TransiNet
● Letting Spectra Speak for Themselves
![Page 3: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/3.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Machine Learning
![Page 4: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/4.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
30 second intro to machine learning
![Page 5: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/5.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
30 second intro to machine learning
DOG? DOG?
DOG?
CAT?
CAT?CAT?
Guess
![Page 6: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/6.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
30 second intro to machine learning
DOG? DOG?
DOG?
CAT?
CAT?CAT?
Update
![Page 7: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/7.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
30 second intro to machine learning
DOG? DOG?
CAT?
CAT?
DOG?DOG?
EducatedGuess
![Page 8: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/8.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
30 second intro to machine learning
Update
DOG? DOG?
CAT?
CAT?
DOG?DOG?
![Page 9: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/9.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
30 second intro to machine learning
CAT? DOG?
CAT?
CAT?
DOG?CAT?
EducatedGuess
![Page 10: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/10.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Real-world Example
Human or not?
www.istockphoto.com
![Page 11: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/11.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
“Feature”
![Page 12: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/12.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
if (there is a circle somewhere close to the top)
if (there are two parallel vertical lines below it)
if ...Probably a human!
else
if ...Probably a human without a neck!
else
not a human
Featrues → Final Answers(inference)
![Page 13: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/13.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
From If-else to Learning by Examples
![Page 14: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/14.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
From If-else to Learning by Examples
“Model”
![Page 15: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/15.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Model
Human?Not Human?
![Page 16: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/16.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Different Methods – Same Idea
Support Vector Machine
DecisionTree
NeuralNetwork
...
![Page 17: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/17.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Classical Machine Learning vs.
Deep Learning
![Page 18: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/18.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
From Hand-Crafted Features to Representation Learning
Alex, D., 2017
![Page 19: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/19.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Why didn’t we do it before?
We needed to go deeper: more parameters, more sophisticated features
It would take forever to tell a cat from a dog!
![Page 20: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/20.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
What made it possible?
Convolutional Layers
![Page 21: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/21.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
GPU: Graphical Processing Unit
https://www.wikihow.com/Connect-an-External-TV-Tuner-Card-to-a-Desktop
![Page 22: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/22.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
GPU: Graphical Processing Unit
![Page 23: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/23.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Convolutional Layers
https://www.analyticsindiamag.com/convolutional-neural-network-image-classification-overview
![Page 24: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/24.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Why Convolutional Layers help?
“Shared Weights”
Seongwon Hwang, “Convolutional Neural Network (CNN) presentation from theory to code in Theano”
![Page 25: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/25.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Deep ConvNets
![Page 26: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/26.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Hierarchical Representation Learning
![Page 27: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/27.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
On the Importance of Data
![Page 28: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/28.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
On the Importance of Data
over-fittingSmall Dataset
It’s a cat
![Page 29: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/29.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
The Rapid Evolution of Deep Learning
![Page 30: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/30.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Classification
CAT? DOG?
CAT?
CAT?
DOG?CAT?
EducatedGuess
![Page 31: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/31.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Classification
https://github.com/EdwardJKim/dl4astro/
![Page 32: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/32.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Regression
Sedaghat, Brox, “Unsupervised Generation of a Viewpoint Annotated Car Dataset from Videos”
![Page 33: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/33.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
● Question: What examples can you think of in Astronomy?
Regression
![Page 34: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/34.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Encoder-Decoder Networks
![Page 35: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/35.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
E.g. Auto-Encoder
![Page 36: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/36.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Why an Auto-Encoder?
Code
![Page 37: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/37.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
E.g. De-noising
Question: How would you train this?
![Page 38: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/38.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
E.g. Segmentation
![Page 39: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/39.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
E.g. Optical Flow (Motion) Estimation
![Page 40: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/40.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Application Example: TransiNet
Reference Image Science Image Ideal output
Nima Sedaghat, Ashish Mahabalhttps://doi.org/10.1093/mnras/sty613
Watch presentation @ Astroinformatics '18
![Page 41: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/41.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Application Example
Letting Spectra Speak for themselves!
![Page 42: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/42.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
The Idea
![Page 43: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/43.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
First Results
![Page 44: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/44.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Retrieval
Query Spectrum
![Page 45: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/45.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Retrieval
Search Results:
![Page 46: Deep Data-driven Astronomyrvanderb/KES/sedaghat/DL_eso.pdfNeural Network... Nima Sedaghat, Sep. 2019, ESO, Garching Classical Machine Learning vs. Deep Learning Nima Sedaghat, Sep](https://reader034.vdocument.in/reader034/viewer/2022042402/5f14638b40e96239c16ad69b/html5/thumbnails/46.jpg)
Nima Sedaghat, Sep. 2019, ESO, Garching
Serendipitous Finding
● Does the network know something we don’t?