deep learning: theory and practice - leap laboratory...deep learning: theory and practice 14-02-2019...
TRANSCRIPT
![Page 1: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/1.jpg)
Deep Learning: Theory and Practice
14-02-2019Linear and Logistic Models for
Classification
![Page 2: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/2.jpg)
Logistic Regression
Bishop - PRML book (Chap 3)
❖ 2- class logistic regression
❖ K-class logistic regression
❖ Maximum likelihood solution
❖ Maximum likelihood solution
![Page 3: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/3.jpg)
Least Squares versus Logistic Regression
Bishop - PRML book (Chap 4)
![Page 4: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/4.jpg)
Least Squares versus Logistic Regression
Bishop - PRML book (Chap 4)
![Page 5: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/5.jpg)
Underfit
(Courtesy - Dr D. Vijayasenan, NITK)
![Page 6: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/6.jpg)
Overfit
(Courtesy - Dr D. Vijayasenan, NITK)
![Page 7: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/7.jpg)
Compromise
(Courtesy - Dr D. Vijayasenan, NITK)
![Page 8: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/8.jpg)
Summary so far …
Bishop - PRML book (Chap 3)
❖ Maximum Likelihood
❖ Linear Least Squares Classifiers
❖ Logistic Regression
❖ Application of ML to Logistic Regression
❖ Gradient Descent
❖ Coding Logistic regression
![Page 9: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/9.jpg)
Training, Validation and Test Set
![Page 10: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/10.jpg)
Perceptron Algorithm
What if the data is not linearly separable
Perceptron Model [McCulloch, 1943, Rosenblatt, 1957]
Targets are binary classes [-1,1]
![Page 11: Deep Learning: Theory and Practice - LEAP Laboratory...Deep Learning: Theory and Practice 14-02-2019 Linear and Logistic Models for Classification deeplearning.cce2019@gmail.com Logistic](https://reader034.vdocument.in/reader034/viewer/2022052611/5f08f4ea7e708231d4248aa3/html5/thumbnails/11.jpg)
Multi-layer PerceptronMulti-layer Perceptron [Hopfield, 1982]
thresholding function
non-linear function (tanh,sigmoid)