![Page 1: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/1.jpg)
Introduction to Artificial IntelligenceCOSC 4550 / COSC 5550
Professor Cheney11/6/17
![Page 2: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/2.jpg)
sample exam posted
2 weeks until project half-way check-in
paper readings
withdraw deadline this week!
![Page 3: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/3.jpg)
many slides today borrowed from Xavier Giro-i-Nieto
(sorry for lack of pixels… )
![Page 4: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/4.jpg)
end-to-end differentiable!
![Page 5: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/5.jpg)
![Page 6: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/6.jpg)
neural networks have been around for decades – why now?
recent advances in deep learning are due to:
huge labeled datasets
deeper and deeper architectures
some simple, but clever, tricks to better train these networks
![Page 7: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/7.jpg)
demo! …?
![Page 8: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/8.jpg)
yosinski.com/deepvis
![Page 9: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/9.jpg)
huge labeled datasets
![Page 10: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/10.jpg)
![Page 11: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/11.jpg)
![Page 12: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/12.jpg)
![Page 13: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/13.jpg)
MNIST(Modified National Institute of Standards and Technology)
60,000 training, 10,000 testing
![Page 14: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/14.jpg)
20 classes. The train/val data has 11,530 images containing 27,450 ROI annotated objects and6,929 segmentations.
![Page 15: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/15.jpg)
Caltech 256
(256 object categories, 30607 images)
![Page 16: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/16.jpg)
and many more…
including industrial datasets
(e.g. Netflix Prize – $1,000,000 prize to create rating prediction algorithm better than Netflix's current best)
Kaggle.com
Data.gov
...
![Page 17: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/17.jpg)
deeper and deeper architectures
![Page 18: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/18.jpg)
![Page 19: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/19.jpg)
![Page 20: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/20.jpg)
![Page 21: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/21.jpg)
![Page 22: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/22.jpg)
![Page 23: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/23.jpg)
![Page 24: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/24.jpg)
![Page 25: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/25.jpg)
![Page 26: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/26.jpg)
![Page 27: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/27.jpg)
![Page 28: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/28.jpg)
![Page 29: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/29.jpg)
![Page 30: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/30.jpg)
![Page 31: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl](https://reader035.vdocument.in/reader035/viewer/2022062605/5fd0eb7b69641f253d62afd9/html5/thumbnails/31.jpg)