deep networks - department of computer scienceayuille/courses/stat271-fall15/deep networks...
TRANSCRIPT
![Page 1: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/1.jpg)
Deep NetworksVittal Premachandran
![Page 2: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/2.jpg)
Supervised Learning y=f(x)● Binary Classification:
○ Given x find y ∊ {-1, 1}● Multiclass Classification
○ Given x find y ∊ {1,...,k}● Regression
○ Given x find y ∊ R (or, Rd)
![Page 3: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/3.jpg)
![Page 4: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/4.jpg)
![Page 5: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/5.jpg)
SIFT
![Page 6: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/6.jpg)
SIFT
HOG
![Page 7: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/7.jpg)
SIFT
HOG
LBP
![Page 8: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/8.jpg)
SIFT
HOG
LBP
SURF
![Page 9: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/9.jpg)
SIFT
HOG
LBP
SURF MSER
![Page 10: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/10.jpg)
SIFT
HOG
LBP
SURF MSERTextons
![Page 11: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/11.jpg)
SIFT
HOG
LBP
SURF MSERTextons
GLOH
![Page 12: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/12.jpg)
SIFT
HOG
LBP
SURF MSERTextons
GLOH
Color-SIFT
![Page 13: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/13.jpg)
SIFT
HOG
LBP
SURF MSERTextons
GLOH
Color-SIFT
SPIN
![Page 14: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/14.jpg)
SIFT
HOG
LBP
SURF MSERTextons
GLOH
Color-SIFT
SPIN
PHOG
![Page 15: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/15.jpg)
SIFT
HOG
LBP
SURF MSERTextons
GLOH
Color-SIFT
SPIN
PHOG
...
![Page 16: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/16.jpg)
W T F
![Page 17: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/17.jpg)
Which
Training
Features to use?
![Page 18: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/18.jpg)
Can we learn the features (internal representations)?
![Page 19: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/19.jpg)
![Page 20: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/20.jpg)
![Page 21: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/21.jpg)
![Page 22: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/22.jpg)
![Page 23: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/23.jpg)
![Page 24: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/24.jpg)
![Page 25: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/25.jpg)
![Page 26: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/26.jpg)
![Page 27: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/27.jpg)
![Page 28: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/28.jpg)
![Page 29: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/29.jpg)
![Page 30: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/30.jpg)
![Page 31: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/31.jpg)
![Page 32: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/32.jpg)
![Page 33: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/33.jpg)
![Page 34: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/34.jpg)
![Page 35: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/35.jpg)
Convolutional Neural Networks
![Page 36: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/36.jpg)
![Page 37: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/37.jpg)
![Page 38: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/38.jpg)
![Page 39: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/39.jpg)
![Page 40: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/40.jpg)
![Page 41: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/41.jpg)
![Page 42: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/42.jpg)
![Page 43: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/43.jpg)
![Page 44: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/44.jpg)
![Page 45: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/45.jpg)
![Page 46: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/46.jpg)
![Page 47: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/47.jpg)
![Page 48: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/48.jpg)
![Page 49: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/49.jpg)
![Page 50: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/50.jpg)
Alex Net
Krizhevsky et al. NIPS 2012
![Page 51: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/51.jpg)
![Page 52: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/52.jpg)
![Page 53: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/53.jpg)
![Page 54: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face](https://reader033.vdocument.in/reader033/viewer/2022050208/5f5aaf6a7fc93e59b62316d7/html5/thumbnails/54.jpg)