neural networks professor michael c. mozer csci 3202 · neural networks professor michael c. mozer...
TRANSCRIPT
![Page 1: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/1.jpg)
Neural Networks
Professor Michael C. MozerCSCI 3202
![Page 2: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/2.jpg)
![Page 3: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/3.jpg)
![Page 4: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/4.jpg)
![Page 5: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/5.jpg)
![Page 6: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/6.jpg)
![Page 7: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/7.jpg)
![Page 8: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/8.jpg)
![Page 9: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/9.jpg)
![Page 10: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/10.jpg)
![Page 11: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/11.jpg)
![Page 12: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/12.jpg)
![Page 13: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/13.jpg)
![Page 14: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/14.jpg)
![Page 15: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/15.jpg)
![Page 16: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/16.jpg)
![Page 17: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/17.jpg)
![Page 18: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/18.jpg)
![Page 19: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/19.jpg)
![Page 20: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/20.jpg)
![Page 21: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/21.jpg)
![Page 22: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/22.jpg)
![Page 23: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/23.jpg)
![Page 24: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/24.jpg)
![Page 25: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/25.jpg)
![Page 26: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/26.jpg)
![Page 27: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/27.jpg)
![Page 28: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/28.jpg)
![Page 29: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/29.jpg)
![Page 30: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/30.jpg)
Exponential number of hidden units is bad— large network— poor generalization
With domain knowledge we could pick an appropriate hidden representation.
e.g., perceptron scheme
AlternativeLearn hidden representation
ProblemWhere does training signal come from?Teacher specifies target outputs, not target hiddens.
![Page 31: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/31.jpg)
![Page 32: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/32.jpg)
![Page 33: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/33.jpg)
![Page 34: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/34.jpg)
![Page 35: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/35.jpg)
![Page 36: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/36.jpg)
![Page 37: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/37.jpg)
![Page 38: Neural Networks Professor Michael C. Mozer CSCI 3202 · Neural Networks Professor Michael C. Mozer CSCI 3202. Exponential number of hidden units is bad ... DICK TRACY NEURAL- B catvus](https://reader030.vdocument.in/reader030/viewer/2022020303/5b913c4909d3f2b86e8dbf2b/html5/thumbnails/38.jpg)