![Page 1: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/1.jpg)
Neural Networks
Dr. ThompsonMarch 19, 2013
![Page 2: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/2.jpg)
Artificial Intelligence
• Robotics• Computer Vision & Speech Recognition• Expert Systems• Pattern Recognition• Machine Learning• Natural Language Processing• Prognostics & Diagnostics
![Page 3: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/3.jpg)
Neural Network Applications
• Character Recognition• Loan Officer • Cancer Diagnosis• Wine Classifier• Stock Market Prediction• Network Security
![Page 4: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/4.jpg)
HRL
• Artificial Neural Networks - Pattern Recognition– Airbag Problem – Accelerometer False Positive– OCR Check Character Recognition
• Bayesian Networks – Expert System– GM Electromotive Division– Amazon.com Buyer Preferences
![Page 5: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/5.jpg)
Biological Neuron
![Page 6: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/6.jpg)
Artificial Neural Network Topology
![Page 7: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/7.jpg)
Artificial Neuron Activation
![Page 8: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/8.jpg)
Threshhold Functions(include graphs)
• Linear• Logistic• Hyperbolic Tangent – Sigmoid (*)• Step
Logistic Curve
![Page 9: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/9.jpg)
Network Output
• Y = f(WX)• Z = f(W’Y) = f(W’f(WX))
![Page 10: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/10.jpg)
Error Correction
• (Method of Least Squares)• Minimize Total Error = E = Σ (Z-O)2
![Page 11: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/11.jpg)
Solution Space
![Page 12: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/12.jpg)
Error Function:Local & Global Minima
![Page 13: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/13.jpg)
Back PropagationDelta Rule – Gradient Descent
• http://en.wikipedia.org/wiki/Delta_Rule
![Page 14: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/14.jpg)
Learning & Testing
• Heuristics– 10%– 90%
• Overtraining/Overfitting– Polynomial Curve Fitting Analogy
![Page 15: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/15.jpg)
Next Week Matlab Neural Network
Toolbox Tutorial
![Page 16: Neural Networks Dr. Thompson March 19, 2013. Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition](https://reader030.vdocument.in/reader030/viewer/2022032612/56649efa5503460f94c0c74a/html5/thumbnails/16.jpg)
Assignment
• Read the Wikipedia Artificial Neural Network & Backpropagation Chapters
• Devise a Neural Network Characterization of• 4x4 Scoreboard Digit Problem
• Input Layer• Hidden Layer• Output Layer
• Training Set Examples