Download - Nanjing University of Science & Technology
![Page 1: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/1.jpg)
1
Nanjing University of Science & Technology
Like to Thank
Lu Jian FengYang Jing-yu Wang Han
For inviting me to present this course on
Pattern Recognition: Statistical and Neural
![Page 2: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/2.jpg)
2
Nanjing University of Science & Technology
Lecture 1: Introduction
September 14, 2005
![Page 3: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/3.jpg)
3
Today’s Presentation ______________________
Introduce Myself
Proposed Course
Current Research
![Page 4: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/4.jpg)
4
Dr. Lonnie C. Ludeman
Professor Emeritus, College Professor
Klipsch School of Electrical and computer EngineeringNew Mexico State UniversityLas Cruces, New Mexico 88003USA
![Page 5: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/5.jpg)
5
Textbooks:
Fundamentals of Digital Signal Processing,John Wiley, 1968
Random Processes: Filtering, Estimationand Detection, John Wiley, 2003
PHEI 2005 Chinese VersionPattern Recognition: Statistical and Neural,Currently Preparing Manuscript
![Page 6: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/6.jpg)
6
Proposed Course
PATTERN RECOGNITION: Statistical and Neural_________________________________________________
Text: "Pattern Recognition: Statistical and Neural", Lonnie C. Ludeman (Manuscript in progress) Instructor: Dr. Lonnie C. Ludeman, Professor General Description: Statistical pattern classification, supervised and unsupervised
learning, neural networks for pattern recognition, featureselection and extraction, clustering techniques, and syntacticalpattern recognition.
Prerequisites: Probability and random variables
![Page 7: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/7.jpg)
7
Course Topical Outline: 1. Pattern Recognition Overview 2. Statistical Pattern Recognition
Maximum A'posteriori decision rule, Minimum Probability oferror decision rule Bayes decision rule, Neyman PearsonDecision Rule Classifier performance-Risk, Probability oferror, and Receiver Operating Characteristics GeneralGaussian Case, Discriminant Functions, ClassifierPerformance Decision regions and Discriminant functions-linear, nonlinear and generalized linear
3. Training pattern recognizers The perceptron algorithm The potential function algorithm
![Page 8: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/8.jpg)
8
4. Pattern Recognition using Neural NetworksIntroduction to Neural Networks- Basics, Physical Neural NetworksArtificial Neural Networks-McColloch Pitts Model, ActivationFunctions, Continuous Perceptron Training algorithms- Delta rule forsingle layers, Back propagation for multilayer networks, Improvementsto the backpropagaton algorithm, parameter selection and guidelines,and performance evaluation
5. Other classifiers
Functional link nets, Hopfield neural nets, Hammming net classifier,MAXNET classifier, nearest neighbor rules using distance andsimilarities measures,
4. Pattern Recognition using Neural NetworksIntroduction to Neural Networks- Basics, PhysicalNeural Networks Artificial Neural Networks-McColloch Pitts Model, Activation Functions,Continuous Perceptron Training algorithms- Deltarule for single layers, Back propagation for multilayernetworks, Improvements to the backpropagaton algorithm, parameter selection and guidelines, andperformance evaluation
5. Other classifiers
Functional link nets, Hopfield neural nets,Hammming net classifier, MAXNET classifier,nearest neighbor rules using distance and similarities measures,
![Page 9: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/9.jpg)
9
6. Clustering algorithms K-means, ISODATA, Maximin, Hierarchical,Adaptive Resonance Theory, Fuzzy Clustering
7. Syntactic Pattern Recognition 8. Feature selection 9. Data Fusion
![Page 10: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/10.jpg)
10
Current Research Interests:
Clustering of non QuantitativeArchaeological Data
Neural Networks and ClusteringEducational Software
Blind Nonlinear System Identification ofSpeech Signals
![Page 11: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/11.jpg)
11
Clustering of non quantitative data
(A) Nominal or ordinal
(B) Syntactical
(C) Fuzzy
![Page 12: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/12.jpg)
12
Pattern Recognition Educational Software
(A) LCLNET - A neural Network Simulator
(B) LCLCLUSTER - A clustering GUI
![Page 13: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/13.jpg)
13
(A) LCLNET - A neural Network Simulator
1. Train a feedforward neural network2. Test trained network using training and other non-training files3. Change parameters quickly and interactively: Layers , nodes/layer, learning and momentum parameter, nonlinearities, target values, initial conditions4. Create, store, print, and view - Data files, weight files and results5. Provide visual tracking of weight changes For trining by sample and epoch
![Page 14: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/14.jpg)
14
(A) LCLCLUSTER - A Clustering GUI
1. Data selection Interface - directory information
2. Easy Selection of Types of clustering - K-means, Hierarchical, Fuzzy, ART
3. Storage and viewing - of iterative steps and final results
4. Easy changing of parameters- Number of clusters, fuzzy index, and initial conditions
![Page 15: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/15.jpg)
15
GUI for LCLCLUSTER
![Page 16: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/16.jpg)
16
Fuzzy Clustering Results
![Page 17: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/17.jpg)
17
ln()
s(t)
x(t)
1
c sin( ct+ )
d
xln()
s(t)
x(t)
1
c sin( ct+ )
d
x
ln()
s(t)
x(t)
1
c sin( ct+ )
d
x
Non Linear Speech Model
![Page 18: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/18.jpg)
18
Estimate c
x(t)
-1
Bandpass Filter 2 c ± c/2
Estimate dc2
Bandpass Filter 3 c ± c/2
Estimate 1 + s(t)
s(t) ^
^
^ ^
^
^
Estimate c
x(t)
-1
Bandpass Filter 2 c ± c/2
Estimate dc2
Bandpass Filter 3 c ± c/2
Estimate 1 + s(t)
s(t) ^
^
^ ^
^
^
Synthesis of speech signal
![Page 19: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/19.jpg)
19
![Page 20: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/20.jpg)
20
![Page 21: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/21.jpg)
21
![Page 22: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/22.jpg)
22
Summary ______________________
Introduced Myself
Presented Proposed Course
Discussed my Current Research Directions
![Page 23: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/23.jpg)
23
Thank you for your attention ______________________
I am happy to answer any questions.
![Page 24: Nanjing University of Science & Technology](https://reader035.vdocument.in/reader035/viewer/2022070411/568146c4550346895db3fde8/html5/thumbnails/24.jpg)
24
New Mexico
Land of Enchantment