image analysis lecture 9.3 -introduction to machine learning · lecture 9.3 -introduction to...
TRANSCRIPT
![Page 1: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/1.jpg)
Image AnalysisLecture 9.3 - Introduction to Machine Learning
Idar Dyrdal
![Page 2: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/2.jpg)
Machine learning (Pattern recognition)
• Recognition of individuals (instance recognition)• Discrimination between classes (pattern recognition, classification)
2
Supervised learning
![Page 3: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/3.jpg)
Pattern recognition in practice
Working applications of Image Pattern recognition:• Reading license plates, postal codes, bar codes• Character recognition• Automatic diagnosis of medical samples• Fingerprint recognition• Face detection and recognition• …
3
Credit: L. Lazebnik
![Page 4: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/4.jpg)
Classification system
4
Feature extractor Classifier
Pine
Birch
Camera
![Page 5: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/5.jpg)
Image features for object recognition
5
![Page 6: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/6.jpg)
Feature vector and feature space
6
![Page 7: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/7.jpg)
Training of classifiers
7
Learn a function to predict the class fromthe given features
Region 1
Region 2
Decisionboundary
![Page 8: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/8.jpg)
Classifiers and training methods
• Bayes classifier• Nearest-neighbors and K-nearest-neighbors• Parzen windows• Linear and higher order discriminant functions• Neural nets• Support Vector Machines (SVM)• Decision trees• Random forest• …
8
![Page 9: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/9.jpg)
Class conditional probability density functions
9
![Page 10: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/10.jpg)
Bayesian decision theory
Overview
10
x
Class conditional densities:
Prior probabilities:
Posterior probabilities given by Bayes rule:
Minimum error rate classification:
Assign the unknown object to the class with maximum posterior probability!
![Page 11: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/11.jpg)
Density estimation
Parametric methods:• Assume a given shape of the density
function• Use the training set to estimate the
unknown parameters.
Non-parametric (distribution free) methods:• Point estimation of the density using
the training set directly• Parzen windows• Nearest neighbor estimation (leads
directly to the nearest-neighbor and k-nearest-neighbor classifiers).
11
Example – Gaussian distribution:
Parameters:
![Page 12: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/12.jpg)
Parameter estimation
12
Parameter estimates:
![Page 13: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/13.jpg)
Discriminant functions
13
Estimate of the density in a given point:
From Bayes rule:
Examples of discriminant functions:
Decision rule:
Choose the class with maximum discriminant function value.
![Page 14: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/14.jpg)
Quadratic classifier - example
14
![Page 15: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/15.jpg)
Linear classifier
15
Uncorrelated features andcommon covariance matrices
Linear decision boundaries
Example:
![Page 16: Image Analysis Lecture 9.3 -Introduction to Machine Learning · Lecture 9.3 -Introduction to Machine Learning Idar Dyrdal. Machine learning (Pattern recognition) ... Feature vector](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4dd10e891f3349e4e6b2c/html5/thumbnails/16.jpg)
Summary
Machine learning:• Pattern classification• Training of classifiers (supervised learning)• Parametric and non-parametric methods• Discriminant functions• Quadratic and linear classifiers.
More information:• Szeliski 14.1• R. O. Duda, P. E. Hart, D. G. Stork (2001).
Pattern classification (2nd ed.). Wiley, New York. ISBN 0-471-05669-3.
16