cs404 pattern recognition - locality preserving projections
TRANSCRIPT
![Page 1: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/1.jpg)
CS404 : Pattern Recognition
Locality Preserving Projections
07-November-2016
![Page 2: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/2.jpg)
Presenters
P Jishnu Jaykumar
Paste your photo here
Vivek Kumar Singh
![Page 3: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/3.jpg)
Paper Overview
Authors● Xiaofei He and ● Partha Niyogi
From● Computer Science Department● The University of Chicago● Chicago, IL 60615
Resource Link
![Page 4: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/4.jpg)
Before proceeding, 2 simple questions
1. Has anyone of you ever heard about dimensionality reduction techniques ?
2. If yes, then do you know why they are used ?
![Page 5: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/5.jpg)
Dimensionality reduction (In CS/IT context)
● What is it ?○ In machine learning and statistics, dimensionality reduction or
dimension reduction is the process of reducing the number of random variables under consideration, via obtaining a set of principal variables.
■ Courtesy : https://en.wikipedia.org/wiki/Dimensionality_reduction
○ Simply, removing the redundant information(among the random variables) and keeping the important information (principal variables) that will be sufficient enough to represent the original data.
![Page 6: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/6.jpg)
Dimensionality reduction (In CS/IT context)
● Why is it needed ?◆ It helps in data compressing and reducing the storage space required.
◆ It fastens the time required for performing same computations. Less dimensions leads to less
computing, also less dimensions can allow usage of algorithms that are unfit for a large number of
dimensions.
◆ It takes care of multicollinearity that improves the model performance. It removes redundant features.
For example: there is no point in storing a value in two different units (meters and inches).
● Don’t throw tomatoes towards us. This is just an example for the convenience of explanation. ..
![Page 7: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/7.jpg)
Some common DR Techniques.
1. Multidimensional scaling
2. Linear discriminant analysis
3. High Correlation
4. Backward feature elimination
5. Factor Analysis
6. Missing Values
7. Low Variances
8. Principal Component Analysis (PCA)
9. And many more ...
To learn more about this techniques Click here.
![Page 8: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/8.jpg)
Our topic : Locality Preserving Projection (LPP)
● An overview○ It is one of the DR techniques.○ Obviously, it is the topic of our presentation as well as
the topic of the research paper which we read.○ As the name suggests, this technique preserves the
information of its local region and thereby provides a helping hand in dimensionality reduction.
➔
![Page 9: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/9.jpg)
Locality Preserving Projection (LPP)
● Algorithm ◆ .
![Page 10: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/10.jpg)
Constructing the adjacency graph
![Page 11: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/11.jpg)
Constructing the adjacency graphA Graphical look
![Page 12: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/12.jpg)
Choosing the weights
![Page 13: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/13.jpg)
EigenMaps
![Page 14: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/14.jpg)
EigenMaps - Continues...
![Page 15: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/15.jpg)
Evaluating criteria
![Page 16: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/16.jpg)
Comparison between PCA and LPP.
![Page 17: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/17.jpg)
Any Queries?
![Page 18: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/18.jpg)
References
● http://www.machinelearning.org/proceedings/icml2005/papers/036_Statisti
cal_HeEtAl.pdf
● http://papers.nips.cc/paper/2359-locality-preserving-projections.pdf
● https://www.youtube.com/watch?v=BgMFBqrtCwo
![Page 19: CS404 Pattern Recognition - Locality Preserving Projections](https://reader033.vdocument.in/reader033/viewer/2022042600/58f1e97e1a28aba03d8b45c7/html5/thumbnails/19.jpg)
Thank you ...