presenter : wei- hao huang authors : miguel ´ a. carreira-perpi˜ n´an icml , 2010
DESCRIPTION
The Elastic Embedding Algorithm for Dimensionality Reduction. Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010. Outlines. Motivation Objectives Methodology Experiments Conclusions Comments. Motivation. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/1.jpg)
Intelligent Database Systems Lab
Presenter : Wei-Hao Huang
Authors : Miguel ´ A. Carreira-Perpi˜n´an
ICML, 2010
The Elastic Embedding Algorithm for Dimensionality Reduction
![Page 2: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/2.jpg)
Intelligent Database Systems Lab
OutlinesMotivationObjectivesMethodologyExperimentsConclusionsComments
![Page 3: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/3.jpg)
Intelligent Database Systems Lab
Motivation• The disadvantage of dimensionality reduction
– Difficult to understand their objective function.
– Optimisation is costly and prone to local optima.
![Page 4: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/4.jpg)
Intelligent Database Systems Lab
Objectives• To propose a new dimensionality reduction
More efficient and robust
Further our understanding algorithms
![Page 5: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/5.jpg)
Intelligent Database Systems Lab
Methodology - Framework
Elastic Embedding High dimension dataset
Low dimension data
Laplacian eigenmaps SNE+
Objective function
![Page 6: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/6.jpg)
Intelligent Database Systems Lab
Methodology – Elastic Embedding
• Object function
• Gradient of E
![Page 7: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/7.jpg)
Intelligent Database Systems Lab
Methodology - Study of λ
• N=2
• N>2
![Page 8: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/8.jpg)
Intelligent Database Systems Lab
Methodology – Out of sample
• Objective function
• Mapping and reconstruction mappings
![Page 9: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/9.jpg)
Intelligent Database Systems Lab
Experiments – 2D spiral
![Page 10: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/10.jpg)
Intelligent Database Systems Lab
Experiments – Swiss roll
![Page 11: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/11.jpg)
Intelligent Database Systems Lab
Experiments – COIL-20 dataset
![Page 12: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/12.jpg)
Intelligent Database Systems Lab
Conclusions• EE dimensionality reduction improves over SNE
methods.
• EE produces better quality more quickly and robustly.
• All of ideas can be directly applied to SNE, t-SNE and
earlier algorithms.
![Page 13: Presenter : Wei- Hao Huang Authors : Miguel ´ A. Carreira-Perpi˜ n´an ICML , 2010](https://reader035.vdocument.in/reader035/viewer/2022062222/56816181550346895dd112c3/html5/thumbnails/13.jpg)
Intelligent Database Systems Lab
Comments• Advantages– EE improves disadvantage of SNE on different
versions• Applications– Dimensionality Reduction