the curse of (attribute) dimensionality
TRANSCRIPT
![Page 1: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/1.jpg)
![Page 2: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/2.jpg)
The curse of (attribute) dimensionality• Data may have large number of attributes
– Data matrix with many columns d
– Challenges• Models have large number of parameter
– d(d-1)/2 variances / covariances in a Gaussian model– Cumbersome, more difficult to estimate well
– Dimension reduction• Identify small number of attributes (or combinations of attributes) that
account for most of the data variation• Other dimensions of the data are viewed as noise,
![Page 3: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/3.jpg)
![Page 4: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/4.jpg)
![Page 5: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/5.jpg)
![Page 6: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/6.jpg)
![Page 7: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/7.jpg)
![Page 8: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/8.jpg)
![Page 9: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/9.jpg)
! is Lagrange Multiplier used in constrained optimization. See https://en.wikipedia.org/wiki/Lagrange_multipliers
projected mean is 0 because D is centered
![Page 10: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/10.jpg)
=
![Page 11: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/11.jpg)
![Page 12: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/12.jpg)
Exercise!
![Page 13: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/13.jpg)
![Page 14: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/14.jpg)
![Page 15: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/15.jpg)
![Page 16: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/16.jpg)
![Page 17: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/17.jpg)
Scree Plots: eigenvalues in decreasing order
![Page 18: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/18.jpg)
![Page 19: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/19.jpg)
![Page 20: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/20.jpg)
![Page 21: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/21.jpg)
![Page 22: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/22.jpg)
![Page 23: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/23.jpg)
![Page 24: The curse of (attribute) dimensionality](https://reader030.vdocument.in/reader030/viewer/2022012807/61bd465461276e740b11275b/html5/thumbnails/24.jpg)