isomap tracking with particle filter presented by nikhil rane
TRANSCRIPT
![Page 1: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/1.jpg)
ISOMAP TRACKING WITH PARTICLE FILTER
Presented by Nikhil Rane
![Page 2: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/2.jpg)
Dimensionality Reduction
Let xi be H-dimensional and yi be L-dimensional then dimensionality reduction solves the problem xi = f (yi) where H>L
![Page 3: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/3.jpg)
Dimensionality Reduction Techniques Linear
• PCA• Transforms data into a new coordinate system so that largest
variance in on the 1st dimension, 2nd largest along 2nd dimension …
• Classical MDS• Preserves Euclidean distances between points
Nonlinear • Isomap
• Preserves geodesic distances between points
• LLE• Preserves local configurations in data
![Page 4: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/4.jpg)
Face Database
![Page 5: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/5.jpg)
Principal Components Analysis (PCA)
1) Make the mean of the data zero2) Compute covariance matrix C3) Compute eigenvalues and eigenvectors
of C4) Choose the principal components5) Generate low-dimensional points using
principal components
![Page 6: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/6.jpg)
Performance of PCA on Face-data
![Page 7: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/7.jpg)
Classical Multidimensional Scaling (MDS) Compute Distance Matrix S
Compute inner product matrix B = -0.5JSJ where J = IN – (1/N)11T
Decompose B into eigenvectors and eigenvalues
Use top d eigenvectors and eigenvalues to form the d dimensional embedding.
![Page 8: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/8.jpg)
Performance of MDS on face-data
![Page 9: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/9.jpg)
Locally Linear Embedding (LLE)
Find neighbors of each data point
Compute weights that best reconstruct each data point from its neighbors
Compute low-dimensional vectors best reconstructed by the weights
![Page 10: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/10.jpg)
Performance of LLE on Face-data
![Page 11: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/11.jpg)
Geodesic Distance
Geodesic distance – the length of the shortest curve between two points taken along the surface of a manifold
![Page 12: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/12.jpg)
Isometric Feature Mapping (Isomap)
Construct neighborhood graph
Compute shortest paths between points
Apply classical MDS
![Page 13: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/13.jpg)
Performance of Isomap on face-data
![Page 14: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/14.jpg)
Tracking vs. Detection
Detection - locating an object independent of the past information
• When motion is unpredictable
• For reacquisition of a lost target Tracking - locating an object based on past information
• Saves computation time
![Page 15: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/15.jpg)
Recursive Bayesian Framework
Estimate the pdf of state at time t given the pdf of state at time t - 1 and measurement at time t• Predict
• Predict state of the system at time t using a system-model and pdf from time t – 1
• Update
• Update the predicted state using measurement at time t by Bayes’ rule
![Page 16: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/16.jpg)
Kalman Filtering vs. Particle Filtering
Kalman filter assumes the pdf of the state to be Gaussian at all times and requires the measurement and process noise to be Gaussian
Particle filter makes no such assumption and in fact estimates the pdf at every time-step
![Page 17: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/17.jpg)
Resampling
![Page 18: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/18.jpg)
Condensation algorithm Algorithm – 1) Resample 2) Predict 3) Measure
![Page 19: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/19.jpg)
Condensation algorithm
![Page 20: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/20.jpg)
Isomap Tracking with Particle Filtering
Create training set of a person’s face (off-line)
Use Isomap to reduce dimensionality of the training set (off-line)
Run particle filter on test sequence to track the person
![Page 21: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/21.jpg)
Training Data
![Page 22: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/22.jpg)
Isomap of Training Data
![Page 23: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/23.jpg)
Isomap Discrepancy Isomap gave dimensionality of 2 when head poses moving up
were removed. Thus, the dimensionality of 3 recovered by training data can be attributed to the non-symmetry of the face about the horizontal axis.
![Page 24: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/24.jpg)
Weighting Particles by SSD
![Page 25: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/25.jpg)
Weighting Particles by Chamfer distance
![Page 26: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/26.jpg)
State evolution without resampling
![Page 27: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/27.jpg)
State evolution with resampling
![Page 28: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/28.jpg)
Experimental Results
![Page 29: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/29.jpg)
Videos
![Page 30: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/30.jpg)
Videos Continued
![Page 31: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/31.jpg)
Conclusion and Future work Isomap provides good frame-work for pose estimation
Algorithm can track and estimate a person’s pose at the same time
Use of particle filter allows parallel implementation
Goal is to be able to build an Isomap on-line so that the particle filter tracker can learn as it tracks
![Page 32: ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane](https://reader036.vdocument.in/reader036/viewer/2022062422/56649f355503460f94c53795/html5/thumbnails/32.jpg)
Thank You!