motion icon
DESCRIPTION
Motion Icon. Feng Liu Advisor: Michael Gleicher Computer Sciences Department University of Wisconsin-Madison. Goal. Motion Icon Summarize a motion capture data into a single image Application: motion database browsing. Solution. Extract key frames Pose clustering Extract key frames - PowerPoint PPT PresentationTRANSCRIPT
Motion Icon
Feng Liu
Advisor: Michael Gleicher
Computer Sciences Department
University of Wisconsin-Madison
Goal Motion Icon
Summarize a motion capture data into a single image
Application: motion database browsing
Solution Extract key frames
Pose clustering Extract key frames
Render key frames Re-position key frames Determine proper camera settings to
render them effectively
Feature dimension reduction Decomposing motion using Singular
Value Decomposition (SVD)
Select the q most significant singular values
Reconstruct new ‘motion’ M ‘
NNNTTTNT VSUM
qqqTqT SUM ''
qqS '
Only need 8~15/57 DOFs
to keep 90-95% singular values
Feature dimension reduction
first 3 new motion signals of M’Singular values from decomposing a walking motion using SVD
Pose clustering Unsupervised clustering method based
on Gaussian Mixture Models Estimate a GMM model for a motion using
Expectation-Maximization (EM) Initialize the clusters using the Gaussian
Mixture components Merge 2 closest clusters greedily until only 1
cluster is left Select the number of clusters with minimal
Rissanen cost
Rissanen cost A combination of fitting errors and the
number of clusters
)log()1)2
*)1(1((
2
1),|(log),( TN
NNNKKypKMDL y
fitting errors number of clusters
Clustering procedure
minimal cost with 4 clusters
Clustering examples
Extract key frames First frames of each cluster as key
frame
Shortest path from cluster graph containing all the clusters
First frame scheme
?
Shortest path scheme Shortest path from Cluster Graph
Containing all the clusters
C2 C0 C1
C3
Cluster graphC2 C0 C3 C1
Shortest path
Cluster sequence
Path-finding algorithm A variation of Hamiltonian path: NP-hard ! Greedy approximation
Construct cluster sequence Greedily shorten the cluster sequence
Find all sub-paths start and end with the same cluster, all the intermediate vertices exist in the other part
of the cluster sequence Select the shortest path, and reduce it
Eliminate redundant vertices at the beginning and the end of the path
Path-finding algorithm
C2 C0 C1 C0 C2 C0 C3 C1 C0 C2 C0 C3
C2 C0 C2 C0 C3 C1 C0 C2 C0 C3
C2 C0 C3 C1 C0 C2 C0 C3
C2 C0 C3 C1 C0 C3
C2 C0 C3 C1
Shortest path
Re-position key frames Along user-specified routes
Line Circle Grid ……
Lost motion trajectory info.
Re-position key frames Along the original motion trajectory
Scale the motion trajectory Evenly position the key frames
Proper camera setting selection Goal
Render key frames in a way with minimal key frame occlusion
At vector the center of the root trajectory
Up vector Interpolation btw [0 1 0] and the minor motion
axis Eye vector
Eye-At line perpendicular to the plane determined by the the Up vector and the major motion axis
Camera settings
Results
Motion icon
Walk containing 559 frames
Results
Motion icon
High-wire Walk containing 548 frames
Results
Motion icon
“Walk” containing 236 frames
Results
Motion icon
“Ballet” containing 1022 frames
Results
Motion icon
“Faint” containing 145 frames
More icons
Conclusion A complete framework for creating
motion icon SVD based feature reduction GMM based unsupervised pose clustering Cluster graph based key frame extraction Key frame reposition methods Motion trajectory based camera setting
determination
Thank You