markerless motion capture with unsynchronized moving cameras n. haslern. hasler, mpi inf.,...
TRANSCRIPT
![Page 1: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/1.jpg)
Markerless Motion Capture with Unsynchronized Moving
CamerasN. Hasler, MPI Inf., Saarbrucken, Germany
B. Rosenhahn, MPI Inf., Saarbrucken, GermanyT. Thormahlen, MPI Inf., Saarbrucken, Germany
M. Wand, MPI Inf., Saarbrucken, GermanyJ. Gall, MPI Inf., Saarbrucken, Germany
H.-P. Seidel, MPI Inf., Saarbrucken, GermanyIEEE 2009
![Page 2: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/2.jpg)
Outline
• Introduction• Steps• Experiments
![Page 3: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/3.jpg)
Introduction
![Page 4: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/4.jpg)
Steps
• Camera Calibration• Camera Synchronization• Motion Capture
![Page 5: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/5.jpg)
Camera Calibration
• Single Camera Structure from Motion KLT–Tracker or SIFT filter out feature points
RANSAC with multi-view constraints
minimizes the error of 3D points (Gaussian distribution)– d(….) = Euclidean distance– Pj = 3D object point– Ak = 3x4 camera matrix– p(j,k) = K images J trajectories of 2D feature point
![Page 6: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/6.jpg)
Camera Calibration
• Multi camera Structure from Motion– Register N reconstructions into global system (H) find and merge 3D object points (pairwise match) (color intensity , uniqueness constraint)
![Page 7: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/7.jpg)
Camera Calibration
• Tensor Voting filter (noise)• Least Squares filter (smooth)• 3D surface reconstruction
![Page 8: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/8.jpg)
Camera Synchronization
• Camera Synchronization– Audio signals– denotes cross correlation (Fast Fourier Trans.)– * convolution
![Page 9: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/9.jpg)
Motion Capture
• Kinematic Chains
• Silhouette Extraction
• Pose Estimation
![Page 10: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/10.jpg)
Experiments
![Page 11: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/11.jpg)
![Page 12: Markerless Motion Capture with Unsynchronized Moving Cameras N. HaslerN. Hasler, MPI Inf., Saarbrucken, Germany B. RosenhahnB. Rosenhahn, MPI Inf., Saarbrucken,](https://reader036.vdocument.in/reader036/viewer/2022062318/551b524f550346d41a8b6083/html5/thumbnails/12.jpg)