![Page 1: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/1.jpg)
Human Pose detection
Abhinav Golas
S. Arun Nair
![Page 2: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/2.jpg)
Overview
Problem Previous solutions Solution, details
![Page 3: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/3.jpg)
Problem
Segmentation of humans from video capture
Pose detection (by fitting onto body model) Resistant to noise (background etc.)
![Page 4: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/4.jpg)
Previous procedures
View problem as sequential process1. Segmentation2. Pose detection
Problems: Not using prior knowledge of “what a human looks
like” in segmentation Uses only information from detected “foreground”
for pose detection All available information not used
![Page 5: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/5.jpg)
Solution
Combine segmentation and pose detection as a single step Uses all available information in frame (for pose
detection) Uses prior knowledge of human body for better
segmentation
PoseCut: Bray, Kohli, Torr Model segmentation as Bayesian labeling problem
with 2 labels: foreground, background
![Page 6: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/6.jpg)
Details
Model problem as energy minimization problem – model as an MRF
Use a basic stickman model as a human body model
Adaptive model for background – GMM Neighbourhood terms – Generalised Potts
model
![Page 7: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/7.jpg)
MRF – Markov Random Fields
Markov property for time:P(event:t) depends on events at times k<t
Markov property for space:P(event:x) depends on events at N(x) – neighbourhood of x
Use Gibbs energy model for solving We use neighbourhood of 8 pixels
![Page 8: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/8.jpg)
Stickman model
Basic model 26 degrees of
freedom
![Page 9: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/9.jpg)
GMM – Gaussian Mixture Model
Model each pixel of image as a weighted sum of Gaussian functions
Adapt functions using each new frame Pixel matches expected value –
background, else foreground
![Page 10: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/10.jpg)
Execution details
For each frame Calculate weights for GMM, Potts model For given value of 26 vector (based on degrees of
freedom of stickman model) calculate energy cost for stickman model (by distance transform)
Minimize energy for Bayesian labeling by graph cut Minimize 26 vector by repeated graph cuts by
Powell's algorithm
![Page 11: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/11.jpg)
Sample results
A – original frame B – segmentation by
colour likelihood and contrast terms
C – when GMM terms are taken
D – with pose prior components
E – deduced pose
![Page 12: Human Pose detection Abhinav Golas S. Arun Nair. Overview Problem Previous solutions Solution, details](https://reader035.vdocument.in/reader035/viewer/2022072006/56649cf85503460f949c8f43/html5/thumbnails/12.jpg)
Comparisons