kinect and its application movement research lab kyungyong yang
TRANSCRIPT
![Page 1: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/1.jpg)
Kinect and its Application
Movement Research Lab
Kyungyong Yang
![Page 2: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/2.jpg)
Overview Kinect
Kinect in Research
Kinect in Medical
![Page 3: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/3.jpg)
Controllers
![Page 4: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/4.jpg)
XBOX 360 Kinect
![Page 5: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/5.jpg)
Kinect Commercial http://www.youtube.com/watch?v=T_QLg
uHvACs
![Page 6: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/6.jpg)
Issues
ActionObject
Real World
Recognize
Computer
![Page 7: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/7.jpg)
How to 3D Motion Capture
3D Surface Scan
Depth Camera
Etc…
![Page 8: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/8.jpg)
Depth Camera
Depth Image RGB Image
![Page 9: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/9.jpg)
How Kinect Works
• Evaluate near-infrared reflection time• Create accurate depth map
![Page 10: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/10.jpg)
Depth Cube Display
![Page 11: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/11.jpg)
Human Body Depth Image
• Can you recognize each body parts?• Is it possible to computer?
![Page 12: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/12.jpg)
Human Pose Recognition
![Page 13: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/13.jpg)
Kinect Mainstream
![Page 14: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/14.jpg)
Body Part Recognition 다양한 체형과 자세로 선행 학습
![Page 15: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/15.jpg)
Human Joint Estimation 선행 학습한 데이터를 이용 새로 입력되는 데이터로 human pose 생성
![Page 16: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/16.jpg)
Overview Kinect
Kinect in Research
Kinect in Medical
![Page 17: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/17.jpg)
Research Issue
잘 동작하게 하기 위해서 많은 예제를 사전학습 해야 한다 .
데이터를 무한정 늘릴 수 없으므로 선정이 중요하다 .
중복되지 않으면서 부족한 예제가 없도록 만들자 Data 의 uniform sampling 이 필요
![Page 18: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/18.jpg)
Research 앉는 동작 선행 학습
선 동작 선행 학습
![Page 19: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/19.jpg)
Research Labeling issue
![Page 20: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/20.jpg)
Research Joint estimation issue
Labeling 에 많은 noise 가 있을 경우 일부 body part 가 없을 수 있다 .
Labeling 에 실패한 body part 에 대한 처리 과정 필요
![Page 21: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/21.jpg)
Research Use bayesian estimation P(X|Z) = max( P(X|X’)P(X’|Z’) ) P(Z|X)
P(X)
P(X|Z) : Joint estimation X probability with given labeling Z
P(X|X’) : Transition probability from X’ to X P(X’|Z’) : Last joint estimation probability P(Z|X) : Labeling probability with given joint esti-
mation X P(X) : Joint estimation X probability with given
model
![Page 22: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/22.jpg)
Overview Kinect
Kinect in Research
Kinect in Medical
![Page 23: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/23.jpg)
Touchless Controller http://www.youtube.com/watch?v=M-wL
OfjVfVc
![Page 24: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/24.jpg)
Medical Application 수술실에서 오염되지 않고 기기를 자유롭게 제어할
수 있다 .
스페인 Tedesys 수술실 의사들이 손 동작을 통해 MRI 및 CAT 스캔 영상 제어 .
![Page 25: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/25.jpg)
Kinect in Operation Room http://www.youtube.com/watch?v=ZEQcO
ydY2k8
![Page 26: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/26.jpg)
Fitness Trainer Application http://
www.youtube.com/watch?v=2tSNsb7l0AM
![Page 27: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/27.jpg)
홈 재활운동 트레이너 꾸준한 재활 운동이 필요한 환자
매일 의사나 전문가가 체크하기 어려움
Kinect 를 이용한 자가 재활운동
![Page 28: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/28.jpg)
Conclusion At the research viewport
Kinect is very strong depth input device.
At the development viewport Kinect is very strong motion controller.
At the medical viewport Kinect is some aid.
![Page 29: Kinect and its Application Movement Research Lab Kyungyong Yang](https://reader035.vdocument.in/reader035/viewer/2022081513/56649cf85503460f949c90b9/html5/thumbnails/29.jpg)
Q/A
Thank You!