introduction to kinect v2
DESCRIPTION
2014/10/04 第25回コンピュータビジョン勉強会@関東 http://connpass.com/event/8082/TRANSCRIPT
![Page 1: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/1.jpg)
Introduction to Kinect v2
Tsukasa Sugiura
@UnaNancyOwen
![Page 2: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/2.jpg)
Self-Introduction
Tsukasa SugiuraMicrosoft MVP for Kinect for Windows
@UnaNancyOwen
http://UnaNancyOwen.com
(July 2014 - June 2015)
![Page 3: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/3.jpg)
ワタシハキネクトチョットデキルI can develop Kinect App a little
![Page 4: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/4.jpg)
Agenda
What is Kinect v2
Specifications
New Features
Demo
![Page 5: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/5.jpg)
Disclaimer
“This is preliminary software and/or hardware and APIs
are preliminary and subject to change.”(Kinect for Windows v2は暫定的なものであり、ソフトウェア、ハードウェア、およびAPIは製品版で変更される可能性があります。)
![Page 6: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/6.jpg)
Kinect for Windows v1 Sensor
MULTI-ARRAY MIC MOTORIZED TILT
3D DEPTH SENSORS
RGB CAMERA
![Page 7: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/7.jpg)
Kinect for Windows v2 Sensor
MULTI-ARRAY MIC
3D DEPTH SENSOR
( IR Camera + IR Emitters )
RGB CAMERA
![Page 8: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/8.jpg)
Kinect for Windows v2 Sensor
Image by iFixit
IR EMITTERS
IR CAMERA
![Page 9: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/9.jpg)
Specifications
Kinect for Windows v1 Kinect for Windows v2
Color 640×480 @ 30fps 1920×1080 @ 30fps
Depth 320×240 @ 30fps 512×424 @ 30fps
Sensor Structured Light(PrimeSense Light Coding)
Time of Flight(ToF)
Range 0.8~4.0 m 0.5~4.5 m
Angle of ViewHorizontal / Vertical
57 / 43 degree 70 / 60 degree
Microphone Array ◯ ◯
![Page 10: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/10.jpg)
Specifications
Kinect for Windows v1 Kinect for Windows v2
BodyIndex 6 people 6 people
Body 2 people 6 people
Joint 20 joint/people 25 joint/people
Hand State Open / Closed Open / Closed / Lasso
Gesture ☓ ◯
Face ◯
Speech / Beamforming ◯ ◯
![Page 11: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/11.jpg)
System / Software Requirements
OS * Windows 8, 8.1, Embedded 8, Embedded 8.1 (x64)
CPU Intel Core i7 3.1GHz (or higher)
RAM 4GB (or more)
GPU * DirectX 11 supported
USB * USB 3.0 (Intel or Renesas Host Controller)
Compiler * Visual Studio 2012, 2013 (Supported Express)
Language Native (C++), Managed (C#,VB.NET), WinRT (C#,HTML)
Other Unity Pro (Add-in), Cinder, openFrameworks (wrapper)
![Page 12: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/12.jpg)
System
Kinect for Windows v1 Kinect for Windows v2
PCPC
![Page 13: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/13.jpg)
System
Kinect
Driver
Kinect SDK
Application
Kinect
Driver
Kinect SDK
Application
Kinect
Service
Kinect SDK
Application
Kinect SDK
Application
Kinect for Windows v1 Kinect for Windows v2
![Page 14: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/14.jpg)
New Features
Joint
Tip (指先), Thumb (親指), Neck (首)の追加 解剖学的に正しいJointの構成
![Page 15: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/15.jpg)
New Features
Gesture
機械学習によるジェスチャー認識 (Discrete, Continuous)
識別器を学習するツール”Visual Gesture Builder”
Video by http://youtu.be/-XYoblrnDpg
![Page 16: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/16.jpg)
New Features
Face
Bounding Box (囲枠), Rotation (方向), Points (目、鼻、口角)の取得 Activity (動作), Appearance (外観), Expression (表情)の認識
Activity … 目の開閉, 口の開閉, Sensorに正対 Appearance … メガネの有無 Expression … 笑顔
![Page 17: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/17.jpg)
New Features
HDFace
顔の3Dモデルを作成するためのデータ 詳細なPoints (1347点), HairColor (髪色), SkinColor (肌色)の取得 モデルのフィッティング
![Page 18: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/18.jpg)
Other
Drawing the Point Cloud retrieved from
Kinect v2 using Point Cloud Library
Kinect v2から取得したPoint CloudをPCLを使って描画 PCL All-in-one installerはBlogで配布
![Page 19: Introduction to Kinect v2](https://reader031.vdocument.in/reader031/viewer/2022020712/547e862cb47959ca508b4bb8/html5/thumbnails/19.jpg)
Reference
Sample Program
Kinect2Sample | GitHubhttps://github.com/UnaNancyOwen/Kinect2Sample
Article Series
Kinect for Windows v2 | Build Insider http://www.buildinsider.net/small/kinectv2cpp
Blog
Kinect | Summary?Bloghttp://unanancyowen.com/?cat=3