![Page 1: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/1.jpg)
Kinect & Leap Motion Overview
Nicholas Gillian
Responsive Environments, MIT Media Lab
Thursday, September 5, 13
![Page 2: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/2.jpg)
Leap Demo
Thursday, September 5, 13
![Page 3: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/3.jpg)
Kinect Libraries, APIs & Tools
• OpenNI SDK
• Openframeworks
• Microsoft Official Kinect SDK
• Synapse
Thursday, September 5, 13
![Page 4: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/4.jpg)
Microsoft Official Kinect SDK
Thursday, September 5, 13
![Page 5: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/5.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
Thursday, September 5, 13
![Page 6: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/6.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
Advantages
Thursday, September 5, 13
![Page 7: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/7.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
Thursday, September 5, 13
![Page 8: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/8.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
• Standing and seated tracking modes
Thursday, September 5, 13
![Page 9: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/9.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
• Standing and seated tracking modes
• Joint Orientation in addition to Joint Position
Thursday, September 5, 13
![Page 10: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/10.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
• Standing and seated tracking modes
• Joint Orientation in addition to Joint Position
• Tracks up to 6 users, 2 users full skeleton tracking
Thursday, September 5, 13
![Page 11: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/11.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
• Standing and seated tracking modes
• Joint Orientation in addition to Joint Position
• Speech Recognition
• Tracks up to 6 users, 2 users full skeleton tracking
Thursday, September 5, 13
![Page 12: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/12.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
• Standing and seated tracking modes
• Joint Orientation in addition to Joint Position
• Speech Recognition
• Face tracking (feature tracking - i.e. mouth, nose, eyes, etc. and direction estimation)
• Tracks up to 6 users, 2 users full skeleton tracking
Thursday, September 5, 13
![Page 13: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/13.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Calibration-free skeleton tracking
Advantages
• Standing and seated tracking modes
• Joint Orientation in addition to Joint Position
• Speech Recognition
• Face tracking (feature tracking - i.e. mouth, nose, eyes, etc. and direction estimation)
• Good examples (c++, c#) and user documentation
• Tracks up to 6 users, 2 users full skeleton tracking
Thursday, September 5, 13
![Page 14: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/14.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
AdvantagesThursday, September 5, 13
![Page 15: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/15.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
Disadvantages
Thursday, September 5, 13
![Page 16: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/16.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Only works on Windows
Disadvantages
Thursday, September 5, 13
![Page 17: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/17.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Only works on Windows
Disadvantages
• Very CPU intensive
Thursday, September 5, 13
![Page 18: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/18.jpg)
Microsoft Official Kinect SDK
• http://www.microsoft.com/en-us/kinectforwindows/
• Only works on Windows
Disadvantages
• Very CPU intensive
• Skeleton tracking can fail drastically if not used in ideal scenarios
Thursday, September 5, 13
![Page 19: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/19.jpg)
Open NI
Thursday, September 5, 13
![Page 20: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/20.jpg)
Open NI
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Thursday, September 5, 13
![Page 21: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/21.jpg)
Open NI
Advantages
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Thursday, September 5, 13
![Page 22: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/22.jpg)
Open NI
• Cross Platform
Advantages
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Thursday, September 5, 13
![Page 23: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/23.jpg)
Open NI
• Cross Platform
Advantages
• Works with a large number of depth sensors
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Thursday, September 5, 13
![Page 24: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/24.jpg)
Open NI
• Cross Platform
Advantages
• Works with a large number of depth sensors
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
• Robust Skeleton Tracking
Thursday, September 5, 13
![Page 25: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/25.jpg)
Open NI
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
• Cross Platform
Advantages
• Works with a large number of depth sensors
• Robust Skeleton Tracking
• Calibration-free skeleton tracking
Thursday, September 5, 13
![Page 26: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/26.jpg)
Open NI
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
AdvantagesThursday, September 5, 13
![Page 27: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/27.jpg)
Open NI
Disadvantages
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Thursday, September 5, 13
![Page 28: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/28.jpg)
Open NI
Disadvantages
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
• Installation requires a few independent drivers, libraries, etc.
Thursday, September 5, 13
![Page 29: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/29.jpg)
Open NI
Disadvantages
• Installation requires a few independent drivers, libraries, etc.
• API requires some time to digest
• http://openni.org/
• ...an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Thursday, September 5, 13
![Page 30: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/30.jpg)
Synapse
Thursday, September 5, 13
![Page 31: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/31.jpg)
Synapse
• http://synapsekinect.tumblr.com/
Thursday, September 5, 13
![Page 32: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/32.jpg)
Synapse
Advantages
• http://synapsekinect.tumblr.com/
Thursday, September 5, 13
![Page 33: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/33.jpg)
Synapse
• Packages up the Open NI tracking libraries for you and sends the tracked positions of a user’s joint positions out to another application via OSC (Open Sound Control)
Advantages
• http://synapsekinect.tumblr.com/
Thursday, September 5, 13
![Page 34: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/34.jpg)
Synapse
• Packages up the Open NI tracking libraries for you and sends the tracked positions of a user’s joint positions out to another application via OSC (Open Sound Control)
Advantages
• http://synapsekinect.tumblr.com/
• Very easy to use - OS X version requires no setup, Windows version needs drivers to be installed
Thursday, September 5, 13
![Page 35: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/35.jpg)
Synapse
• Packages up the Open NI tracking libraries for you and sends the tracked positions of a user’s joint positions out to another application via OSC (Open Sound Control)
Advantages
• http://synapsekinect.tumblr.com/
• Very easy to use - OS X version requires no setup, Windows version needs drivers to be installed
Disadvantages
Thursday, September 5, 13
![Page 36: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/36.jpg)
Synapse
• Packages up the Open NI tracking libraries for you and sends the tracked positions of a user’s joint positions out to another application via OSC (Open Sound Control)
Advantages
• http://synapsekinect.tumblr.com/
• Very easy to use - OS X version requires no setup, Windows version needs drivers to be installed
Disadvantages
• Skeleton tracking needs calibration pose
Thursday, September 5, 13
![Page 37: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/37.jpg)
Synapse
• Packages up the Open NI tracking libraries for you and sends the tracked positions of a user’s joint positions out to another application via OSC (Open Sound Control)
Advantages
• http://synapsekinect.tumblr.com/
• Very easy to use - OS X version requires no setup, Windows version needs drivers to be installed
• Only works with “Kinect XBox360” hardware
Disadvantages
• Skeleton tracking needs calibration pose
Thursday, September 5, 13
![Page 38: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/38.jpg)
Openframeworks
Thursday, September 5, 13
![Page 39: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/39.jpg)
Openframeworks
• http://www.openframeworks.cc/
• https://github.com/ofTheo/ofxKinect
• Uses the libfreenect library
Thursday, September 5, 13
![Page 40: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/40.jpg)
Openframeworks
Advantages
• http://www.openframeworks.cc/
• https://github.com/ofTheo/ofxKinect
• Uses the libfreenect library
Thursday, September 5, 13
![Page 41: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/41.jpg)
Openframeworks
Advantages
• http://www.openframeworks.cc/
• Easiest way to access the raw depth image from the Kinect
• https://github.com/ofTheo/ofxKinect
• Uses the libfreenect library
Thursday, September 5, 13
![Page 42: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/42.jpg)
Openframeworks
Advantages
• http://www.openframeworks.cc/
• Easiest way to access the raw depth image from the Kinect
• https://github.com/ofTheo/ofxKinect
• Supports multiple Kinects
• Uses the libfreenect library
Thursday, September 5, 13
![Page 43: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/43.jpg)
Openframeworks
Advantages
• http://www.openframeworks.cc/
• Easiest way to access the raw depth image from the Kinect
• https://github.com/ofTheo/ofxKinect
• Supports multiple Kinects
• Uses the libfreenect library
Thursday, September 5, 13
![Page 44: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/44.jpg)
Openframeworks
Advantages
• http://www.openframeworks.cc/
• Easiest way to access the raw depth image from the Kinect
• https://github.com/ofTheo/ofxKinect
• Supports multiple Kinects
• Works on OS X
• Uses the libfreenect library
Thursday, September 5, 13
![Page 45: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/45.jpg)
Openframeworks
Advantages
• http://www.openframeworks.cc/
• Easiest way to access the raw depth image from the Kinect
• https://github.com/ofTheo/ofxKinect
Disadvantages
• Supports multiple Kinects
• Works on OS X
• Uses the libfreenect library
Thursday, September 5, 13
![Page 46: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/46.jpg)
Openframeworks
• No skeleton tracking
Advantages
• http://www.openframeworks.cc/
• Easiest way to access the raw depth image from the Kinect
• https://github.com/ofTheo/ofxKinect
Disadvantages
• Supports multiple Kinects
• Works on OS X
• Uses the libfreenect library
Thursday, September 5, 13
![Page 47: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/47.jpg)
Kinect Gesture Demo
Thursday, September 5, 13
![Page 48: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/48.jpg)
Kinect Gesture Demo
Built Using:
Thursday, September 5, 13
![Page 49: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/49.jpg)
Kinect Gesture Demo
• OpenNI API to interface with the Kinect
Built Using:
Thursday, September 5, 13
![Page 50: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/50.jpg)
Kinect Gesture Demo
• OpenNI API to interface with the Kinect
• NITE library for calibration-free skeleton tracking
Built Using:
Thursday, September 5, 13
![Page 51: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/51.jpg)
Kinect Gesture Demo
• OpenNI API to interface with the Kinect
• NITE library for calibration-free skeleton tracking
• OSC (Open Sound Control) to send skeleton data to external apps
Built Using:
Thursday, September 5, 13
![Page 52: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/52.jpg)
Kinect Gesture Demo
• OpenNI API to interface with the Kinect
• NITE library for calibration-free skeleton tracking
• OSC (Open Sound Control) to send skeleton data to external apps
Built Using:
OSC
Thursday, September 5, 13
![Page 53: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/53.jpg)
Kinect Gesture Demo
• OpenNI API to interface with the Kinect
• NITE library for calibration-free skeleton tracking
• OSC (Open Sound Control) to send skeleton data to external apps
Built Using:
• Openframeworks as a wrapper for drawing and networking
OSC
Thursday, September 5, 13
![Page 54: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/54.jpg)
Kinect Gesture Demo
• OpenNI API to interface with the Kinect
• NITE library for calibration-free skeleton tracking
• OSC (Open Sound Control) to send skeleton data to external apps
Built Using:
• Openframeworks as a wrapper for drawing and networking
• Gesture Recognition Toolkit: www.nickgillian.com/software/grt
OSC
Thursday, September 5, 13
![Page 55: Kinect & Leap Motion Overview - Nick Gillian · 2016-03-06 · Kinect Libraries, APIs & Tools •OpenNI SDK •Openframeworks •Microsoft Official Kinect SDK •Synapse Thursday,](https://reader033.vdocument.in/reader033/viewer/2022052803/5f2bcbc666b260564a42e6de/html5/thumbnails/55.jpg)
www.nickgillian.com/09-05-13.html
Slides & Software Links
Thursday, September 5, 13