team kinect
DESCRIPTION
Team Kinect. Final presentation. What is Kinect ?. Microsoft gaming console accesoire for Xbox 360 Human interface device with gestures For Xbox 360 since September 2010 For Windows since February 2012. Motivation. Interest in HCI and alternative input devices - PowerPoint PPT PresentationTRANSCRIPT
1
TEAM KINECT
Final presentation31-8-2012
2
What is Kinect?
31-8-2012
Microsoft gaming console accesoire for Xbox 360 Human interface device with gestures For Xbox 360 since September 2010 For Windows since February 2012
3
Motivation
31-8-2012
Interest in HCI and alternative input devices Expand functionality of (consumer) hardware “Trendy” topic Versatile application areas
Entertainment Education Security Medicine
4
Existing Projects
31-8-2012
Application specific projects : MIT: Google Chrome KinEmote: Controlling home theater software Use in sterile environment like a hospital
5
Technical background
31-8-2012
3 important components: Infrared laser projector RGB Camera Depth sensor (monochrome camera with IR-pass-
through filter)
Not used (by us): Microphone array
6
IR Grid
31-8-2012
7
Name: Kinect using shortCuts
Application independent Kinect control
Using Java and OpenNI and PrimeSense
Java Robot-Class
Our project – “KinectCut”
31-8-2012
8
Approach
31-8-2012
Stock gesture recognition isn’t appropriate enough for our approach
Measuring the angles and length of the arms Velocity and position of several body parts
9
Interaction Model
31-8-2012
Problem to differ between gestures and actions
Solution: mode arm & action arm Mode arm (left): switch
between states Action arm (right): propose
the action while in state
10
From Body to Command
Discretizing angles to recognize gestures
Smoothing filter for mouse coordinates to screen mapping
31-8-2012
11
Mapping for Mouse Control
31-8-2012
12
Architecture
31-8-2012
OpenNI&
PrimeSense
BodyParser
(discretization)
1110100001
Gestures/Skeleton
StateMachine
Body (Skeleton)/Raw Data
Robot
Actions
Control
13
Feedback
31-8-2012
No tengible feedback provided by Kinect
Different Types of feedback: Mode displayed Calibration state Hand-recognition state History of actions and state
changes Wireframe model
14
Demo Video
31-8-2012
15
Experience on project
31-8-2012
Working in an interdisciplinary, multicultural and multilanguage team
Finding ideas that can be completed in the given time with the given team
16
Experience on Summer Camp
31-8-2012
océ is not only doing paper printing :-) Real-life experience on project work
New Environment New Task New Team
Excellent organization of SummerCamp Social Events Accommodation Supervision
17
In the end, it was FUN!
31-8-2012
Thankyouocé!