kinect based 3d object manipulation on a desktop display
TRANSCRIPT
![Page 1: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/1.jpg)
Kinect Based 3D Object Manipulation on a Desktop Display
Mukund Raj, Sarah H. Creem-Regehr, Kristina M.Rand, Jeanine K. Stefanucci and William B.
Thompson
University of Utah
![Page 2: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/2.jpg)
Introduction
• Controlled experimental evaluation of a Kinect based user interface.
• 3D object manipulation in virtual environment.
• Two variations - with & without self avatars.
2
![Page 3: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/3.jpg)
Motivation
• Availability of low cost gesture recognition hardware.
• 3D graphics on web platform.
3
The LeapMicrosoft Windows Kinect
Nintendo Wii
![Page 4: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/4.jpg)
Avatars
• Self Avatars
• Earlier studies – Inconclusive results on spatial cognition tasks.
4
![Page 5: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/5.jpg)
Questions
• Does self avatar have observable effect on interfaces for object manipulation in virtual environments on a desktop display?
• Are there strong individual differences in the effect?
5
![Page 6: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/6.jpg)
Experimental task
• Orientation matching 3D object by rotating object in virtual world.
6
![Page 7: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/7.jpg)
Interface - Display Conditions
7
• Sphere Condition
• Self Avatar Condition
* Between subjects design used
![Page 8: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/8.jpg)
Interface – Interaction Methods
8
• Swipe – Rotation along hand motion.
• Twist – Rotation about the wrist.
![Page 9: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/9.jpg)
Experimental objects
• Objects
9
Number of objects Trials per object
Training 1 6
Test 12 1
Training Object Test Object #1
![Page 10: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/10.jpg)
Experiment Setup
10
• Kinect
• Orientation Sensor
• Wireless Mouse
![Page 11: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/11.jpg)
Result – Completion Time
• No significant difference between sphere and avatar condition overall
11
![Page 12: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/12.jpg)
Result – Completion Time
• Difference as function of gender and video game experience.
12
![Page 13: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/13.jpg)
Gaming experience / Gender ?
13
![Page 14: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/14.jpg)
Results – Manipulation modes
• Difference in manipulation mode as a function of gender/gaming experience
14
![Page 15: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/15.jpg)
Conclusion
• Effect of self avatar on performance of only a subset of users
• Necessary to check for individual differences in performance data
16
![Page 16: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/16.jpg)
Future Research
• Automatic twist/swipe mode detection• Replace orientation sensor with a low cost
mobile device accelerometer• 6DOF task• Stereographic displays• Symmetrical objects• Tactile Feedback• Comprehension vs. Manipulation
15
![Page 17: Kinect Based 3D Object Manipulation on a Desktop Display](https://reader033.vdocument.in/reader033/viewer/2022051710/5a65d85a7f8b9a8c538b47f1/html5/thumbnails/17.jpg)
This work was supported by the National Science Foundation under Grant No. 1116636
17