touch technologies · 2013. 5. 13. · touch technologies touching the world by sara kilcher...
TRANSCRIPT
![Page 1: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/1.jpg)
Touch TechnologiesTouching the World
by Sara Kilcher
Distributed Systems Seminar30. April 2013
![Page 2: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/2.jpg)
Motivation
![Page 3: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/3.jpg)
Overview
• Skin as touchscreen– Skinput
![Page 4: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/4.jpg)
Overview
• Skin as touchscreen– Skinput– OmniTouch
![Page 5: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/5.jpg)
Overview
• Skin as touchscreen– Skinput– OmniTouch
• Touchscreen for virtual 3D– Toucheo
![Page 6: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/6.jpg)
Skin as Touchscreen
Introduction
• Mobile phones like computers• Small screen/keyboard size
User becomes bottleneck
![Page 7: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/7.jpg)
Skinput OmniTouch Toucheo
Harrison et al. 2010
Skinput
![Page 8: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/8.jpg)
Skinput OmniTouch Toucheo
Purpose
• Extend interface
• Using skin
![Page 9: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/9.jpg)
Skinput OmniTouch Toucheo
Video
Video: 01_skinput.avi
![Page 10: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/10.jpg)
Skinput OmniTouch Toucheo
Difficulty
• Touch where?→
![Page 11: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/11.jpg)
Skinput OmniTouch Toucheo
How it works
The Waves
![Page 12: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/12.jpg)
Skinput OmniTouch Toucheo
How it works
Processing the Waves
![Page 13: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/13.jpg)
Skinput OmniTouch Toucheo
How it works
Training SVM
Video: 02_skinput.avi
![Page 14: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/14.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition
Video: 03_skinput.avi
![Page 15: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/15.jpg)
Skinput OmniTouch Toucheo
How well it works
• User study with 13 participants• Touch event errors “negligible”• Position not very accurate
– Overall 87.6% (5 to 10 locations)– Up to 95.5% (5 locations)
![Page 16: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/16.jpg)
Skinput OmniTouch Toucheo
How well it works
Video: 04_skinput.avi
![Page 17: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/17.jpg)
Skinput OmniTouch Toucheo
Personal Opinion
• Very innovative• Requires lots of calibration
– Did not work well in demos
• Lots of “magic” that isn't entirely understood– Hard to tune gesture recognition?→– Completely individual
![Page 18: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/18.jpg)
Skinput OmniTouch Toucheo
Vision
• Armband will get smaller
• Use cases without projector– Car– Jogging– Audio Feedback?
![Page 19: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/19.jpg)
Skinput OmniTouch Toucheo
Harrison et al. 2011
OmniTouch
![Page 20: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/20.jpg)
Skinput OmniTouch Toucheo
Purpose
• Like Skinput, but– Needs a projector– Needs a depth-camera– Can be used on additional flat surfaces
![Page 21: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/21.jpg)
Skinput OmniTouch Toucheo
Video
![Page 22: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/22.jpg)
Skinput OmniTouch Toucheo
Video
Video: 05_omnitouch.avi
![Page 23: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/23.jpg)
Skinput OmniTouch Toucheo
Difficulties
Projection
• Surface is uneven– Distortion– Focus
• Surface is moving– Tracking
![Page 24: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/24.jpg)
Skinput OmniTouch Toucheo
Difficulties
Input Recognition
• Touch event recognition– Touch when?→– Touch where?→
![Page 25: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/25.jpg)
Skinput OmniTouch Toucheo
How it works
The Hardware
![Page 26: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/26.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition of Fingers
Step 1:
Depth map of scene
![Page 27: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/27.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition of Fingers
Step 2:
Derivatives
![Page 28: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/28.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition of Fingers
Step 3:
“Template matching”
![Page 29: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/29.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition of Fingers
Step 4:
Group slices &
find fingertips
![Page 30: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/30.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition of Touch Events
Flood fill the finger
![Page 31: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/31.jpg)
Skinput OmniTouch Toucheo
How it works
Recognition of Surfaces
![Page 32: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/32.jpg)
Skinput OmniTouch Toucheo
How it works
Displaying Interfaces
• Projective texturing
![Page 33: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/33.jpg)
Skinput OmniTouch Toucheo
How well it works
Click Accuracy
• User study with 12 participants
• Click recognition: 96.5%
![Page 34: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/34.jpg)
Skinput OmniTouch Toucheo
How well it works
Location Accuracy
Touchscreen: 15mm
Omnitouch, hand: 25mm
![Page 35: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/35.jpg)
Skinput OmniTouch Toucheo
Personal Opinion
• Fascinating paper• Popular on web• No real applications yet• Use self-made algorithms
– possible to improve
![Page 36: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/36.jpg)
Skinput OmniTouch Toucheo
Vision
• Entire world as touchscreen
• Device will get smaller and more comfortable
![Page 37: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/37.jpg)
Skinput OmniTouch Toucheo
Skinput OmniTouch
• Touch accuracy
• Use cases without projector
• Location accuracy
• Use more surfaces– More applications
![Page 38: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/38.jpg)
Skinput OmniTouch Toucheo
Skinput OmniTouch
• “Impact” press needed– No long press– No dragging
• Setup & calibration• Stable arm position• Predefined points
• Finger detection• Where to place
hardware?• Bright light
![Page 39: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/39.jpg)
Skinput OmniTouch Toucheo
Touchscreen World⇔
Touchscreen
![Page 40: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/40.jpg)
Skinput OmniTouch Toucheo
Hachet et al. 2011
Toucheo
![Page 41: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/41.jpg)
Skinput OmniTouch Toucheo
Purpose
• Merge trends– Multitouch touchscreen– Stereoscopic screen
Easy interaction with virtual 3D objects!
• Solve difficult tasks– e.g. 3D docking task
![Page 42: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/42.jpg)
Skinput OmniTouch Toucheo
Video
![Page 43: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/43.jpg)
Skinput OmniTouch Toucheo
Video
Video: 06_toucheo.avi
Video: 07_toucheo.avi
![Page 44: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/44.jpg)
Skinput OmniTouch Toucheo
Difficulties
3D and the Hands
• Occlusions
• Depth collision
![Page 45: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/45.jpg)
Skinput OmniTouch Toucheo
Difficulties
Eye Related
Contradiction
![Page 46: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/46.jpg)
Skinput OmniTouch Toucheo
Difficulties
Eye Related
Contradiction– 3D useful
above/below plane
![Page 47: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/47.jpg)
Skinput OmniTouch Toucheo
Difficulties
Eye Related
Contradiction– 3D useful
above/below plane– Touchscreen only
in plane
![Page 48: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/48.jpg)
Skinput OmniTouch Toucheo
Difficulties
Usable Interface
• Typical smartphone has 3+1 DOF, Toucheo has 9+1
• Intuitive interface?
![Page 49: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/49.jpg)
Skinput OmniTouch Toucheo
Difficulties
The 9+1 DOF
X Y
ZTranslation: 3 DOF
![Page 50: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/50.jpg)
Skinput OmniTouch Toucheo
Difficulties
The 9+1 DOF
X Y
ZRotation: 3 DOF
![Page 51: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/51.jpg)
Skinput OmniTouch Toucheo
Difficulties
The 9+1 DOF
X Y
ZScaling: 3 DOF
![Page 52: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/52.jpg)
Skinput OmniTouch Toucheo
Difficulties
The 9+1 DOF
X Y
ZScaling: 3+1 DOF
![Page 53: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/53.jpg)
Skinput OmniTouch Toucheo
Difficulties
Smartphone: 3+1 DOF
X Y
Z
![Page 54: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/54.jpg)
Skinput OmniTouch Toucheo
How it works
The Setup
Screen
Mirror
Touchscreen
Mirrored Screen
![Page 55: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/55.jpg)
Skinput OmniTouch Toucheo
How it works
The Setup
Screen
Mirror
Touchscreen
Mirrored Screen
![Page 56: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/56.jpg)
Skinput OmniTouch Toucheo
How it works
The Setup
3D Screen
Mirror
Touchscreen
Mirrored 3D Screen
![Page 57: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/57.jpg)
Skinput OmniTouch Toucheo
How it works
The Setup
![Page 58: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/58.jpg)
Skinput OmniTouch Toucheo
How it works
The Setup
• Occlusion problems eliminated
• Depth collision problems reduced
![Page 59: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/59.jpg)
Skinput OmniTouch Toucheo
How it works
3D to 2D - „Virtual Ray”
![Page 60: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/60.jpg)
Skinput OmniTouch Toucheo
How it works
The 9+1 DOF
X Y
ZScaling: 3+1 DOF
![Page 61: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/61.jpg)
Skinput OmniTouch Toucheo
How it works
The 9+1 DOF
Video: 08_toucheo.avi
![Page 62: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/62.jpg)
Skinput OmniTouch Toucheo
How well it works
• User study, 16 participants– Bulky, quite big– 3D-docking task solved well– Feedback used to improve interface
![Page 63: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/63.jpg)
Skinput OmniTouch Toucheo
Personal Opinion
• Clever setup to solve common problems
• Interface: independent achievement
![Page 64: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/64.jpg)
Skinput OmniTouch Toucheo
Vision
• Interface used in other applications
• New generation less bulky
![Page 65: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/65.jpg)
Toucheo OmniTouch / Skinput
Touchscreen
Touch of non-planar objects
Virtual 3D objects Real 3D objects
Input from traditionaltouchscreen
Input from camera / vibration sensors
How to use touch events How to get touch events
Novel GUI Standard GUI
Display withstereoscopic screen
Display with pico-projector
Static / big Mobile / small
![Page 66: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/66.jpg)
Displays of the Future
• Assumption– Increase in screen size = increase in device size
• Alternative– Displays non-planar surfaces→
• Market direction?
![Page 67: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/67.jpg)
Displays of the Future
Video: 09_future.avi
Video: 10_future.avi
Video: 11_future.avi
Video: 12_future.avi
Video: 13_future.avi
Video: 14_future.avi
![Page 68: Touch Technologies · 2013. 5. 13. · Touch Technologies Touching the World by Sara Kilcher Distributed Systems Seminar 30. April 2013 ... – OmniTouch • Touchscreen for virtual](https://reader035.vdocument.in/reader035/viewer/2022071108/5fe2fef53de41c5997253fa6/html5/thumbnails/68.jpg)
Displays of the Future
?