q: a tactile approach to digital organization
DESCRIPTION
COMP 410 December 2009. Q: A Tactile Approach To Digital Organization. COMP 410 – What is it?. Semester-long project “Customer” poses a challenge Student-run Dr. Wong and 4 TAs Warmup project: BallNet. Resources – Sharepoint. TFS + Visual Studio. Resources – Development Servers. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/1.jpg)
Q: A Tactile ApproachTo Digital Organization
COMP 410December 2009
![Page 2: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/2.jpg)
COMP 410 – What is it? Semester-long project “Customer” poses a challenge Student-run Dr. Wong and 4 TAs Warmup project: BallNet
![Page 3: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/3.jpg)
Resources – Sharepoint
![Page 4: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/4.jpg)
TFS + Visual Studio
![Page 5: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/5.jpg)
Resources – Development Servers
![Page 6: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/6.jpg)
Our Team
Nick BridleInput
Jaewoo JeonClient
Lee MarinelliServer, Input
Rick ManningServer, Client
Kevin MontroseServer, Plugin
Seth O’BrienClient
Jim Russell3D Interface
Ivan VanServer
![Page 7: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/7.jpg)
Our Organization
Every two weeks we: Presented new prototype to customer Reassessed progress Set goals for next two weeks
Advantages: Regular schedule More upfront progress
![Page 8: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/8.jpg)
The Challenge
Search is useful, but users need a way to structure information.
![Page 9: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/9.jpg)
Our Solution
Workspaces Multi-user collaboration Categories, Tags, and Links
Gestures!
![Page 10: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/10.jpg)
Demonstration
![Page 11: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/11.jpg)
System Overview – Modules
Server
GestureInput
Plugin Client
![Page 12: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/12.jpg)
The Server
Server
GestureInput
Plugin Client
![Page 13: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/13.jpg)
Server – Architecture
Workspace
Workspace
Workspace
Workspace
Task Queue Task Queue Task Queue Task Queue
Server Worker Threads
HTTP Communications Layer
![Page 14: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/14.jpg)
Server – HTTP Communication HTTP Requests
GET to get data POST to send data
JSON encoding used for structured queries:
![Page 15: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/15.jpg)
Server – Concurrency
Many-reader, single-writer Number of threads proportional to
number of processor cores
![Page 16: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/16.jpg)
Server – Workspace Instances Each instance manages:
Document content Document metadata Full-text indexing Version tracking Lock tracking
![Page 17: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/17.jpg)
Resource Desc. Framework
Semantic Web Triples:
Subject Predicate Object
Easy to represent many different types of relationships
“Tagged with”
www.Q-is-the-best.com
“COMP 410”
![Page 18: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/18.jpg)
The Plugin
Server
GestureInput
Plugin Client
![Page 19: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/19.jpg)
Plugin – Overview
Extend the browser, rather than replace it
Familiar interface for keyboard and mouse
User “shares” items from the browser, optionally specifying title, category, and tags
![Page 20: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/20.jpg)
Plugin – Design Firefox extension
Well-exercised platform
Lots of flexibility XUL for UI Javascript for logic
![Page 21: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/21.jpg)
Plugin – The Guts
Wraps all requests into JSON objects Data transmitted as base-64 encoded
strings Tracks browsing history on a per-tab
basis Tracks user actions like reload,
back/forward Browsing histories are non-linear!
![Page 22: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/22.jpg)
The Client
Server
GestureInput
Plugin Client
![Page 23: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/23.jpg)
Client – Overview
Browser-hosted application Windows Presentation Foundation
Reference implementation Wide variety of clients could use same
server Platform independence!
![Page 24: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/24.jpg)
Client – Design
![Page 25: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/25.jpg)
Scalability
Download data only as needed Workspace structure Thumbnails Full documents
![Page 26: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/26.jpg)
Demonstration
![Page 27: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/27.jpg)
The Input
Server
GestureInput
Plugin Client
![Page 28: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/28.jpg)
Input – Motivation
Interesting Substitute for traditional keyboard and
mouse Uses Wiimotes!
Intuitive Meshes well with 3D view
Flexible Doesn't restrict the user to one input
interface
![Page 29: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/29.jpg)
Input – Inspiration
![Page 30: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/30.jpg)
Input – Physical Setup
2 Wiimotes on tripods Gloves with IR LEDs on the fingers
![Page 31: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/31.jpg)
Wiimote Stereovision
Like depth perception in humans Calibrate with cube
Human w/glove
s
MonitorWiimote Wiim
ote
![Page 32: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/32.jpg)
Input – Demonstration
![Page 33: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/33.jpg)
Gesture Recognition
Project points in 3D space to two 2D planes
Apply 2D recognizers
![Page 34: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/34.jpg)
Custom Gestures
Pre-existing libraries used to analyze strokes
![Page 35: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/35.jpg)
Super Annoying ProblemsInteresting Challenges Interfacing different platforms
Browser/client communication Client/input communication
Firefox Poor documentation No official API for extensions!
Hardware (Wiimotes)
![Page 36: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/36.jpg)
Future Improvements
Security HTTPS SQL queries
More 3D layouts Improved gesture fidelity Improved gloves
Reflected IR approach
![Page 37: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/37.jpg)
Acknowledgements
![Page 38: Q: A Tactile Approach To Digital Organization](https://reader033.vdocument.in/reader033/viewer/2022051421/568161d3550346895dd1cc4d/html5/thumbnails/38.jpg)
Questions