kinectarms cscw2013
DESCRIPTION
TRANSCRIPT
![Page 1: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/1.jpg)
KinectArmsA Toolkit for Capturing and Displaying Arm
Embodiments in Distributed Tabletop Groupware
Aaron Genest, Carl Gutwin, Anthony Tang*, Michael Kalyn, and Zenja Ivkovic
University of Saskatchewan and *University of Calgary
![Page 2: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/2.jpg)
Develop a toolkit to help with representing gestures in
groupware.
easycheap
expressiveextensible
![Page 3: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/3.jpg)
KinectArms:KinectTable -- KinectViz
![Page 4: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/4.jpg)
Easy:KinectTable
![Page 5: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/5.jpg)
Kinect
Table
![Page 6: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/6.jpg)
Recognize Table
![Page 7: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/7.jpg)
Person
Recognize Table
![Page 8: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/8.jpg)
Recognize Table
![Page 9: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/9.jpg)
Recognize Table
![Page 10: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/10.jpg)
Recognize Table
![Page 11: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/11.jpg)
Recognize Table
![Page 12: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/12.jpg)
Cheap:KinectTable
![Page 13: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/13.jpg)
Capture Arms and Hands
![Page 14: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/14.jpg)
Raw Depth Image
Canny Edge Detection
Generate Arm Blobs
![Page 15: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/15.jpg)
Detect Arm Crossings
Create Structure
Separate Arm Blobs
![Page 16: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/16.jpg)
Cheap and Easy:KinectTable
![Page 17: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/17.jpg)
Get Data
Raw Image DataKinectArmsClient *client = KinectArmsGetClient();KinectData data;client->GetData(data);DepthImage& depthImage = data.depthImage;
![Page 18: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/18.jpg)
Table Data BinaryImage& maskImage = data.tableMaskImage;
Get Data
![Page 19: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/19.jpg)
Arm and Finger Data
client -> GetData(data);Arm& arm1 = data.arms[0];int fingerHeight = client->getHeight(arm1.fingers[0]);
Get Data
![Page 20: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/20.jpg)
Expressive:KinectViz
![Page 21: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/21.jpg)
Hand and Arm Representation
Video Separation
Stick Figures
![Page 22: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/22.jpg)
Hand and Arm Representation
Stick Figures
client-‐>GetData(data);viz.updateData(data);viz.applyEffects();
viz.getEffect(kSkeleton).enabled=true;
![Page 23: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/23.jpg)
Height
Expanding Circle
Rainbow ArmsShadow
![Page 24: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/24.jpg)
Height
Expanding Circle
Rainbow ArmsShadow
viz.getEffect(kShadow).enabled=true;
viz.getEffect(kRainbow).enabled=true;
viz.getEffect(kPointerCircle).enabled=true;
![Page 25: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/25.jpg)
Changing Visibility
Outline
Transparency
![Page 26: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/26.jpg)
Changing Visibility
Outline
Transparencyviz.getEffect(kTransparency).enabled=true;
viz.getEffect(kOutline).enabled=true;
![Page 27: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/27.jpg)
User Identification
Tattoos
![Page 28: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/28.jpg)
User Identification
Tattoos
viz.getEffect(kTattoo).enabled=true;
![Page 29: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/29.jpg)
Historical Traces
Motion Blur
Motion Lines
![Page 30: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/30.jpg)
Historical Traces
Motion Blur
Motion Lines
viz.getEffect(kTraces).enabled=true;viz.getEffect(kMotionBlur).enabled=true;
![Page 31: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/31.jpg)
![Page 32: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/32.jpg)
Extensible
![Page 33: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/33.jpg)
Combinations
![Page 34: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/34.jpg)
...or new visualizations
github.com/aarongenest/KinectArms
![Page 35: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/35.jpg)
Communication
![Page 36: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/36.jpg)
Interaction
![Page 37: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/37.jpg)
University of Waterloo
Queen’s University
UOIT
Olin College, MA
University of California, San Diego
![Page 38: KinectArms cscw2013](https://reader033.vdocument.in/reader033/viewer/2022061217/54b411a64a7959d12c8b47ee/html5/thumbnails/38.jpg)
Aaron Genest, Carl Gutwin, Anthony Tang*, Michael Kalyn, and Zenja Ivkovic
University of Saskatchewan and *University of Calgary
github.com/aarongenest/KinectArms
@aarongenest [email protected]