paraviewweb + kinect
DESCRIPTION
The results of 6 weeks of spare time looking at how to couple a Kinect sensor to a CFD simulation result viewer. The results is ParaViewWebKinect a strange and wonderful mash-up of ParaViewWeb and Kinect... No plan to release anything at the moment. But if you are interested in getting a bit of knowledge of how it was put together, email me at [email protected] See it in action at http://youtu.be/XHXqmQPqQNsTRANSCRIPT
ParaViewWeb + Kinect
Towards accessible immersive CFD results visualisation
Introduction
• Objective of the presentation:
• Provide a synopsis of the methodology used when developing proof-of-concept ParaViewWeb + Kinect.
The aim of the ParaViewWeb+Kinect project is to evaluate feasibility and demonstrate proof-of-concept of gesture based navigation for
CFD simulation visualisation, not to provide a final product.
Component Chart
Kinect Sensor
Kinect Driver
Kinect SDK
Adapter (C#)
pvpython + pv_web_visualizer.py
Geometry + CFD results files
Visualizer/index.html
index.html+ interpreter library (JavaScript)
WebSocket
WebSocket
MouseEvent
Components Details
• C# Adapter:
SkeletonFrame DepthImageFrame
InteractionFrame
UserInfo
Broadcast as JSON
Component Details
• HTML/JavaScript
Receive JSON
Create custom HandEvents:HandMove, HandGrip, HandRelease
Display hand "cursors"
Convert HandEvents into MouseEvents (move, over, enter,
leave, down, up, click)
Implementation
Pro• Allow kinect movement with no
modification of targeted web-page;
• Allow for kinect to be hosted on different computer/OS than client;
• Support hand interaction and skeleton movement;
• Small and simple.
Cons• No recognition of hand
gesture;• One hand is dominant when
mapping hand movement to mouse movement;
• Slow;• Not 100% web-based, and
requires distribution the local C# adapter;
• Based on kinect SDK, need porting to openNI for non-kinect sensors.
Demo
• The demo is based on ParaViewWeb, but we trying to make it work other web-based services
ParaViewWeb + Kinect demo: http://youtu.be/XHXqmQPqQNs
The End
This project is standing on the shoulders of giants such Microsoft & Kitware...
Special thanks to
The Edge
and
Hack-the-Evening
Contact details:
Twitter: @FormerlyHibou
https://juliendecharentenay.appspot.com