sdp 12 project “praser” senior design project final project review team mosaic advisor:...
TRANSCRIPT
SDP 12
Project “PRASER”Senior Design Project Final Project Review
Team Mosaic
Advisor: Professor Lixin GaoMembers: Allen Chew, Charles Essien, Brian Giang, Simon Ma
Evaluators: Professor Gong, Professor Vouvakis
2SDP 12 2
Agenda
Introduction• Refined project definition• Comparison
Project Specification• System block diagram• Subsystem components• Application• Accomplished• Demonstration
3SDP 12 3
Reintroduction - Motivation
Online presentations are boring• Difficult to view both presentation
and presenter at the same time• Low quality slides (streaming video)• Loss of focus on presenter
Viewing remote presentations• Bad visual quality• Loss of expression
4SDP 12 4
Comparison
For most presentations,• Difficult to capture both the
presenter and Power Point at the same time
• Requires a cameraman
However our prototype application• Capable of capture both the
presenter and Power Point• Addition functions/gestures
5SDP 12 5
Reintroduction - Goals
We want to:Improve presentation experience
• More interactive• More entertaining
Rethink approach to capturing presentations• Bring focus back to the presenter• Facilitate “emotion” for remote presentation
6SDP 12 6
Design Specification – Project Definition
Praser is …
“A redesigned platform capable of delivering an enhanced presentation experience, both for in
person and remote viewers.”
More interactive utility for presenters Better experience for viewers with avatars
7SDP 12 7
Design Specifications –Block Diagram
System Block Diagram
8SDP 12 8
Design Specifications – Kinect Subsystem
OpenNI & NITE• Generate “users”• Return interpreted motions and gestures
OpenGL• Real-time image manipulation
OpenNI NITE OpenGL
9SDP 12 9
Kinect Subsystem - Capabilities
Gesture Recognition• Hand gestures for control• User poses
Tracking• Mapping user position to screen• Location based “selections”
Compositing• Background removal• Image manipulation
10
SDP 12 10
Kinect Subsystem – Avatar Application
Capture presenter in on screen avatar
Walk around and point modes• X, Y coordinates mapped with Kinect
Depth information• Presenter avatar points mapped to
actual points
11
SDP 12 11
Kinect Subsystem – Avatar Application cont’dBenefits:More expression and emotionBetter interaction with slideshow slidesMore efficient remote viewing of presentation
12
SDP 12 12
Accomplished
Hand TrackingHand GesturesVideo RecordingLayer Control – Presenter, Power Point Slides, AnnotationsSelecting specific Power Point SlidesDisplaying two slides at once – Splitting
13
SDP 12
Kinect Demonstration
13
14
SDP 12 14
The Future
Writing Recognition when annotating. Capturing the presenter in 3-D using two Kinects. Using the Kinect for other purposes (e.g. medical
diagnostics and therapy)
15
SDP 12 15
Problems Addressed
Purchased safety goggles to prevent retinal damage
Blanking not currently implemented For safety reasons decided would be best not to
use the laser system in this project. Memory Leak in software
Video Recording Threading Tracking and Scaling
16
SDP 12 16
Team Responsibility
Allen Chew (CSE) – Team Manager, Coordinated laser projection system, Software Development, Researched on how to build correctional amplifier, Researched and ordered parts for project in a timely manner
Charles Essien (CSE) – Software coordinator, Research graphics libraries, Isolated user pixels and overlay onto slides, Created Flow and Calibration, Split Screen
Brian Giang (EE) – Laser Projection Coordinator, Coordinated team
meetings and set deadlines, Assembled laser projection system and figured signal lines from DAC
Simon Ma (CSE) – Compiled OpenLase Binaries, Ported code over to Ubuntu, Coordinated hand tracking and gestures, Created Annotations
17
SDP 12 17
The End
Thank you very much for your time. I hope you enjoyed the presentation.
Questions?