presented by motion capture group: azadeh jamalian ata naemi sa'ed abu-alhaija sunghoon ivan...
Post on 20-Dec-2015
221 views
TRANSCRIPT
![Page 1: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/1.jpg)
Presented By Motion Capture Group:
Azadeh JamalianAta Naemi
Sa'ed Abu-Alhaija Sunghoon Ivan Lee
SensIT Technology
![Page 2: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/2.jpg)
Overview
Introduction
System Overview
Hardware unit
Image Processing
Modeling and Animation
Results
Financing
Applications and Marketing
Future Missions
Question Period
Demonstration
Welcome to our Presentation!
![Page 3: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/3.jpg)
Introduction
Study dance movements MedicineRobotic
Sports
Our Mission:
Study dance movements
![Page 4: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/4.jpg)
System Overview
Image Processing
Unit
Image Processing
Unit
Animation
Unit
Real time
User friendly
Easy to customize for different applications
Compatible with other systems
Low cost
![Page 5: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/5.jpg)
System Overview
Image Processing
Unit
Animation
Unit
![Page 6: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/6.jpg)
Hardware Block Diagram
Microcontroller
PIC16LF84A
4Sel
4-16
Decoder
Turn on One LED
Turn on LED’s for 10 frames/sec
Timing issues
Components from local vendors and engineering department
![Page 7: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/7.jpg)
Hardware Components
Microcontroller (PIC16LF84A)- Assembly Language- Watch Dog Timer (WDT)- Low power (1mA), Sleep mode (3.5μA)
Regulator (LM317)- Regulate 3.3V power supply off a 9V battery- Power off operation as well as staple WDT
Infrared LED’s (KIE-7305)- 1.6V, draw a current of 2mA- Each LED is on for 50 msec
![Page 8: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/8.jpg)
Test Models
Angle Sensitivity Problem solving as project progressed Use high efficient IR LED’s
![Page 9: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/9.jpg)
System Overview
Image Processing
Unit
Animation
Unit
![Page 10: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/10.jpg)
Software Components
Low Level Design - Capture Control Unit (CCU) - Image Processing Unit (IPU)
![Page 11: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/11.jpg)
Capture Control Unit (CCU)
Three main tasks
1. Adjusting Phase Difference
2. Capturing Image
3. Convert Raw Image into RGB
![Page 12: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/12.jpg)
Image Processing Unit (IPU)
Calculate position of IR light source in the frame Placing film in front of the web camera
- Film absorbs all visible light
- Only IR lights penetrate the film
![Page 13: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/13.jpg)
IPU- Challenges
Synchronization with Hardware
Distorted Images and Virtual Images
![Page 14: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/14.jpg)
Synchronization
Frequency of IR sensors and frame rate can be identical
IR Freq.
FrameRate
t
t
Tb
Tb
![Page 15: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/15.jpg)
Frequency of IR sensors and frame rate can be identical
IR Freq.
FrameRate
t
t
Tb
Tb
Tphase
Synchronization
![Page 16: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/16.jpg)
Unexpected Images
Distorted Images & Virtual ImagesSolutions:
- Intensity (changing threshold value)
- Width & Height
![Page 17: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/17.jpg)
System Overview
Image Processing
Unit
Animation
Unit
![Page 18: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/18.jpg)
Start CCU IPU
External FileAUDisplay Monitor
Data Flow Diagram
Captured
Frames
Calculated Coordinates of the LED’s
X and Y values
Animated Model
![Page 19: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/19.jpg)
Animation Unit (AU)
Software:
-C++ (OpenGL)
Main Tasks:
-Reads the coordinates from an external file
-Assign the coordinates of each joint and record them in a file
-Model 2D motion in real time
![Page 20: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/20.jpg)
AU- Challenges
Synchronization with IPU- Timing- Start Point- Missing Points
Simulation and Modeling- Coordinate Systems- Matrix Transformation and Rotation
![Page 21: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/21.jpg)
Simulation Algorithm- Cont.Start
Reads From the External File
Is it neck- length away from the neck joint?
Is it hand- length away from the right shoulder?
Is it hand- length away from the left shoulder?
Is it leg- length away from the upper right leg joint?
Is it leg- length away from the upper left leg joint?
Record the Head position
Record the Right Hand position
Record the Left Hand position
Record the Left Leg position
Record the Right Leg` position
Animate the Model Accordingly
Y
Y
Y
Y
Y
N
N
N
N
It’s not that easy to think smart!
![Page 22: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/22.jpg)
AU- User Interface
![Page 23: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/23.jpg)
Results
Frame Rate: 10 frames/sec
Max Motion Frequency: 2Hz
Max Distance from camera: 1m
Precision: 100% (Clear angle of sight)
Accuracy: ± 10%
![Page 24: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/24.jpg)
Finance
Equipment Estimated Cost
Sensors/markers + interface-electronics $400
Sources + interface-electronics $400
Computer interface-electronics $100
User Interface $80
Cables $20
Total Cost $1000.00
Available Funding:
$400 from EUSS
Actual Cost:
Estimated Cost:
Equipment Estimated Cost
Sensors/markers + interface-electronics $60
Sources + interface-electronics $80
Computer interface-electronics 0
User Interface $60
Cables $10
Total Cost $200
![Page 25: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/25.jpg)
Supplementary Application
SensIT Mouse:
Tracks the motion of finger
![Page 26: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/26.jpg)
Marketing
Different applications:
- Art
- Robotic
- Medicine
- Sports
- Game Industry
Competitors:
- Electronic Arts Canada
- C4 Digital Entertainment
- PhoeniX Technologies Incorporated
![Page 27: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/27.jpg)
Future Improvements
Known Limitations:
- Captures the motion only in 2D
- Line of sight
- Angle of sight
- Limited range of monitoring
- Interference from other IR sources
- Frequency limitation of object motion
Improvements:
- Capture the motion in 3D
- Multiple marking
- Enhance the speed
![Page 28: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/28.jpg)
What We Learned
“If you’re not sure what makes the problem
Guess what causes it,
Make it worse,
Try to solve it,
If it didn’t work, try another source!”
![Page 29: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/29.jpg)
Conclusion
Our system:
- Research based project
- Proof of concept to design a low cost
motion capture system
- Initial step to designing a 3D motion capture system
In future:
- Unifying music and dance
- Future research opportunities
- Future Coop positions
![Page 30: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/30.jpg)
Acknowledgements
Special Thanks to:
Dr. Lucky One
Mr. Steve Whitmore
Dr. Pavaneh
Dr. Patrick Leung
Dr. Ivan Bajic
Dr. Payandeh
Mr. Vinay Kotamraju
Mr. Amir Masoud Niroumand
Mr. Brad Oldham
Thanks a ton!
![Page 31: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/31.jpg)
Questions ?
![Page 32: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/32.jpg)
Points to make here
Camera Recognizes the IR as a white light
True white color pixel in 24-bit RGB gives
[R,G,B] = [255,255,255]
Only Use one of R,G,B matrices
IPU- Cont.
![Page 33: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/33.jpg)
IPU Algorithm
![Page 34: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/34.jpg)
IPU Algorithm
![Page 35: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/35.jpg)
IPU Algorithm
![Page 36: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/36.jpg)
IPU Algorithm
![Page 37: Presented By Motion Capture Group: Azadeh Jamalian Ata Naemi Sa'ed Abu-Alhaija Sunghoon Ivan Lee SensIT Technology](https://reader030.vdocument.in/reader030/viewer/2022033104/56649d435503460f94a1ee11/html5/thumbnails/37.jpg)
Simulation Algorithm
- One LED blinks twice indicating the start point
- An array to hold the coordinates
Useful for applications that track the motion of a specific object
However, not smart enough to detect the position of various joints in real time