Download - COMIT
![Page 1: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/1.jpg)
CRITICAL DESIGN REVIEW
COMIT
![Page 2: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/2.jpg)
2
CONTENTS• Motivations• Mission• Overview• Stakeholders• Sponsors• Team Organization
• Electrical System Overview• Functional Decomposition• Environmental Circuit Overview• Image Sensing Overview• Data Processing Overview• Application Framework
• Structural System Overview• Drawings
• Budget• Risks & Impacts• Economic Impacts• Risk Mitigation and Safety• Environmental Impacts• Societal Impact
• Schedule• Gantt Chart• Milestones
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
![Page 3: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/3.jpg)
3
MISSION
“The mediocre teacher tells. The good teacher explains. The superior teacher demonstrates. The great teacher inspires.” ― William Arthur Ward
Our mission is to inspire students in a way that defies conventions of the classroom, engaging them in the sights, sounds, and kinesthetic of a new experience.
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 4: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/4.jpg)
4
OVERVIEW
• This project will provide a table-sized multi-touch interface on which to run educational applications. • Primary Foci: • Exciting, dynamic, non-conventional learning• Appeals to childlike curiosity• Engages multiple users• User-Centered Design• Educates on math, science, and music
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 5: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/5.jpg)
5
STAKEHOLDERS
"Consumer preference and motivation is far less influenced by the tangible attributes of product and service than the sub-conscious sensory and emotional elements derived by the total experience."
Dr. Gerald Zaltman, Harvard Business School
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 6: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/6.jpg)
6
SPONSORS
• “A leader in sustainable, energy-efficient LED lighting”
• “Designers, fabricators, architects, engineers and end-users have come to rely on ACRYLITE® sheet products to meet their unique challenges in a broad range of market.”
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 7: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/7.jpg)
7
TEAM ORGANIZATION
Team Member RolesJenny Cofer Project ManagerJared Yenzer Systems EngineerJustin Barth Hardware EngineerNate Turley Software EngineerNate Glab Structural Engineer
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 8: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/8.jpg)
8
ELECTRICAL SYSTEM OVERVIEW
JUSTIN BARTH
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
![Page 9: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/9.jpg)
9
LEVEL 0 FUNCTIONAL DECOMPOSITION
Power 120 V AC
Touch
Touch Table
LegendInput / Output
Display
Audio
![Page 10: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/10.jpg)
10
LEVEL 1 FUNCTIONAL DECOMPOSITION
Power Suppl
y
12 V 12 V
Touch Sensing
Touch Utilization
Environmental Sensors
Power 120 V AC
Touch
Display
Audio
TouchData
LegendInput / OutputPowerData
![Page 11: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/11.jpg)
11
LEVEL 2 FUNCTIONAL DECOMPOSITION
Power Suppl
y
120V AC
Power 120 V AC
Display
Audio
Touch
Projector
Application
Framework
Image Processing System
ImagingSystem
Acrylic Surface
IR LEDS
Touch Sensing
Touch Utilization
Environmental Sensors
12 V
LegendInput / OutputPowerData
12 V
![Page 12: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/12.jpg)
12
ENVIRONMENTAL SENSORS
SYSTEM OVERVIEWJARED YENZER
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 13: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/13.jpg)
13
ENVIRONMENTAL SENSORS
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
Proximity Sensor
3.3 V
Imag
ing
Syst
em
LED STRIPS
R in I/O
Analog Output
TemperatureSensor
5 V
AnalogOutput
CAT5114Potentiometer
CAT32LED DRIVER
![Page 14: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/14.jpg)
14
PROXIMITY SENSOR
GP2Y0A21YK SPECIFICATIONS
• Infrared Analog Sensor
• 25 Hz Sampling Rate
• 5V Supply
• Detecting Distance• 10 to 80 cm
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 15: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/15.jpg)
15
TEMPERATURE SENSOR
TMP36 SPECIFICATIONS
• Analog Sensor
• 5V Supply
• ± 2º Celsius Accuracy
• -40º C to +125º C Range
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 16: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/16.jpg)
16
IMAGING SYSTEM OVERVIEW
JARED YENZER
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 17: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/17.jpg)
17
IMAGING SYSTEM
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
TCM8230Camera
ATXMEGA16D4μController
3.3 V
20 MHz CLK
8 Lines Parallel Camera Data2.8 V 1.5 V
I2C BUS
I/Os to Potentiometer D
ata
Proc
essi
ng
Syst
em
Proximity Sensor & Temp Data
Envi
ronm
enta
l Se
nsor
s Sy
stem
![Page 18: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/18.jpg)
18
MICROCONTROLLER
ATXMEGA16D4 INPUTS/OUTPUTS• I2C BUS• Program Camera Reg.• Image Size• Color Options• Shutter Speed
• I/O Pin for LED Circuit• Control Potentiometer
• 12-Bit ADC• Proximity Sensor• Temperature Sensor
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 19: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/19.jpg)
19
CAMERA
TCM8230 Inputs/Outputs• Parallel Data Out• D0 – D7
• I2C Bus• Control Registers
• 30 FPS• YUV Format (3 Bytes)• Luminance (Y)• Chrominance (UV)
• Sub-QCIF (128px x 96px)
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 20: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/20.jpg)
20
PROGRAMMER
AVRISP MKII SPECIFICATIONS• Program AVR• PDI 6 pin Interface
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 21: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/21.jpg)
21
TESTING RESULTS
TEST BOARD SOFTWARE• Test Major
Components• Microcontroller √• Camera• Voltage Regulators √ • Proximity Sensors
• Drivers for MCU √
Presenter: Jared YenzerCapstone Senior Design 2012
COMIT TouchSystems
![Page 22: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/22.jpg)
22
IMAGE PROCESSING SYSTEM OVERVIEW
JUSTIN BARTH
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
![Page 23: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/23.jpg)
FPGA IMAGE PROCESSING SYSTEM
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
Imag
ing
Syst
em
Alte
ra D
E0
Rasp
berr
y Pi8 Line Parallel Camera Data
Horizontal EndFrame End
Camera Clock Touch Coordinatesin TUIO FormatAvailable Input
5v USB
GPIO
RS-2
32
23
20MHz Clock
![Page 24: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/24.jpg)
24
FPGA
Altera DE0 INPUTS/OUTPUTS
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
• 72 GPIO pins
• RS-232 Serial Out• 115,200 baud
• 50MHz
![Page 25: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/25.jpg)
25
RS-232 TO USB ADAPTER
RS-232 to USB Adapter INPUTS/OUTPUTS
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
• RS-232 on FPGA
• USB on Raspberry Pi
![Page 26: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/26.jpg)
26
FPGA DATA SENT OVER RS-232
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
![Page 27: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/27.jpg)
BLOB DETECTION ALGORITHM
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
For each luminance pixel in frame if pixel ≥ brightness threshold for neighbor in pixel neighbors if neighbor is part of a blob pixel is incorporated into that blob if pixel not assigned a blob pixel assigned to new blob compare location of new pixel with blob parameters determine left, right, top, bottom most points of blob
Draw boxes around each blobUse center point of boxes to determine touch coordinates to send out
27
![Page 28: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/28.jpg)
28
BLOB DETECTION ALGORITHM IN MATLAB
Presenter: Justin BarthCapstone Senior Design 2012
COMIT TouchSystems
Basic image of IR touch blobs Image after processed through Matlab algorithm
![Page 29: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/29.jpg)
29
APPLICATION FRAMEWORKOVERVIEW
NATE TURLEY
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
![Page 30: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/30.jpg)
30
FUNCTIONAL DECOMPOSITION
5 V
Proj
ecto
r
Raspberry Pi
Imag
e Pr
oces
sing
Sy
stem
TUIO Spec via COM port
HDMI
![Page 31: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/31.jpg)
31
RASBERRY PI BOARD
SPECIFICATIONS• 700 MHz ARM11• Overclocking
• Broadcom VideoCore IV• OpenGL ES 2.0
• USBx2 via integrated Hub• HDMI Video Output• 5v, 700mA, 3.5 W• OS: Raspbian
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
Broadcom BCM2835 SoC
![Page 32: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/32.jpg)
32
SOFTWAREOpenFrameworks• Open source c++ toolkit• Game engine architecture• Setup()• Update()• Draw()
• Built in event listener• Custom Event Args• Callbacks
• OpenGL ES 2.0• Standard for embedded accelerated graphics• Hardware floating point support
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
![Page 33: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/33.jpg)
33
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
UML CLASS DIAGRAMCRITICAL SOFTWARE COMPONENTS
![Page 34: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/34.jpg)
34
APPLICATION FLOW CHART
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
![Page 35: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/35.jpg)
35
PROJECTOR
ViewSonic PDJ5351 SPECIFICATIONS
Presenter: Nate TurleyCapstone Senior Design 2012
COMIT TouchSystems
• 23’’ Throw Distance
• 2500 Lumens
• 3000:1 Contrast Ratio
• $420
![Page 36: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/36.jpg)
36
STRUCTURALSYSTEM OVERVIEW
NATHAN GLAB
Presenter: Nate GlabCapstone Senior Design 2012
COMIT TouchSystems
![Page 37: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/37.jpg)
37
TABLE STRUCTURE
Presenter: Nate GlabCapstone Senior Design 2012
COMIT TouchSystems
![Page 38: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/38.jpg)
38
TABLE STRUCTURE
Presenter: Nate GlabCapstone Senior Design 2012
COMIT TouchSystems
![Page 39: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/39.jpg)
39
INSIDE TABLE STRUCTURE
Presenter: Nate GlabCapstone Senior Design 2012
COMIT TouchSystems
![Page 40: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/40.jpg)
40
BUDGET OVERVIEWJENNIFER COFER
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 41: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/41.jpg)
41
BUDGETItem Company Unit Price Quantity Total CostProjector $420 1 $420IR LED Reel Environment
alLights.com$215 - $21.50 (estimated)
1, length 5m
$193 (estimated)
Rear Projection Sheet (diffuser)
Acrylite $152.57 - $15.26
1, 40x25in $137.31
Endlighten T Acrylic (Polished)
Acrylite $219.34 - $21.93
1, 40x25in $197.41
Plexiglas Overlay
Home Depot $109 1, 40x25 $109
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 42: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/42.jpg)
42
BUDGETItem Company Unit Price Quantit
yTotal Cost
Proximity Sensing Board Final
Advanced Circuits
$33 1 $33
AVRISP Microcontroller
Atmel $56.64 1 $56.64
Proximity LEDs Sparkfun $1.35 48 $64.80CMOS Camera Sparkfun $9.95 2 $19.90Potentiometer Mouser $3.04 2 $6.08LED Driver Mouser $2.48 2 $4.96IR LED track materials
$50 $50
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 43: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/43.jpg)
43
BUDGETItem Company Unit Price Quantity Total CostSound System
Provided 1 1 N/A
Structural Materials
Home Depot $150
Proximity Sensing Board Draft
Advanced Circuits
$33 1 $33
Total $1,481.18
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 44: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/44.jpg)
44
ECONOMIC ASPECTS
• Marketability of system: • Could decrease teachers needed (esp. special education)• Could supplement homeschooling • Could extend past an educational environment• Cost expected to decrease in mass production
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 45: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/45.jpg)
45
RISKS & IMPACTSOVERVIEWJENNIFER COFER
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 46: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/46.jpg)
46
ENVIRONMENTAL IMPACTS• Acrylite is Green and LEEDs certified • “We are committed to minimizing our environmental impact.
Operating under the Guiding Principles of Responsible Care®, we strive to continuously improve our health, safety, and environmental performances. Our goal is to improve the environment by supplying sustainable and long-living acrylic products to the green building sector and to all other markets we serve.”
• Environmental Lights has A New Angle on Green• “At EnvironmentalLights.com we believe in sustainable lighting
solutions that are energy-efficient and long-lasting, which lowers energy use and minimizes the environmental impacts from manufacturing and waste.”
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 47: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/47.jpg)
47
RISK MITIGATION & SAFETY
• Temperature• Fans• Ventilation• Overall heat sensor (in LED circuit)• Temperature sensor on camera board / projector unit
• Dust• Fans • Devices accessible for cleaning
• Followed Component Specifications (linked below)• Acrylic here• IR LEDs here
• Followed UL Guidelines (linked here)Presenter: Jenny Cofer
Capstone Senior Design 2012COMIT TouchSystems
![Page 48: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/48.jpg)
48
SOCIETAL IMPACT
• Defying educational conventions• “Spoon feeding in the long run teaches us
nothing but the shape of the spoon” ~ E. M. Forster
• Providing the alternative• “It is the supreme art of the teacher to awaken
joy in creative expression and knowledge.~ Albert Einstein
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems
![Page 49: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/49.jpg)
49
SCHEDULE OVERVIEW
NATHAN GLAB
Presenter: Nate GlabCapstone Senior Design 2012
COMIT TouchSystems
![Page 50: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/50.jpg)
SCHEDULE
50
![Page 51: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/51.jpg)
SCHEDULEDate Description Deliverable
Sept. 25/27 Milestone 1Oct. 16/18 PDR
Oct. 23/25 Functional Decomposition
Nov. 13/15 Milestone 2
Dec. 4/6 CDR
Jan. 15/17 Milestone 3 Materials Ordered Have the Structure Assembled Application Framework complete Camera Driver set up Matlab blob detection optimized
Apr. 16/18 Milestone 4 FPGA Implementation Camera to FPGA integration FPGA to CPU integration Environmental Sensor Implementation Software Application Implementation
Apr. 23/25 Expo Completed table with custom software running
51
Presenter: Nate GlabCapstone Senior Design 2012
COMIT TouchSystems
![Page 52: COMIT](https://reader035.vdocument.in/reader035/viewer/2022070420/56815e5c550346895dccd531/html5/thumbnails/52.jpg)
52
QUESTIONS?
Presenter: Jenny CoferCapstone Senior Design 2012
COMIT TouchSystems