comit

CRITICAL DESIGN REVIEW

COMIT

2

CONTENTS• Motivations• Mission• Overview• Stakeholders• Sponsors• Team Organization

• Electrical System Overview• Functional Decomposition• Environmental Circuit Overview• Image Sensing Overview• Data Processing Overview• Application Framework

• Structural System Overview• Drawings

• Budget• Risks & Impacts• Economic Impacts• Risk Mitigation and Safety• Environmental Impacts• Societal Impact

• Schedule• Gantt Chart• Milestones

Presenter: Nate TurleyCapstone Senior Design 2012

COMIT TouchSystems

3

MISSION

“The mediocre teacher tells. The good teacher explains. The superior teacher demonstrates. The great teacher inspires.” ― William Arthur Ward

Our mission is to inspire students in a way that defies conventions of the classroom, engaging them in the sights, sounds, and kinesthetic of a new experience.

Presenter: Jenny CoferCapstone Senior Design 2012

COMIT TouchSystems

4

OVERVIEW

• This project will provide a table-sized multi-touch interface on which to run educational applications. • Primary Foci: • Exciting, dynamic, non-conventional learning• Appeals to childlike curiosity• Engages multiple users• User-Centered Design• Educates on math, science, and music


COMIT TouchSystems

5

STAKEHOLDERS

"Consumer preference and motivation is far less influenced by the tangible attributes of product and service than the sub-conscious sensory and emotional elements derived by the total experience."

Dr. Gerald Zaltman, Harvard Business School


COMIT TouchSystems

6

SPONSORS

• “A leader in sustainable, energy-efficient LED lighting”

• “Designers, fabricators, architects, engineers and end-users have come to rely on ACRYLITE® sheet products to meet their unique challenges in a broad range of market.”


COMIT TouchSystems

7

TEAM ORGANIZATION

Team Member RolesJenny Cofer Project ManagerJared Yenzer Systems EngineerJustin Barth Hardware EngineerNate Turley Software EngineerNate Glab Structural Engineer


COMIT TouchSystems

8

ELECTRICAL SYSTEM OVERVIEW

JUSTIN BARTH

Presenter: Justin BarthCapstone Senior Design 2012

COMIT TouchSystems

9

LEVEL 0 FUNCTIONAL DECOMPOSITION

Power 120 V AC

Touch

Touch Table

LegendInput / Output

Display

Audio

10


Power Suppl

y

12 V 12 V

Touch Sensing

Touch Utilization

Environmental Sensors

Power 120 V AC

Touch

Display

Audio

TouchData

LegendInput / OutputPowerData

11


Power Suppl

y

120V AC

Power 120 V AC

Display

Audio

Touch

Projector

Application

Framework

Image Processing System

ImagingSystem

Acrylic Surface

IR LEDS

Touch Sensing

Touch Utilization

Environmental Sensors

12 V

LegendInput / OutputPowerData

12 V

12

ENVIRONMENTAL SENSORS

SYSTEM OVERVIEWJARED YENZER

Presenter: Jared YenzerCapstone Senior Design 2012

COMIT TouchSystems

13

ENVIRONMENTAL SENSORS


COMIT TouchSystems

Proximity Sensor

3.3 V

Imag

ing

Syst

em

LED STRIPS

R in I/O

Analog Output

TemperatureSensor

5 V

AnalogOutput

CAT5114Potentiometer

CAT32LED DRIVER

14

PROXIMITY SENSOR

GP2Y0A21YK SPECIFICATIONS

• Infrared Analog Sensor

• 25 Hz Sampling Rate

• 5V Supply

• Detecting Distance• 10 to 80 cm


COMIT TouchSystems

15

TEMPERATURE SENSOR

TMP36 SPECIFICATIONS

• Analog Sensor

• 5V Supply

• ± 2º Celsius Accuracy

• -40º C to +125º C Range


COMIT TouchSystems

16

IMAGING SYSTEM OVERVIEW

JARED YENZER


COMIT TouchSystems

17

IMAGING SYSTEM


COMIT TouchSystems

TCM8230Camera

ATXMEGA16D4μController

3.3 V

20 MHz CLK

8 Lines Parallel Camera Data2.8 V 1.5 V

I2C BUS

I/Os to Potentiometer D

ata

Proc

essi

ng

Syst

em

Proximity Sensor & Temp Data

Envi

ronm

enta

l Se

nsor

s Sy

stem

18

MICROCONTROLLER

ATXMEGA16D4 INPUTS/OUTPUTS• I2C BUS• Program Camera Reg.• Image Size• Color Options• Shutter Speed

• I/O Pin for LED Circuit• Control Potentiometer

• 12-Bit ADC• Proximity Sensor• Temperature Sensor


COMIT TouchSystems

19

CAMERA

TCM8230 Inputs/Outputs• Parallel Data Out• D0 – D7

• I2C Bus• Control Registers

• 30 FPS• YUV Format (3 Bytes)• Luminance (Y)• Chrominance (UV)

• Sub-QCIF (128px x 96px)


COMIT TouchSystems

20

PROGRAMMER

AVRISP MKII SPECIFICATIONS• Program AVR• PDI 6 pin Interface


COMIT TouchSystems

21

TESTING RESULTS

TEST BOARD SOFTWARE• Test Major

Components• Microcontroller √• Camera• Voltage Regulators √ • Proximity Sensors

• Drivers for MCU √


COMIT TouchSystems

22

IMAGE PROCESSING SYSTEM OVERVIEW

JUSTIN BARTH


COMIT TouchSystems

FPGA IMAGE PROCESSING SYSTEM


COMIT TouchSystems

Imag

ing

Syst

em

Alte

ra D

E0

Rasp

berr

y Pi8 Line Parallel Camera Data

Horizontal EndFrame End

Camera Clock Touch Coordinatesin TUIO FormatAvailable Input

5v USB

GPIO

RS-2

32

23

20MHz Clock

24

FPGA

Altera DE0 INPUTS/OUTPUTS


COMIT TouchSystems

• 72 GPIO pins

• RS-232 Serial Out• 115,200 baud

• 50MHz

25

RS-232 TO USB ADAPTER

RS-232 to USB Adapter INPUTS/OUTPUTS


COMIT TouchSystems

• RS-232 on FPGA

• USB on Raspberry Pi

26

FPGA DATA SENT OVER RS-232


COMIT TouchSystems

BLOB DETECTION ALGORITHM


COMIT TouchSystems

For each luminance pixel in frame if pixel ≥ brightness threshold for neighbor in pixel neighbors if neighbor is part of a blob pixel is incorporated into that blob if pixel not assigned a blob pixel assigned to new blob compare location of new pixel with blob parameters determine left, right, top, bottom most points of blob

Draw boxes around each blobUse center point of boxes to determine touch coordinates to send out

27

28

BLOB DETECTION ALGORITHM IN MATLAB


COMIT TouchSystems

Basic image of IR touch blobs Image after processed through Matlab algorithm

29

APPLICATION FRAMEWORKOVERVIEW

NATE TURLEY


COMIT TouchSystems

30

FUNCTIONAL DECOMPOSITION

5 V

Proj

ecto

r

Raspberry Pi

Imag

e Pr

oces

sing

Sy

stem

TUIO Spec via COM port

HDMI

31

RASBERRY PI BOARD

SPECIFICATIONS• 700 MHz ARM11• Overclocking

• Broadcom VideoCore IV• OpenGL ES 2.0

• USBx2 via integrated Hub• HDMI Video Output• 5v, 700mA, 3.5 W• OS: Raspbian


COMIT TouchSystems

Broadcom BCM2835 SoC

32

SOFTWAREOpenFrameworks• Open source c++ toolkit• Game engine architecture• Setup()• Update()• Draw()

• Built in event listener• Custom Event Args• Callbacks

• OpenGL ES 2.0• Standard for embedded accelerated graphics• Hardware floating point support


COMIT TouchSystems

33


COMIT TouchSystems

UML CLASS DIAGRAMCRITICAL SOFTWARE COMPONENTS

34

APPLICATION FLOW CHART


COMIT TouchSystems

35

PROJECTOR

ViewSonic PDJ5351 SPECIFICATIONS


COMIT TouchSystems

• 23’’ Throw Distance

• 2500 Lumens

• 3000:1 Contrast Ratio

• $420

36

STRUCTURALSYSTEM OVERVIEW

NATHAN GLAB

Presenter: Nate GlabCapstone Senior Design 2012

COMIT TouchSystems

37

TABLE STRUCTURE


COMIT TouchSystems

38

TABLE STRUCTURE


COMIT TouchSystems

39

INSIDE TABLE STRUCTURE


COMIT TouchSystems

40

BUDGET OVERVIEWJENNIFER COFER


COMIT TouchSystems

41

BUDGETItem Company Unit Price Quantity Total CostProjector $420 1 $420IR LED Reel Environment

alLights.com$215 - $21.50 (estimated)

1, length 5m

$193 (estimated)

Rear Projection Sheet (diffuser)

Acrylite $152.57 - $15.26

1, 40x25in $137.31

Endlighten T Acrylic (Polished)

Acrylite $219.34 - $21.93

1, 40x25in $197.41

Plexiglas Overlay

Home Depot $109 1, 40x25 $109


COMIT TouchSystems

42

BUDGETItem Company Unit Price Quantit

yTotal Cost

Proximity Sensing Board Final

Advanced Circuits

$33 1 $33

AVRISP Microcontroller

Atmel $56.64 1 $56.64

Proximity LEDs Sparkfun $1.35 48 $64.80CMOS Camera Sparkfun $9.95 2 $19.90Potentiometer Mouser $3.04 2 $6.08LED Driver Mouser $2.48 2 $4.96IR LED track materials

$50 $50


COMIT TouchSystems

43

BUDGETItem Company Unit Price Quantity Total CostSound System

Provided 1 1 N/A

Structural Materials

Home Depot $150

Proximity Sensing Board Draft

Advanced Circuits

$33 1 $33

Total $1,481.18


COMIT TouchSystems

44

ECONOMIC ASPECTS

• Marketability of system: • Could decrease teachers needed (esp. special education)• Could supplement homeschooling • Could extend past an educational environment• Cost expected to decrease in mass production


COMIT TouchSystems

45

RISKS & IMPACTSOVERVIEWJENNIFER COFER


COMIT TouchSystems

46

ENVIRONMENTAL IMPACTS• Acrylite is Green and LEEDs certified • “We are committed to minimizing our environmental impact.

Operating under the Guiding Principles of Responsible Care®, we strive to continuously improve our health, safety, and environmental performances. Our goal is to improve the environment by supplying sustainable and long-living acrylic products to the green building sector and to all other markets we serve.”

• Environmental Lights has A New Angle on Green• “At EnvironmentalLights.com we believe in sustainable lighting

solutions that are energy-efficient and long-lasting, which lowers energy use and minimizes the environmental impacts from manufacturing and waste.”


COMIT TouchSystems

http://www.acrylite.net/product/acrylite/en/about/green-statement/pages/default.aspx

http://www.environmentallights.com/green

47

RISK MITIGATION & SAFETY

• Temperature• Fans• Ventilation• Overall heat sensor (in LED circuit)• Temperature sensor on camera board / projector unit

• Dust• Fans • Devices accessible for cleaning

• Followed Component Specifications (linked below)• Acrylic here• IR LEDs here

• Followed UL Guidelines (linked here)Presenter: Jenny Cofer

Capstone Senior Design 2012COMIT TouchSystems

http://www.acrylite.net/sites/dc/Downloadcenter/Evonik/Product/ACRYLITE/3735-endlightent-technical-brochure.pdf

http://www.environmentallights.com/files/documents/ir_light_hazard.pdf

http://www.ul.com/global/eng/pages/

48

SOCIETAL IMPACT

• Defying educational conventions• “Spoon feeding in the long run teaches us

nothing but the shape of the spoon” ~ E. M. Forster

• Providing the alternative• “It is the supreme art of the teacher to awaken

joy in creative expression and knowledge.~ Albert Einstein


COMIT TouchSystems

49

SCHEDULE OVERVIEW

NATHAN GLAB


COMIT TouchSystems

SCHEDULE

50

SCHEDULEDate Description Deliverable

Sept. 25/27 Milestone 1Oct. 16/18 PDR

Oct. 23/25 Functional Decomposition

Nov. 13/15 Milestone 2

Dec. 4/6 CDR

Jan. 15/17 Milestone 3 Materials Ordered Have the Structure Assembled Application Framework complete Camera Driver set up Matlab blob detection optimized

Apr. 16/18 Milestone 4 FPGA Implementation Camera to FPGA integration FPGA to CPU integration Environmental Sensor Implementation Software Application Implementation

Apr. 23/25 Expo Completed table with custom software running

51


COMIT TouchSystems

52

QUESTIONS?


COMIT TouchSystems

comit

Documents

comit touchsystems8level

comit touchsystems5we

music presenter

emotional elements

great teacher

good teacher

superior teacher

primary foci