final design report project name: liebner notification system · final design report 26 april 2012...

EEL 4924 Electrical Engineering Design (Senior Design)

Final Design Report

26 April 2012

Project Name: Liebner Notification System

Team Members: Name: Ines M. Radovanovic Name: Juan C. Garcia Project Abstract: Our project consists of a notification system preferably for an office or lab door integrating the functionality of several devices. This system will allow the person inside the office to not only communicate with any persons outside but to serve their needs more appropriately. The Liebner Notification System is composed of a network camera able to stream live video to a host computer, a LCD touch screen to provide the user with an input medium and a microcontroller monitoring the behavior of the system. All of these components will be placed in an efficiently-powered and communication-able circuit board. The host computer will be in charge of performing computational-heavy image processing applications as well as allowing the user to remotely control the state of the overall system.

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Table of Contents:

Project Abstract …………………………………………………………………………............. 1 Introduction ……………………………………………………………………………………... 3 Current Market Solutions ……………………………………………………………………….. 3 Technical Objectives ……………………………………………………………………………. 4 Project Features …………………………………………………………………………………. 4

Face-Detection ………………………………………………………………………….. 5 UART Communication through Ethernet Cable ………………………………………... 5 LCD Interface with SD Card ………………………………………………………......... 6 Touchscreen LCD Display ………………………………………………………………. 7 Host Computer Application with Hardware-Control ……………………………………. 7 Away-Mode Text-Message Service …………………………………………………..… 8 Active and Sleep Power Mode …………………………………………………………... 8

Hardware Implementation ......……….……………………………………………………........ 9 Software Implementation …...…...………...…………………………………………...……..... 10 Distribution of Labor …………………………………………………………………………... 11 Cost Objectives ………………………………………………………………………………… 11 Gantt Chart …………………………………………………………………………………...… 12 Appendix A: Altium Schematics and PCBs ………………………………………………….... 13

Table of Figures:

Figure 1 Video Door Phone Intercom System from ESPOW Priced at $254.99 Figure 2 Swann Video Door Phone sold by Best Buy at $225.99 Figure 3 Liebner Notification System Hardware Diagram Figure 4 Face-Detection Performed in GUI Figure 5 Ethernet CAT5 Cable Figure 6 Splitter Board with MSP430F2272 Figure 7 New Haven Display with 16-bit controller and 4-wire Touch Capabilities Figure 8 Sample Interactive Image Displayed in the LCD Figure 9 Away-Mode LCD Display Figure 10 Hardware FSM Figure 11 Software FSM

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Introduction: The Liebner Notification System could be best placed within the area of communication and access control systems. The system integrates techniques from the realms of image processing, microprocessor design, communications and software engineering in order to create the final embedded application. The project was started in response to Mr. Eric Liebner’s interest on having an integrated notification system to be used in his lab door. One of the goals of the project is to create a robust enough system able to gain the interest of other users and/or distributors. This project has a similar use case to the modern intercom systems found in some professional buildings and apartment complexes. A guest at the lab door will be able to get Mr. Liebner’s attention through a touch-based interface, which will trigger an application in the user’s computer allowing the pertinent course of action. Mr. Liebner will be able to identify his guests through the video feed provided by the embedded network camera. This system deviates from the currently established intercom and access control systems in the fact that the user is able to monitor and control the system’s state from his personal computer. In addition, the embedded application will stay in a low-powered mode until the results of image processing tasks remotely inform the processor that a guest is at the door. Current Market Solutions: Homeowners can find in the market today advanced solutions that do more than the average intercom did in the past. Companies as Espow and Swann provide high-resolution video-streaming intercoms composed of an outdoor camera hardware and an indoor monitor system. Both companies have their video door intercom products in the price range of $200 to $250.

Liebner Notification System differs current market solutions by offering an integrated embedded system to a host computer, signifying the application to be ideal for an office door and not for home monitoring. Furthermore, the system proposed integrates video streaming through Ethernet to neglect the possibility of hacking and maintain a secure video-transmission. In terms of communication, the hardware in the tablet located at the door communicates with the host computer through USB converted into differential pair enabling the unused pairs found in the Cat5 Ethernet cable communication. The efficiency of the Liebner Notification System lies in the usability of all differential pairs found in the Ethernet cable for video streaming, UART communication, and power management.

Figure 2 Video Door Phone Intercom System from ESPOW Priced at

$254.99

Figure 2 Swann Video Door Phone sold by Best Buy at

$225.99

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Technical Objectives: Our project is centered on the following design goals:

• Transmission of a video signal to a host computer in order to perform face detection and for general communication purposes

• Touchscreen-based interface to facilitate user’s input • Power-aware design with two modes: active vs. low-power mode • Embedded hardware design able to communicate via a network to a host computer

In order to reach these goals, we will face the following technical challenges: • Network camera able to stream live video wirelessly or via an Ethernet connection. This

camera feed will be processed in the host computer and it will determine the current power mode of the system

• Microprocessor powerful enough to interface with a touchscreen while communicating with a host computer to determine the appropriate course of action

• Design/implementation of a communication module to communicate via a network to a software application running in the host computer

Project Features: Liebner Notification System integrates a software application, an IP Network camera, a resistive touchscreen LCD display, and a microprocessor to provide a complete and effective embedded system with a useful application. Figure 3 bellow provides a pictorial explanation of how all the equipment is connected.

Figure 3 Liebner Notification System Hardware Diagram

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Face-Detection The face-detection feature on the Liebner Notification System will integrate the capabilities of a camera and a motion sensor. The camera will detect a frontal face and will send a signal to the motherboard to wake up the system. The Face-Detection feature is enabled through software utilizing the OpenCV library. As the system detects a face, the GUI application will turn on in the user’s computer and the hardware tablet located at the office door will begin displaying images in the interactive screen. UART Communication through Ethernet Cable The Host Computer will be connected through USB and Ethernet to the Liebner Notification System. The USB will enable the serial communication while the Ethernet will handle the video processing of the camera. The Cat5 Ethernet Cable shows above is the one used in this project for video streaming, UART communication transmission line and voltage sharing. The Cat5 cable possess four differential pairs where the Ethernet communication enables one two color coded in orange and green, leaving the brown and blue pair unused. These two unused pairs will be populated in the splitter board.

Figure 4 Face-Detection Performed in GUI

Figure 5 Ethernet CAT5 Cable

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System The host computer communicates serially through the USB port with the motherboard in the door tablet going through a splitter board. The splitter board is equipped with an FTDI FT232R responsible for the UART communication directly connected to the host computer, with a differential pair transceiver SN75119P enabling the UART communication with the MSP430F5310 in the motherboard via one unused differential pair, and with the help of a mux and a demux the MSP430F2272 in the splitter board is able to used one UART and communicate with both systems. LCD Interface with SD Card Liebner Notification System will integrate a 5.7” LCD with touch capabilities that will display images fed from an 2GB SD Card on board. The SD Card will receive commands from the MSP430F5310 microprocessor to decide which images to show. The images displayed in the LCD screen will be selected from the drop menu in the “Send Message” tab found in the software application running in the host computer. The default image will be the Liebner Notification System logo displayed at the end of every routine performed and before entering sleep mode.

Figure 6 Splitter Board with MSP430F2272

Figure 7 New Haven Display with 16-bit controller and 4-wire Touch Capabilities

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Touchscreen LCD Display The 5.7” LCD screen will display interactive images that will provide a more user-friendly system. The touch feature provided by the 4-wire on the New Haven Display enables the communication and interaction between the host and the guest at the door. Image as the one shown in Figure 8 demonstrate an example of illustrating a door bell on the screen where the guest can intuitive know what to do next. Furthermore, the touch capabilities are integrated with an audio feedback given by a small piezo on the motherboard to enhance the human interaction.

Host Computer Application with Hardware-Control On the software end, the system will come with an application able to communicate with the boards, handle Main user input and react appropriately to External users actions. The software application will constantly run in the background. The Liebner Notification System application will turn on and appear in the front of the screen in host computer when a face is the detected and a guest has pressed the bell. Once the application is running on the main screen the user can choose from the list of status to appear on the LCD. Depending on the one selected the guest decision will be require to determine the next course of action. For example, the busy status will ask the guest if he or she is willing to wait and the answer will be displayed in the application. Furthermore, the possibility of a text message can be send to the host cell-phone during away mode. This feature will be explained in detail in the next section. As stated previously the application will be running at all times in the background of the host computer allowing the user to manually wake up the system and observe the video captured by the IP Camera. Having the freedom to handle and alternate the current status of the motherboard permits the overall Liebner Notification System to be welcoming for non-technology enthusiast. Away-Mode Text-Message Service The system will also integrate a software-based messaging system that is to be triggered/control either by Main user or External users actions.

Figure 8 Sample Interactive Image Displayed in the LCD

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System

Figure 9 Away-Mode LCD Display

Active and Sleep Power Mode The hardware and software implementation of the Liebner Notification System is handled with the used of timeouts that make the system more power efficient. In terms of the hardware, Timer B located in the door-tablet the MSP430F5310 is used to enable a 10 seconds timeout when no touch or interaction is detected. After this 10 second delay the LCD displays the Liebner Notification System logo and slowly fades out putting the system in sleep-mode.

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Hardware Implementation:

Figure 10 Hardware FSM

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Software Implementation:

Figure 11 Software FSM

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Distribution of Labor:

Cost Objectives:

Tasks Ines Radovanovic(%) Juan C. Garcia(%) Initial Planning and Research 50 50

System Design 50 50 Initial Documents and Reports 50 50

PCB Breakouts Design 60 40 LCD Interface 50 50

SD Card Interface 50 50 Face Detection Software 30 70

USB/UART Interface 50 50 Ethernet Transceivers 70 30

GUI Design and Development 40 60 Text-message Feature 30 70

Analog circuitry for sound/remote bell/LEDS 70 30 Finalize parts requirement 50 50

Final motherboard & auxiliary PCB design 60 40 System Assembly and Debugging 50 50

Final Report/Poster 50 50

Name Manufacturer Cost Number NHD-5.7” TFT with TouchPanel NewHaven Display International $95.00 1

NHD-5.7B-LED Driver NewHaven Display International $10.00 1 2 GB SD Card Sandisk $6.00 1 MSP430F5310 Texas Instruments $4.24 1 MSP430F2272 Texas Instruments $4.59 1

IP7133 Network Camera Vivotek $150.00 1 FT232 UART/USB Bridge FTDI $4.50 1 LTV1117 3.3 V Regulator Texas Instruments $1.00 2

SN75119P Differential Transceiver Texas Instruments $5.74 4 SN74UPT1 2:1 Mux Texas Instruments $0.50 1

SN74LVC1G18 1:2 Demux Texas Instruments $0.50 1 RJ45 Connector - $3.00 3

Type B USB Female Connector - $1.00 1 1734829-3 1.5mm right angle header TE Connectivity $5.00 2

440146-3 1.5mm crimp housing TE Connectivity $5.00 2 0.5mm Pitch 32-Conductor FFC Hirose Electric Co. $2.60 1

PCB Boards with Silkscreen Advanced Circuits $100.00 2 $516.91

University of Florida EEL 4924—Spring 2012 26-Apr-12 Electrical & Computer Engineering /14 Final Report: Liebner Notification System Gantt Chart:


EEL 4924 – Senior Design

PCB – Liebner Notification System

1. Motherboard

PCB Layout

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

Schematic

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

Appendix A: Altium Schematics and PCBs


EEL 4924 – Senior Design

PCB – Liebner Notification System

2. Splitterboard

PCB Layout

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

Schematic

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!