Ambulatory Emotion Monitoring with

Wireless SensorsProgress Presentation - Ryan Carey

14/01/2011

Develop an ambulatory system that could be used to monitor emotions using wireless sensors.

The Bioelectronics cluster at NUI Galway has developed an algorithm that can detect specific cardiac defence responses. For example, the algorithm can detect sudden changes in heart rate during fright or startle situations that might be attributed to fear or anger.

The goal of the project is to use the already developed algorithm and demonstrate the feasibility of ambulatory monitoring of emotions during real-life situations.

Project Overview

System Operation

eZ420-Chronos Development Watch

BM-CS5EU Bmi Chest Strap Laptop/Computer

Wireless BlueRobin

Transmission

Wireless SimpliciTI

Transmssion

Developing/Editing HeartRate Function

GUI Design & Development =>

Graph Emotion State

System ComponentsBM-CS5EU BMi Chest Strap‣Low power heart rate data transmitter. ‣Utilises latest ultra-low power BlueRobin™ data transmission technology.‣Information sent from chest strap to suitable receiver i.e.. Chronos watch.

eZ430-Chronos Development Tool(868MHz)‣Programmable development system.‣Receives heart rate data from chest band.‣Transmits wirelessly to PC using SimpliciTI. (low-power RF protocol)

References: bm-innovations.com, processors.wiki.ti.com

Reprogramming watch display Initial task to familiarise with IAR Embedded

Workbench – platform used to program watch.

Simple on-watch functions modified to blink LEDs or toggle symbols etc.

Heart rate assigned arbitrary value i.e. ±50 BPM added to existing reading.◦ Routine at which heart rate is sampled used here

(discussed later)

Progress to Date

TCL (Tool Command Language) PC display of watch information by Chronos

Control Center, programmed with TCL. TCL is a programming language suitable for

desktop applications such as the GUI used in Control Center.

Time spent learning about and adapting to TCL.

On screen GUI modified with extra tab to receive heart rate information, shown on next slide…

Progress to Date

Heart Rate Pane Screen Shot

Progress to Date

Numerical heart rate value change

Heart rate electro-cardiogram will be used to graph heart rate fluctuation

At present, work ongoing to display average heart rate on PC.

Initial watch functionality only receives heart rate transmission and does not broadcast this to PC.

Suitable manipulation of existing code should allow for PC to also receive heart rate fluctuation in real time.

Code modification to “hack” an already existing routine to achieve desired results…

Current Workings

“Hack” Control Center function already in place

takes accelerometer data from the watch and displays (in real time) x, y and z coordinate values.

Current Workings

Chronos Control Center displaying accelerometer data

“Hack” Using this ability, which graphs changing

integer values from watch, finding routine which displays heart rate change on the watch could be substituted for previous accelerometer data.

Workings slightly tedious – various different functions for heart rate all interlinked and dependant on one another (and vice versa for accelerometer data).

Current Workings

Emotional change linked with heart rate via ANS (Autonomic Nervous System) in the brain.

Changes in emotional state, such as fear or excitement, can produce direct change in heart rate.

Heart rate, however, may only vary over a few heart beats.

Current routine programmed in watch which receives heart rate calculated by averaging a given period of beats – problem...

Current Limitations

Therefore there is a need to obtain data in a ‘raw-beat’ form (i.e.. beat to beat change is monitored).

Routine which calculates heart beat currently inaccessible from authors at BMi.

Without this, heart rate data shown would have to be displayed in a less accurate averaged figure.

Current Limitations

To (hopefully) obtain routine from BMi for beat to beat heart rate data.

Further development of GUI◦ Function to display real-time heart rate fluctuation in

both text and electrocardiogram graphed results. Testing working prototype of project in real-life

emotion eliciting situations i.e. watching horror movie or attending sporting event.

Create standalone application for the project to run on.

Implement functionality for ‘over-the-web’ viewing of the project using Apache Server.

Remaining Work

?

Questions