user friendly demo: low-power capacitive sensing wristband...

1
MOTIVATION SYSTEM OVERVIEW University of Colorado, Boulder Hoang Truong, Phuc Nguyen, Nam Bui, Anh Nguyen, Tam Vu DEMO: Low-power Capacitive Sensing Wristband for Hand Gesture Recognition Capacitive sensing technique enables high sensitivity measurement, low-power requirement and low-cost prototype components. Capacitive sensing technique promises a feasibility for a battery-free hand gesture recognition device. The system is provided to research and developer community as open source HW-SW design. Prototype is easy to replicate. Developers can adopt easily to integrate into their applications. OBJECTIVES & APPROACHS CHALLENGES SYSTEM PERFORMANCE The highly sensitivity of capacitive sensors makes the sensor reading fluctuate over time and be susceptible to noise. The design sensors (i.e. number and arrangement of sensors, distance to users' skin) must be aligned precisely. There is tradeoff between accuracy and power consumption (i.e. higher number of sensors will require more power consumption for ADC input). Continuous and real-time operation is necessary to determine users' current gesture. Fig. 2. System architecture CAPACITIVE SENSING An open capacitor design allows the skin of the user to act as the second plate of each capacitor. Compression of the silicone wristband causes a change in distance from the user’s skin to the sensors and a change in capacitance Capacitance is measured via a comparator-based relaxation oscillator. Fig. 5. Wiring design Fig. 6. Sensor placement design Fig. 9. System performance w.r.t. the number of gestures in the prediction set Fig. 10. Confusion matrix for system performance using training data (left hand and right hand respectively) Fig. 8. Software flow Fig. 1. Final Prototype Low power Unobtrusive Continuous and real-time tracking Support large number of gesture User friendly Enable various application Extendable HW-SW design and user defined gestures Light-weight HW-SW stack Wristband wearable design WEB UI Interface Open source HW-SW design Dedicated ADC design Efficient energy harvesting C sensor Source S 1 S 2 C integrated R bleed Comparator Output to processing MCU 1 2 3 CONTACT US Fig. 3. General capacitive sensing circuit with 3-stage operation and output for relaxation oscillator method Fig. 7. Web UI CAPACITIVE SENSING (CONT.) SENSOR DESIGN SOFTWARE DESIGN Sensor array Flex substrate HUMAN SKIN Silicone housing Fig. 4. Open capacitor - sensor and skin of the user act as dielectric plates Distance changes when hand moves Source Code https:// tinyurl.com/MNSWristband Hoang Truong [email protected]

Upload: others

Post on 02-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: User friendly DEMO: Low-power Capacitive Sensing Wristband ...mnslab.org/nambui/ppts/2017_S3_poster.pdf · change in capacitance • Capacitance is measured via a comparator-based

MOTIVATION SYSTEM OVERVIEW

University of Colorado, Boulder

Hoang Truong, Phuc Nguyen, Nam Bui, Anh Nguyen, Tam Vu

DEMO: Low-power Capacitive Sensing Wristband

for Hand Gesture Recognition

• Capacitive sensing technique enables high sensitivity

measurement, low-power requirement and low-cost

prototype components.

• Capacitive sensing technique promises a feasibility for

a battery-free hand gesture recognition device.

• The system is provided to research and developer

community as open source HW-SW design. Prototype

is easy to replicate.

• Developers can adopt easily to integrate into their

applications.

OBJECTIVES & APPROACHS

CHALLENGES

SYSTEM PERFORMANCE

• The highly sensitivity of capacitive sensors makes the

sensor reading fluctuate over time and be susceptible

to noise.

• The design sensors (i.e. number and arrangement of

sensors, distance to users' skin) must be aligned

precisely.

• There is tradeoff between accuracy and power

consumption (i.e. higher number of sensors will

require more power consumption for ADC input).

• Continuous and real-time operation is necessary to

determine users' current gesture.

Fig. 2. System architecture

CAPACITIVE SENSING

• An open capacitor design allows the skin of the user to

act as the second plate of each capacitor.

• Compression of the silicone wristband causes a change

in distance from the user’s skin to the sensors and a

change in capacitance

• Capacitance is measured via a comparator-based

relaxation oscillator.

Fig. 5. Wiring design Fig. 6. Sensor placement design

Fig. 9. System performance w.r.t. thenumber of gestures in the prediction set

Fig. 10. Confusion matrix for system performance usingtraining data (left hand and right hand respectively)

Fig. 8. Software flow

Fig. 1. Final Prototype

Low power

Unobtrusive

Continuous and

real-time tracking

Support large

number of gesture

User friendly

Enable various

application

Extendable HW-SW design

and user defined gestures

Light-weight HW-SW stack

Wristband wearable design

WEB UI Interface

Open source HW-SW design

Dedicated ADC design

Efficient energy harvesting

Cse

nso

r

Sou

rce

S1 S2

Cin

tegra

ted

Rb

leed Comparator

Output to

processing MCU

1 2 3

CONTACT US

Fig. 3. General capacitive sensing circuit with 3-stageoperation and output for relaxation oscillator method

Fig. 7. Web UI

CAPACITIVE SENSING (CONT.)

SENSOR DESIGN

SOFTWARE DESIGN

Sensor array

Flex substrate

HUMAN SKIN

Silicone housing

Fig. 4. Open capacitor - sensor andskin of the user act as dielectric plates

Distance changes

when hand moves

Source Code – https://tinyurl.com/MNSWristband

Hoang Truong – [email protected]