elderly activity recognition and classification for application in assisted living
TRANSCRIPT
![Page 1: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/1.jpg)
Elderly activities recognition and classification for applications in assisted livingMOBILE AND PERVASIVE SYSTEMS – PROF. MARCO AVVENUTIEgidi SaraVillardita Alessio Chernbumroong, Cang, Atkins, Yu
![Page 2: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/2.jpg)
Roadmap● Introduction to the problem
Activity selection
Embedded sensors
Goals● Overview of implementation
Hardware aspects
Software● Experimental results● Discussion of further works
2
![Page 3: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/3.jpg)
Introduction and overview
3
![Page 4: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/4.jpg)
• Rising average life span
• Higher demand in long-term care
• Higher cost for health care and ineffective and insufficient care
• Need for a continuous monitoring of elderly people health
• Foster home-based care
• Elder people independence and enhance living quality
How? Activity recognition applications
Introduction
4
![Page 5: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/5.jpg)
System requirements (Kleinberger 2007)AcceptanceAdaptationUsability
Main approaches:Wearable sensorsCamerasAmbient sensor (on object monitoring)
Small, low cost and non intrusive sensors
Practical assisted living requirements
5
![Page 6: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/6.jpg)
IADLs: Instrumental Activities of Daily Livings
BADLs: Basic Activities of Daily Livings, i.e. necessary for self-care
Activity selection
6
![Page 7: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/7.jpg)
• Inertial sensors (IMU – Inertial measurement unit)
Accelerometer, Gyroscope, Magnetometer
• Altimeter
• Hearth Rate (HR)
• Barometer
• Light
• Temperature
Embedded sensors
7
![Page 8: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/8.jpg)
Two hypotheses:
• Achieve high classification rate
• Combining data from multiple sensors improves recognition accuracy
To the aim of:
• Health care
• Ambient Intelligence
• Abnormal behaviour detection
Goals
8
![Page 9: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/9.jpg)
Overview of implementation
9
![Page 10: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/10.jpg)
Wrist-worn equipment:
- Accelerometer
- Gyroscope
- Magnetometer
- Bio-sensors
Study specific:
- Temperature
- Altimeter eZ430-Chronos watch,
Texas Instruments
Sensors
10
![Page 11: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/11.jpg)
Method design
11
![Page 12: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/12.jpg)
Sensor Data Time-domain Frequency-domain
Acceleration X-axis, Acceleration Y-axis, Acceleration Z-axis,
Acceleration magnitude,Temperature, Altitude
Mean, Min, Max, Standard Deviation, Variance, Range,
Root-Mean-Square, Correlation, Difference,
Main Axis
Spectral energy, spectral entropy,key coefficient
Total number of features 45 18
Features
12
![Page 13: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/13.jpg)
From 63 to 16 features, using feature
combination:
- Clamping to order features by impact
- Forward selection
This method allows weaker features to be
selected
Feature combination
13
![Page 14: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/14.jpg)
Classification accuracy
14
![Page 15: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/15.jpg)
Experimentation and results
15
![Page 16: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/16.jpg)
Data collection carried out to replicate natural living environment
12 participants worn 2 eZ430-Chronos watches
11 activities, 5 min each
19.2h of sensors data collected
Supervised by a researcher
Acceleration data collected using Matlab
Temperature and altitude directly recorded on watches internal memory
Experimental settings
16
![Page 17: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/17.jpg)
High classification rates on: sleeping, sweeping, watching TV, walking and feeding
High misclassification rates on : dressing, ironing, wash dishes, brush teeth
Sensor combination Accuracy (%)
Accelerometer 82.7694
Accelerometer, Temperature 87.5764
Accelerometer, Altimeter 89.3736
Accelerometer, Temperature, Altimeter 90.2250
Results
17
![Page 18: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/18.jpg)
Discussion and further work
18
![Page 19: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/19.jpg)
Imbalanced dataset fixed with under-sampling based on one of the misclassified activities
from 17843 to 7245 patterns
Dataset
12 elderly people for 19h of sensor data
Discussion points
19
No ensemble, using the best classifier: SVM
![Page 20: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/20.jpg)
More patterns (over 30k in the second paper)
Deep learning
Improvements and further work
20
![Page 21: Elderly activity recognition and classification for application in assisted living](https://reader036.vdocument.in/reader036/viewer/2022062310/58f23eca1a28ab8f588b45c9/html5/thumbnails/21.jpg)
Thank you for listening