Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry
Sensors · 09.05.2024 · 24 (10) · 3005
DOI: 10.3390/s24103005 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 09.05.2024. Verfasst von Justin Gilmore und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA. Hauptthemen laut MEDLINE: Photoplethysmography, Accelerometry, Algorithms, Machine Learning. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of North Florida.
Abstract (Originalsprache)
Inertial signals are the most widely used signals in human activity recognition (HAR) applications, and extensive research has been performed on developing HAR classifiers using accelerometer and gyroscope data. This study aimed to investigate the potential enhancement of HAR models through the fusion of biological signals with inertial signals. The classification of eight common low-, medium-, and high-intensity activities was assessed using machine learning (ML) algorithms, trained on accelerometer (ACC), blood volume pulse (BVP), and electrodermal activity (EDA) data obtained from a wrist-worn sensor. Two types of ML algorithms were employed: a random forest (RF) trained on features; and a pre-trained deep learning (DL) network (ResNet-18) trained on spectrogram images. Evaluation was conducted on both individual activities and more generalized activity groups, based on similar intensity. Results indicated that RF classifiers outperformed corresponding DL classifiers at both individual and grouped levels. However, the fusion of EDA and BVP signals with ACC data improved DL classifier performance compared to a baseline DL model with ACC-only data. The best performance was achieved by a classifier trained on a combination of ACC, EDA, and BVP images, yielding F1-scores of 69 and 87 for individual and grouped activity classifications, respectively. For DL models trained with additional biological signals, almost all individual activity classifications showed improvement (p-value < 0.05). In grouped activity classifications, DL model performance was enhanced for low- and medium-intensity activities. Exploring the classification of two specific activities, ascending/descending stairs and cycling, revealed significantly improved results using a DL model trained on combined ACC, BVP, and EDA spectrogram images (p-value < 0.05).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA.
- School of Engineering, University of North Florida, Jacksonville, FL 32224, USA.
ORCID-Profile: Mona Nasseri
Förderung
- University of North Florida
Zitieren
APA
Gilmore, J., & Nasseri, M. (2024). Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry. Sensors, 24(10), 3005. https://doi.org/10.3390/s24103005
Vancouver
Gilmore J, Nasseri M. Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry. Sensors. 2024;24(10):3005. doi:10.3390/s24103005
BibTeX
@article{Gilmore2024,
author = {Gilmore, Justin and Nasseri, Mona},
title = {Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry},
journal = {Sensors},
year = {2024},
volume = {24},
number = {10},
pages = {3005},
doi = {10.3390/s24103005}
}
EUVIMED