EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry

Justin Gilmore, Mona Nasseri iD

Sensors · 09.05.2024 · 24 (10) · 3005

DOI: 10.3390/s24103005 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 09.05.2024. Verfasst von Justin Gilmore und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA. Hauptthemen laut MEDLINE: Photoplethysmography, Accelerometry, Algorithms, Machine Learning. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of North Florida.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Inertial signals are the most widely used signals in human activity recognition (HAR) applications, and extensive research has been performed on developing HAR classifiers using accelerometer and gyroscope data. This study aimed to investigate the potential enhancement of HAR models through the fusion of biological signals with inertial signals. The classification of eight common low-, medium-, and high-intensity activities was assessed using machine learning (ML) algorithms, trained on accelerometer (ACC), blood volume pulse (BVP), and electrodermal activity (EDA) data obtained from a wrist-worn sensor. Two types of ML algorithms were employed: a random forest (RF) trained on features; and a pre-trained deep learning (DL) network (ResNet-18) trained on spectrogram images. Evaluation was conducted on both individual activities and more generalized activity groups, based on similar intensity. Results indicated that RF classifiers outperformed corresponding DL classifiers at both individual and grouped levels. However, the fusion of EDA and BVP signals with ACC data improved DL classifier performance compared to a baseline DL model with ACC-only data. The best performance was achieved by a classifier trained on a combination of ACC, EDA, and BVP images, yielding F1-scores of 69 and 87 for individual and grouped activity classifications, respectively. For DL models trained with additional biological signals, almost all individual activity classifications showed improvement (p-value < 0.05). In grouped activity classifications, DL model performance was enhanced for low- and medium-intensity activities. Exploring the classification of two specific activities, ascending/descending stairs and cycling, revealed significantly improved results using a DL model trained on combined ACC, BVP, and EDA spectrogram images (p-value < 0.05).

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PhotoplethysmographyAccelerometryAlgorithmsMachine LearningHumansMaleAdultSignal Processing, Computer-AssistedFemaleHuman ActivitiesGalvanic Skin ResponseWearable Electronic DevicesYoung Adult

Stichwörter der Autor:innen

accelerometerblood volume pulse (BVP)convolutional neural network (CNN)electrodermal activity (EDA)human activity recognitionmachine learningmulti-modal classification

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA.
  • School of Engineering, University of North Florida, Jacksonville, FL 32224, USA.

ORCID-Profile: Mona Nasseri

Förderung

  • University of North Florida

Zitieren

APA

Gilmore, J., & Nasseri, M. (2024). Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry. Sensors, 24(10), 3005. https://doi.org/10.3390/s24103005

Vancouver

Gilmore J, Nasseri M. Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry. Sensors. 2024;24(10):3005. doi:10.3390/s24103005

BibTeX
@article{Gilmore2024,
  author = {Gilmore, Justin and Nasseri, Mona},
  title = {Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {10},
  pages = {3005},
  doi = {10.3390/s24103005}
}
Kostenlos starten →