EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emotion recognition with multi-modal peripheral physiological signals

Jennifer Gohumpu, Mengru Xue, Yanchi Bao

Frontiers in Computer Science · 05.12.2023 · 5

DOI: 10.3389/fcomp.2023.1264713 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 05.12.2023. Verfasst von Jennifer Gohumpu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Healthcare wearables allow researchers to develop various system approaches that recognize and understand the human emotional experience. Previous research has indicated that machine learning classifiers, such as Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Decision Tree (DT), can improve the accuracy of physiological signal analysis and emotion recognition. However, various emotions can have distinct effects on physiological signal alterations. Therefore, solely relying on a single type of physiological signal analysis is insufficient for accurately recognizing and understanding human emotional experiences.

Methods

Research on multi-modal emotion recognition systems (ERS) has commonly gathered physiological signals using expensive devices, which required participants to remain in fixed positions in the lab setting. This limitation restricts the potential for generalizing the ERS technology for peripheral use in daily life. Therefore, considering the convenience of data collection from everyday devices, we propose a multi-modal physiological signals-based ERS based on peripheral signals, utilizing the DEAP database. The physiological signals selected for analysis include photoplethysmography (PPG), galvanic skin response (GSR), and skin temperature (SKT). Signal features were extracted using the “Toolbox for Emotional Feature Extraction from Physiological Signals” (TEAP) library and further analyzed with three classifiers: SVM, KNN, and DT.

Results

The results showed improved accuracy in the proposed system compared to a single-modal ERS application, which also outperformed current DEAP multi-modal ERS applications.

Discussion

This study sheds light on the potential of combining multi-modal peripheral physiological signals in ERS for ubiquitous applications in daily life, conveniently captured using smart devices.

Zitieren

APA

Gohumpu, J., Xue, M., & Bao, Y. (2023). Emotion recognition with multi-modal peripheral physiological signals. Frontiers in Computer Science, 5. https://doi.org/10.3389/fcomp.2023.1264713

Vancouver

Gohumpu J, Xue M, Bao Y. Emotion recognition with multi-modal peripheral physiological signals. Frontiers in Computer Science. 2023;5. doi:10.3389/fcomp.2023.1264713

BibTeX
@article{Gohumpu2023,
  author = {Gohumpu, Jennifer and Xue, Mengru and Bao, Yanchi},
  title = {Emotion recognition with multi-modal peripheral physiological signals},
  journal = {Frontiers in Computer Science},
  year = {2023},
  volume = {5},
  doi = {10.3389/fcomp.2023.1264713}
}
Kostenlos starten →