EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emotion classification with multi‐modal physiological signals using multi‐attention‐based neural network

Chengsheng Zou, Zhen Deng, Bingwei He, Maosong Yan, Jie Wu, Zhaoju Zhu

Cognitive Computation and Systems · 2024-09 · 6 (1-3) · 1-11

DOI: 10.1049/ccs2.12107 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Computation and Systems, online erschienen am 18.06.2024. Verfasst von Chengsheng Zou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Fujian Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The ability to effectively classify human emotion states is critically important for human‐computer or human‐robot interactions. However, emotion classification with physiological signals is still a challenging problem due to the diversity of emotion expression and the characteristic differences in different modal signals. A novel learning‐based network architecture is presented that can exploit four‐modal physiological signals, electrocardiogram, electrodermal activity, electromyography, and blood volume pulse, and make a classification of emotion states. It features two kinds of attention modules, feature‐level, and semantic‐level, which drive the network to focus on the information‐rich features by mimicking the human attention mechanism. The feature‐level attention module encodes the rich information of each physiological signal. While the semantic‐level attention module captures the semantic dependencies among modals. The performance of the designed network is evaluated with the open‐source Wearable Stress and Affect Detection dataset. The developed emotion classification system achieves an accuracy of 83.88%. Results demonstrated that the proposed network could effectively process four‐modal physiological signals and achieve high accuracy of emotion classification.

Förderung

  • Natural Science Foundation of Fujian Province

Zitieren

APA

Zou, C., Deng, Z., He, B., Yan, M., Wu, J., & Zhu, Z. (2024). Emotion classification with multi‐modal physiological signals using multi‐attention‐based neural network. Cognitive Computation and Systems, 6(1-3), 1-11. https://doi.org/10.1049/ccs2.12107

Vancouver

Zou C, Deng Z, He B, Yan M, Wu J, Zhu Z. Emotion classification with multi‐modal physiological signals using multi‐attention‐based neural network. Cognitive Computation and Systems. 2024;6(1-3):1-11. doi:10.1049/ccs2.12107

BibTeX
@article{Zou2024,
  author = {Zou, Chengsheng and Deng, Zhen and He, Bingwei and Yan, Maosong and Wu, Jie and Zhu, Zhaoju},
  title = {Emotion classification with multi‐modal physiological signals using multi‐attention‐based neural network},
  journal = {Cognitive Computation and Systems},
  year = {2024},
  volume = {6},
  number = {1-3},
  pages = {1--11},
  doi = {10.1049/ccs2.12107}
}
Kostenlos starten →