EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MSDSANet: Multimodal Emotion Recognition Based on Multi-Stream Network and Dual-Scale Attention Network Feature Representation

Weitong Sun iD, Xingya Yan, Yuping Su iD, Gaihua Wang, Yumei Zhang iD

Sensors · 24.03.2025 · 25 (7) · 2029

DOI: 10.3390/s25072029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 24.03.2025. Verfasst von Weitong Sun und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Digital Art, Xi'an University of Posts & Telecommunications, Xi'an 710061, China. Hauptthemen laut MEDLINE: Emotions, Electroencephalography, Attention. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Key Science and Technology Innovation Team Project of Shaanxi Province, Xi'an Science and Technology Program, Shaanxi Provincial Science and Technology Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aiming at the shortcomings of EEG emotion recognition models in feature representation granularity and spatiotemporal dependence modeling, a multimodal emotion recognition model integrating multi-scale feature representation and attention mechanism is proposed. The model consists of a feature extraction module, feature fusion module, and classification module. The feature extraction module includes a multi-stream network module for extracting shallow EEG features and a dual-scale attention module for extracting shallow EOG features. The multi-scale and multi-granularity feature fusion improves the richness and discriminability of multimodal feature representation. Experimental results on two datasets show that the proposed model outperforms the existing model.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsElectroencephalographyAttentionHumansNeural Networks, ComputerAlgorithms

Stichwörter der Autor:innen

attentionemotion recognitionmulti-scalemultimodal

Autor:innen und Institutionen

  • School of Digital Art, Xi'an University of Posts & Telecommunications, Xi'an 710061, China.
  • Key Laboratory of Intelligent Media in Shaanxi Province Colleges and Universities, Xi'an 710061, China.
  • Key Laboratory of Intelligent Computing and Service Technology for Folk Song, Ministry of Culture and Tourism, Xi'an 710062, China.
  • School of Computer Science, Shaanxi Normal University, Xi'an 710062, China.

ORCID-Profile: Weitong Sun, Yuping Su, Yumei Zhang

Förderung

  • the Key Science and Technology Innovation Team Project of Shaanxi Province
  • Xi'an Science and Technology Program
  • Shaanxi Provincial Science and Technology Program
  • Central University Basic Research Fund
  • the National Natural Science Foundation of China
  • National Social Science Foundation
  • Key Science and Technology Innovation Team Project of Shaanxi Province
  • Project of Shaanxi Provincial Department of Education

Zitieren

APA

Sun, W., Yan, X., Su, Y., Wang, G., & Zhang, Y. (2025). MSDSANet: Multimodal Emotion Recognition Based on Multi-Stream Network and Dual-Scale Attention Network Feature Representation. Sensors, 25(7), 2029. https://doi.org/10.3390/s25072029

Vancouver

Sun W, Yan X, Su Y, Wang G, Zhang Y. MSDSANet: Multimodal Emotion Recognition Based on Multi-Stream Network and Dual-Scale Attention Network Feature Representation. Sensors. 2025;25(7):2029. doi:10.3390/s25072029

BibTeX
@article{Sun2025,
  author = {Sun, Weitong and Yan, Xingya and Su, Yuping and Wang, Gaihua and Zhang, Yumei},
  title = {MSDSANet: Multimodal Emotion Recognition Based on Multi-Stream Network and Dual-Scale Attention Network Feature Representation},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {7},
  pages = {2029},
  doi = {10.3390/s25072029}
}
Kostenlos starten →