EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MB-MSTFNet: A Multi-Band Spatio-Temporal Attention Network for EEG Sensor-Based Emotion Recognition

Cheng Fang iD, Sitong Liu iD, Bing Gao iD

Sensors · 05.08.2025 · 25 (15) · 4819

DOI: 10.3390/s25154819 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 05.08.2025. Verfasst von Cheng Fang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Civil Aviation Thermal Hazards Prevention and Emergency Response, Civil Aviation University of China, Tianjin 300300, China. Hauptthemen laut MEDLINE: Electroencephalography, Emotions, Attention. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Security Capacity Building Project of Civil Aviation Administration of China, the Security Capacity Building Project of Civil Aviation Administration of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion analysis based on electroencephalogram (EEG) sensors is pivotal for human–machine interaction yet faces key challenges in spatio-temporal feature fusion and cross-band and brain-region integration from multi-channel sensor-derived signals. This paper proposes MB-MSTFNet, a novel framework for EEG emotion recognition. The model constructs a 3D tensor to encode band–space–time correlations of sensor data, explicitly modeling frequency-domain dynamics and spatial distributions of EEG sensors across brain regions. A multi-scale CNN-Inception module extracts hierarchical spatial features via diverse convolutional kernels and pooling operations, capturing localized sensor activations and global brain network interactions. Bi-directional GRUs (BiGRUs) model temporal dependencies in sensor time-series, adept at capturing long-range dynamic patterns. Multi-head self-attention highlights critical time windows and brain regions by assigning adaptive weights to relevant sensor channels, suppressing noise from non-contributory electrodes. Experiments on the DEAP dataset, containing multi-channel EEG sensor recordings, show that MB-MSTFNet achieves 96.80 ± 0.92% valence accuracy, 98.02 ± 0.76% arousal accuracy for binary classification tasks, and 92.85 ± 1.45% accuracy for four-class classification. Ablation studies validate that feature fusion, bidirectional temporal modeling, and multi-scale mechanisms significantly enhance performance by improving feature complementarity. This sensor-driven framework advances affective computing by integrating spatio-temporal dynamics and multi-band interactions of EEG sensor signals, enabling efficient real-time emotion recognition.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyEmotionsAttentionHumansBrainNeural Networks, ComputerAlgorithmsSignal Processing, Computer-Assisted

Stichwörter der Autor:innen

Inception modulebidirectional gated recurrent unit (BiGRU)convolutional neural network (CNN)electroencephalograph (EEG)emotion signal recognitionmulti-head attention (MHA)

Autor:innen und Institutionen

  • Key Laboratory of Civil Aviation Thermal Hazards Prevention and Emergency Response, Civil Aviation University of China, Tianjin 300300, China.
  • College of Electronic Information and Automation, Civil Aviation University of China, Tianjin 300300, China.
  • Engineering Techniques Training Center, Civil Aviation University of China, Tianjin 300300, China.

ORCID-Profile: Cheng Fang, Sitong Liu, Bing Gao

Förderung

  • Security Capacity Building Project of Civil Aviation Administration of China
  • the Security Capacity Building Project of Civil Aviation Administration of China

Zitieren

APA

Fang, C., Liu, S., & Gao, B. (2025). MB-MSTFNet: A Multi-Band Spatio-Temporal Attention Network for EEG Sensor-Based Emotion Recognition. Sensors, 25(15), 4819. https://doi.org/10.3390/s25154819

Vancouver

Fang C, Liu S, Gao B. MB-MSTFNet: A Multi-Band Spatio-Temporal Attention Network for EEG Sensor-Based Emotion Recognition. Sensors. 2025;25(15):4819. doi:10.3390/s25154819

BibTeX
@article{Fang2025,
  author = {Fang, Cheng and Liu, Sitong and Gao, Bing},
  title = {MB-MSTFNet: A Multi-Band Spatio-Temporal Attention Network for EEG Sensor-Based Emotion Recognition},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {15},
  pages = {4819},
  doi = {10.3390/s25154819}
}
Kostenlos starten →