EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps

Sara Bagherzadeh, Ahmad Shalbaf, Afshin Shoeibi, Mahboobeh Jafari, Ru-San Tan, U. Rajendra Acharya

IEEE Access · 2024 · 12 · 50949-50965

DOI: 10.1109/access.2024.3384303 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Sara Bagherzadeh und 5 weiteren Autor:innen. Die Arbeit wurde bisher 61-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Shahid Beheshti University of Medical Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The objective of this paper is to develop a novel emotion recognition system from electroencephalogram (EEG) signals using effective connectivity and deep learning methods. Emotion recognition is an important task for various applications such as human-computer interaction and, mental health diagnosis. The paper aims to improve the accuracy and robustness of emotion recognition by combining different effective connectivity (EC) methods and pre-trained convolutional neural networks (CNNs), as well as long short-term memory (LSTM). EC methods measure information flow in the brain during emotional states using EEG signals. We used three EC methods: transfer entropy (TE), partial directed coherence (PDC), and direct directed transfer function (dDTF). We estimated a fused image from these methods for each five-second window of 32-channel EEG signals. Then, we applied six pre-trained CNNs to classify the images into four emotion classes based on the two-dimensional valence-arousal model. We used the leave-one-subject-out cross-validation strategy to evaluate the classification results. We also used an ensemble model to select the best results from the best pre-trained CNNs using the majority voting approach. Moreover, we combined the CNNs with LSTM to improve recognition performance. We achieved the average accuracy and F-score of 98.76%, 98.86%, 98.66 and 98.88% for classifying emotions using DEAP and MAHNOB-HCI datasets, respectively. Our results show that fused images can increase the accuracy and that an ensemble and combination of pre-trained CNNs and LSTM can achieve high accuracy for automated emotion recognition. Our model outperformed other state-of-the-art systems using the same datasets for four-class emotion classification.

Förderung

  • Shahid Beheshti University of Medical Sciences

Zitieren

APA

Bagherzadeh, S., Shalbaf, A., Shoeibi, A., Jafari, M., Tan, R., & Acharya, U. R. (2024). Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps. IEEE Access, 12, 50949-50965. https://doi.org/10.1109/access.2024.3384303

Vancouver

Bagherzadeh S, Shalbaf A, Shoeibi A, Jafari M, Tan R, Acharya UR. Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps. IEEE Access. 2024;12:50949-50965. doi:10.1109/access.2024.3384303

BibTeX
@article{Bagherzadeh2024,
  author = {Bagherzadeh, Sara and Shalbaf, Ahmad and Shoeibi, Afshin and Jafari, Mahboobeh and Tan, Ru-San and Acharya, U. Rajendra},
  title = {Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {50949--50965},
  doi = {10.1109/access.2024.3384303}
}
Kostenlos starten →