EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emotion Recognition from Spatio-Temporal Representation of EEG Signals via 3D-CNN with Ensemble Learning Techniques

Rajamanickam Yuvaraj, Arapan Baranwal, A Amalin Prince iD, M Murugappan iD, Javeed Shaikh Mohammed iD

Brain Sciences · 19.04.2023 · 13 (4) · 685

DOI: 10.3390/brainsci13040685 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Brain Sciences, online erschienen am 19.04.2023. Verfasst von Rajamanickam Yuvaraj und 4 weiteren Autor:innen. Beteiligte Einrichtung: National Institute of Education, Nanyang Technological University, Singapore 637616, Singapore. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The recognition of emotions is one of the most challenging issues in human–computer interaction (HCI). EEG signals are widely adopted as a method for recognizing emotions because of their ease of acquisition, mobility, and convenience. Deep neural networks (DNN) have provided excellent results in emotion recognition studies. Most studies, however, use other methods to extract handcrafted features, such as Pearson correlation coefficient (PCC), Principal Component Analysis, Higuchi Fractal Dimension (HFD), etc., even though DNN is capable of generating meaningful features. Furthermore, most earlier studies largely ignored spatial information between the different channels, focusing mainly on time domain and frequency domain representations. This study utilizes a pre-trained 3D-CNN MobileNet model with transfer learning on the spatio-temporal representation of EEG signals to extract features for emotion recognition. In addition to fully connected layers, hybrid models were explored using other decision layers such as multilayer perceptron (MLP), k-nearest neighbor (KNN), extreme learning machine (ELM), XGBoost (XGB), random forest (RF), and support vector machine (SVM). Additionally, this study investigates the effects of post-processing or filtering output labels. Extensive experiments were conducted on the SJTU Emotion EEG Dataset (SEED) (three classes) and SEED-IV (four classes) datasets, and the results obtained were comparable to the state-of-the-art. Based on the conventional 3D-CNN with ELM classifier, SEED and SEED-IV datasets showed a maximum accuracy of 89.18% and 81.60%, respectively. Post-filtering improved the emotional classification performance in the hybrid 3D-CNN with ELM model for SEED and SEED-IV datasets to 90.85% and 83.71%, respectively. Accordingly, spatial-temporal features extracted from the EEG, along with ensemble classifiers, were found to be the most effective in recognizing emotions compared to state-of-the-art methods.

Schlagwörter

Stichwörter der Autor:innen

3D-CNNdeep neural networksemotion recognitionhybrid modelsmachine learning classifiers

Autor:innen und Institutionen

  • National Institute of Education, Nanyang Technological University, Singapore 637616, Singapore.
  • Department of Computer Science and Information Systems, BITS Pilani, Sancoale 403726, Goa, India.
  • Department of Electrical and Electronics Engineering, BITS Pilani, Sancoale 403726, Goa, India.
  • Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Block 4, Doha 13133, Kuwait.
  • Department of Electronics and Communication Engineering, Faculty of Engineering, Vels Institute of Sciences, Technology, and Advanced Studies, Chennai 600117, Tamilnadu, India.
  • Centre for Excellence in Unmanned Aerial Systems (CoEUAS), Universiti Malaysia Perlis, Kangar 02600, Perlis, Malaysia.

ORCID-Profile: A Amalin Prince, M Murugappan, Javeed Shaikh Mohammed

Zitieren

APA

Yuvaraj, R., Baranwal, A., Prince, A. A., Murugappan, M., & Mohammed, J. S. (2023). Emotion Recognition from Spatio-Temporal Representation of EEG Signals via 3D-CNN with Ensemble Learning Techniques. Brain Sciences, 13(4), 685. https://doi.org/10.3390/brainsci13040685

Vancouver

Yuvaraj R, Baranwal A, Prince AA, Murugappan M, Mohammed JS. Emotion Recognition from Spatio-Temporal Representation of EEG Signals via 3D-CNN with Ensemble Learning Techniques. Brain Sciences. 2023;13(4):685. doi:10.3390/brainsci13040685

BibTeX
@article{Yuvaraj2023,
  author = {Yuvaraj, Rajamanickam and Baranwal, Arapan and Prince, A Amalin and Murugappan, M and Mohammed, Javeed Shaikh},
  title = {Emotion Recognition from Spatio-Temporal Representation of EEG Signals via 3D-CNN with Ensemble Learning Techniques},
  journal = {Brain Sciences},
  year = {2023},
  volume = {13},
  number = {4},
  pages = {685},
  doi = {10.3390/brainsci13040685}
}
Kostenlos starten →