EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Spatio-Temporal Capsule Neural Network with Self-Correlation Routing for EEG Decoding of Semantic Concepts of Imagination and Perception Tasks

Jianxi Huang, Yinghui Chang, Wenyu Li, Jigang Tong, Shengzhi Du iD

Sensors · 2024

DOI: 10.3390/s24185988 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Jianxi Huang und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China. Hauptthemen laut MEDLINE: Electroencephalography, Neural Networks, Computer, Imagination, Semantics. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shengzhi Du, Yinghui Chang, Jigang Tong.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Decoding semantic concepts for imagination and perception tasks (SCIP) is important for rehabilitation medicine as well as cognitive neuroscience. Electroencephalogram (EEG) is commonly used in the relevant fields, because it is a low-cost noninvasive technique with high temporal resolution. However, as EEG signals contain a high noise level resulting in a low signal-to-noise ratio, it makes decoding EEG-based semantic concepts for imagination and perception tasks (SCIP-EEG) challenging. Currently, neural network algorithms such as CNN, RNN, and LSTM have almost reached their limits in EEG signal decoding due to their own short-comings. The emergence of transformer methods has improved the classification performance of neural networks for EEG signals. However, the transformer model has a large parameter set and high complexity, which is not conducive to the application of BCI. EEG signals have high spatial correlation. The relationship between signals from different electrodes is more complex. Capsule neural networks can effectively model the spatial relationship between electrodes through vector representation and a dynamic routing mechanism. Therefore, it achieves more accurate feature extraction and classification. This paper proposes a spatio-temporal capsule network with a self-correlation routing mechaninsm for the classification of semantic conceptual EEG signals. By improving the feature extraction and routing mechanism, the model is able to more effectively capture the highly variable spatio-temporal features from EEG signals and establish connections between capsules, thereby enhancing classification accuracy and model efficiency. The performance of the proposed model was validated using the publicly accessible semantic concept dataset for imagined and perceived tasks from Bath University. Our model achieved average accuracies of 94.9%, 93.3%, and 78.4% in the three sensory modalities (pictorial, orthographic, and audio), respectively. The overall average accuracy across the three sensory modalities is 88.9%. Compared to existing advanced algorithms, the proposed model achieved state-of-the-art performance, significantly improving classification accuracy. Additionally, the proposed model is more stable and efficient, making it a better decoding solution for SCIP-EEG decoding.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyNeural Networks, ComputerImaginationSemanticsBrain-Computer InterfacesAlgorithmsHumansPerceptionSignal Processing, Computer-Assisted

Stichwörter der Autor:innen

EEG decodingbrain-computer interface (BCI)capsule neural networkself-correlation routingsemantic concepts

Autor:innen und Institutionen

  • School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China.
  • First Teaching Hospital of Tianjin University of Traditional Chinese Medicine, Tianjin 300193, China.
  • National Clinical Research Center for Chinese Medicine Acupuncture and Moxibustion, Tianjin 300381, China.
  • College of Artificial Intelligence, Nankai University, Tianjin 300350, China.
  • Department of Electrical Engineering, Tshwane University of Technology, Pretoria 0001, South Africa.

ORCID-Profile: Shengzhi Du

Förderung

  • Shengzhi Du
  • Yinghui Chang
  • Jigang Tong
  • Wenyu Li
  • National Science and Technolo-gy Council (NSTC), Taiwan R.O.C
  • Satellite Communications and AIoT Research Center/The Co-operation Platform of the Industry-Academia Innovation School, National Yang Ming Chiao Tung Universit…
  • Open Project of National Clinical Research Center for Chinese Medicine Acupuncture and Moxibustion
  • Science & Technology Development Fund of Tianjin Education Commission for Higher Education

Zitieren

APA

Huang, J., Chang, Y., Li, W., Tong, J., & Du, S. (2024). A Spatio-Temporal Capsule Neural Network with Self-Correlation Routing for EEG Decoding of Semantic Concepts of Imagination and Perception Tasks. Sensors. https://doi.org/10.3390/s24185988

Vancouver

Huang J, Chang Y, Li W, Tong J, Du S. A Spatio-Temporal Capsule Neural Network with Self-Correlation Routing for EEG Decoding of Semantic Concepts of Imagination and Perception Tasks. Sensors. 2024. doi:10.3390/s24185988

BibTeX
@article{Huang2024,
  author = {Huang, Jianxi and Chang, Yinghui and Li, Wenyu and Tong, Jigang and Du, Shengzhi},
  title = {A Spatio-Temporal Capsule Neural Network with Self-Correlation Routing for EEG Decoding of Semantic Concepts of Imagination and Perception Tasks},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24185988}
}
Kostenlos starten →