Decoding Imagined Speech from EEG Data: A Hybrid Deep Learning Approach to Capturing Spatial and Temporal Features
Life · 18.11.2024 · 14 (11) · 1501
DOI: 10.3390/life14111501 ↗Kurz gefasst
Fachartikel in der Zeitschrift Life, online erschienen am 18.11.2024. Verfasst von Yasser F Alharbi und 1 weiteren Autor:innen. Beteiligte Einrichtung: Computer Engineering Department, King Saud University, Riyadh 11451, Saudi Arabia. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Saud University, Riyadh, Saudi Arabia.
Abstract (Originalsprache)
Neuroimaging is revolutionizing our ability to investigate the brain’s structural and functional properties, enabling us to visualize brain activity during diverse mental processes and actions. One of the most widely used neuroimaging techniques is electroencephalography (EEG), which records electrical activity from the brain using electrodes positioned on the scalp. EEG signals capture both spatial (brain region) and temporal (time-based) data. While a high temporal resolution is achievable with EEG, spatial resolution is comparatively limited. Consequently, capturing both spatial and temporal information from EEG data to recognize mental activities remains challenging. In this paper, we represent spatial and temporal information obtained from EEG signals by transforming EEG data into sequential topographic brain maps. We then apply hybrid deep learning models to capture the spatiotemporal features of the EEG topographic images and classify imagined English words. The hybrid framework utilizes a sequential combination of three-dimensional convolutional neural networks (3DCNNs) and recurrent neural networks (RNNs). The experimental results reveal the effectiveness of the proposed approach, achieving an average accuracy of 77.8% in identifying imagined English speech.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Computer Engineering Department, King Saud University, Riyadh 11451, Saudi Arabia.
ORCID-Profile: Yousef A Alotaibi
Förderung
- King Saud University, Riyadh, Saudi Arabia
Zitieren
APA
Alharbi, Y. F., & Alotaibi, Y. A. (2024). Decoding Imagined Speech from EEG Data: A Hybrid Deep Learning Approach to Capturing Spatial and Temporal Features. Life, 14(11), 1501. https://doi.org/10.3390/life14111501
Vancouver
Alharbi YF, Alotaibi YA. Decoding Imagined Speech from EEG Data: A Hybrid Deep Learning Approach to Capturing Spatial and Temporal Features. Life. 2024;14(11):1501. doi:10.3390/life14111501
BibTeX
@article{Alharbi2024,
author = {Alharbi, Yasser F and Alotaibi, Yousef A},
title = {Decoding Imagined Speech from EEG Data: A Hybrid Deep Learning Approach to Capturing Spatial and Temporal Features},
journal = {Life},
year = {2024},
volume = {14},
number = {11},
pages = {1501},
doi = {10.3390/life14111501}
}
EUVIMED