Magnetoencephalogram-based brain–computer interface for hand-gesture decoding using deep learning
Cerebral Cortex · 2023
DOI: 10.1093/cercor/bhad173 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cerebral Cortex, 2023. Verfasst von Yifeng Bu und 16 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093, USA. Hauptthemen laut MEDLINE: Brain-Computer Interfaces, Deep Learning. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 70 Literaturangaben. Gefördert von: Congressionally Directed Medical Research Programs/Department of Defense, Naval Medical Research Center's Advanced Medical Development program, US Department of Veterans Affairs.
Abstract (Originalsprache)
Advancements in deep learning algorithms over the past decade have led to extensive developments in brain–computer interfaces (BCI). A promising imaging modality for BCI is magnetoencephalography (MEG), which is a non-invasive functional imaging technique. The present study developed a MEG sensor-based BCI neural network to decode Rock-Paper-scissors gestures (MEG-RPSnet). Unique preprocessing pipelines in tandem with convolutional neural network deep-learning models accurately classified gestures. On a single-trial basis, we found an average of 85.56% classification accuracy in 12 subjects. Our MEG-RPSnet model outperformed two state-of-the-art neural network architectures for electroencephalogram-based BCI as well as a traditional machine learning method, and demonstrated equivalent and/or better performance than machine learning methods that have employed invasive, electrocorticography-based BCI using the same task. In addition, MEG-RPSnet classification performance using an intra-subject approach outperformed a model that used a cross-subject approach. Remarkably, we also found that when using only central-parietal-occipital regional sensors or occipitotemporal regional sensors, the deep learning model achieved classification performances that were similar to the whole-brain sensor model. The MEG-RSPnet model also distinguished neuronal features of individual hand gestures with very good accuracy. Altogether, these results show that noninvasive MEG-based BCI applications hold promise for future BCI developments in hand-gesture decoding.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093, USA.
- Radiology, Research Services, VA, San Diego Healthcare System, San Diego, CA 92161, USA.
- Department of Radiology, University of California San Diego, La Jolla, CA 92093, USA.
- Department of Neurosciences, University of California San Diego, La Jolla, CA 92093, USA.
- VA Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA 92161, USA.
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093, USA.
Förderung
- Congressionally Directed Medical Research Programs/Department of Defense
- Naval Medical Research Center's Advanced Medical Development program
- US Department of Veterans Affairs
Zitieren
APA
Bu, Y., Harrington, D. L., Lee, R. R., Shen, Q., Angeles-Quinto, A., Ji, Z., Hansen, H., Hernandez-Lucas, J., Baumgartner, J., Song, T., Nichols, S., Baker, D., Rao, R., Lerman, I., Lin, T., Tu, X. M., & Huang, M. (2023). Magnetoencephalogram-based brain–computer interface for hand-gesture decoding using deep learning. Cerebral Cortex. https://doi.org/10.1093/cercor/bhad173
Vancouver
Bu Y, Harrington DL, Lee RR, Shen Q, Angeles-Quinto A, Ji Z, et al. Magnetoencephalogram-based brain–computer interface for hand-gesture decoding using deep learning. Cerebral Cortex. 2023. doi:10.1093/cercor/bhad173
BibTeX
@article{Bu2023,
author = {Bu, Yifeng and Harrington, Deborah L and Lee, Roland R and Shen, Qian and Angeles-Quinto, Annemarie and Ji, Zhengwei and Hansen, Hayden and Hernandez-Lucas, Jaqueline and Baumgartner, Jared and Song, Tao and Nichols, Sharon and Baker, Dewleen and Rao, Ramesh and Lerman, Imanuel and Lin, Tuo and Tu, Xin Ming and Huang, Mingxiong},
title = {Magnetoencephalogram-based brain–computer interface for hand-gesture decoding using deep learning},
journal = {Cerebral Cortex},
year = {2023},
doi = {10.1093/cercor/bhad173}
}
EUVIMED