Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface
PNAS Nexus · 28.03.2024 · 3 (4)
DOI: 10.1093/pnasnexus/pgae145 ↗Kurz gefasst
Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 30.04.2024. Verfasst von Dylan Forenzo und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIBIB NIH HHS, NCCIH NIH HHS, NINDS NIH HHS.
Abstract (Originalsprache)
Brain–computer interfaces (BCI) using electroencephalography provide a noninvasive method for users to interact with external devices without the need for muscle activation. While noninvasive BCIs have the potential to improve the quality of lives of healthy and motor-impaired individuals, they currently have limited applications due to inconsistent performance and low degrees of freedom. In this study, we use deep learning (DL)-based decoders for online continuous pursuit (CP), a complex BCI task requiring the user to track an object in 2D space. We developed a labeling system to use CP data for supervised learning, trained DL-based decoders based on two architectures, including a newly proposed adaptation of the PointNet architecture, and evaluated the performance over several online sessions. We rigorously evaluated the DL-based decoders in a total of 28 human participants, and found that the DL-based models improved throughout the sessions as more training data became available and significantly outperformed a traditional BCI decoder by the last session. We also performed additional experiments to test an implementation of transfer learning by pretraining models on data from other subjects, and midsession training to reduce intersession variability. The results from these experiments showed that pretraining did not significantly improve performance, but updating the models’ midsession may have some benefit. Overall, these findings support the use of DL-based decoders for improving BCI performance in complex tasks like CP, which can expand the potential applications of BCI devices and help to improve the quality of lives of healthy and motor-impaired individuals.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
ORCID-Profile: Dylan Forenzo, Jenn Shanahan, Bin He
Förderung
- NIBIB NIH HHS
- NCCIH NIH HHS
- NINDS NIH HHS
- NIH
Zitieren
APA
Forenzo, D., Zhu, H., Shanahan, J., Lim, J., & He, B. (2024). Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface. PNAS Nexus, 3(4). https://doi.org/10.1093/pnasnexus/pgae145
Vancouver
Forenzo D, Zhu H, Shanahan J, Lim J, He B. Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface. PNAS Nexus. 2024;3(4). doi:10.1093/pnasnexus/pgae145
BibTeX
@article{Forenzo2024,
author = {Forenzo, Dylan and Zhu, Hao and Shanahan, Jenn and Lim, Jaehyun and He, Bin},
title = {Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface},
journal = {PNAS Nexus},
year = {2024},
volume = {3},
number = {4},
doi = {10.1093/pnasnexus/pgae145}
}
EUVIMED