EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface

Dylan Forenzo iD, Hao Zhu, Jenn Shanahan iD, Jaehyun Lim, Bin He iD

PNAS Nexus · 28.03.2024 · 3 (4)

DOI: 10.1093/pnasnexus/pgae145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 30.04.2024. Verfasst von Dylan Forenzo und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIBIB NIH HHS, NCCIH NIH HHS, NINDS NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Brain–computer interfaces (BCI) using electroencephalography provide a noninvasive method for users to interact with external devices without the need for muscle activation. While noninvasive BCIs have the potential to improve the quality of lives of healthy and motor-impaired individuals, they currently have limited applications due to inconsistent performance and low degrees of freedom. In this study, we use deep learning (DL)-based decoders for online continuous pursuit (CP), a complex BCI task requiring the user to track an object in 2D space. We developed a labeling system to use CP data for supervised learning, trained DL-based decoders based on two architectures, including a newly proposed adaptation of the PointNet architecture, and evaluated the performance over several online sessions. We rigorously evaluated the DL-based decoders in a total of 28 human participants, and found that the DL-based models improved throughout the sessions as more training data became available and significantly outperformed a traditional BCI decoder by the last session. We also performed additional experiments to test an implementation of transfer learning by pretraining models on data from other subjects, and midsession training to reduce intersession variability. The results from these experiments showed that pretraining did not significantly improve performance, but updating the models’ midsession may have some benefit. Overall, these findings support the use of DL-based decoders for improving BCI performance in complex tasks like CP, which can expand the potential applications of BCI devices and help to improve the quality of lives of healthy and motor-impaired individuals.

Schlagwörter

Stichwörter der Autor:innen

brain–computer interfacecontinuous pursuitdeep learninghuman–machine intelligencemotor imagery

Autor:innen und Institutionen

  • Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.

ORCID-Profile: Dylan Forenzo, Jenn Shanahan, Bin He

Förderung

  • NIBIB NIH HHS
  • NCCIH NIH HHS
  • NINDS NIH HHS
  • NIH

Zitieren

APA

Forenzo, D., Zhu, H., Shanahan, J., Lim, J., & He, B. (2024). Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface. PNAS Nexus, 3(4). https://doi.org/10.1093/pnasnexus/pgae145

Vancouver

Forenzo D, Zhu H, Shanahan J, Lim J, He B. Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface. PNAS Nexus. 2024;3(4). doi:10.1093/pnasnexus/pgae145

BibTeX
@article{Forenzo2024,
  author = {Forenzo, Dylan and Zhu, Hao and Shanahan, Jenn and Lim, Jaehyun and He, Bin},
  title = {Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface},
  journal = {PNAS Nexus},
  year = {2024},
  volume = {3},
  number = {4},
  doi = {10.1093/pnasnexus/pgae145}
}
Kostenlos starten →