EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Decoding Handwriting Trajectories from Intracortical Brain Signals for Brain‐to‐Text Communication

Guangxiang Xu, Zebin Wang, Kedi Xu, Junming Zhu, Jianmin Zhang, Yueming Wang, Yaoyao Hao iD

Advanced Science · 2025-10 · 12 (40)

DOI: 10.1002/advs.202505492 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Science, online erschienen am 28.07.2025. Verfasst von Guangxiang Xu und 6 weiteren Autor:innen. Beteiligte Einrichtung: The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, 311121, China. Hauptthemen laut MEDLINE: Brain-Computer Interfaces, Handwriting, Brain. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The potential to decode handwriting trajectories from brain signals has yet to be fully explored in clinical brain‐computer interfaces (BCIs). Here, intracortical neural signals are recorded from a paralyzed individual during attempted handwriting of complex characters. An innovative decoding framework is introduced to address both shape and temporal distortions between neural activity and movement, effectively resolving the misalignment issue commonly encountered in clinical BCIs due to the lack of accurate movement labels. The results demonstrated the reconstruction of highly accurate and human‐recognizable handwriting trajectories, significantly outperforming conventional methods. Furthermore, the new framework enabled effective multi‐day data fusion, leading to additional improvements in trajectory quality. By employing a dynamic time warping approach to translate trajectories into text, a recognition rate up to 91.1% is achieved within a 1000‐character database. Additionally, the framework is applied to reconstruct single‐trial trajectories of English letters using a previously published dataset, achieving similarly high recognition rates. Collectively, these findings present a novel BCI decoding scheme capable of accurately reconstructing handwriting trajectories, demonstrating its applicability to both alphabetic and logographic brain‐to‐text translation. This approach has the potential to revolutionize communication for individuals with motor impairments by enabling accurate brain‐to‐text translation across diverse languages.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Brain-Computer InterfacesHandwritingBrainHumansMaleAdultElectroencephalographyFemale

Stichwörter der Autor:innen

brain‐computer interfacebrain‐to‐texthandwritingshape and time distortiontrajectory fitting

Autor:innen und Institutionen

  • The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, 311121, China.
  • Nanhu Brain-computer Interface Institute, Hangzhou, 311121, China.
  • Department of Biomedical Engineering, Zhejiang University, Hangzhou, 310027, China.
  • Department of Neurosurgery, Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310009, China.
  • College of Computer Science and Technology, Zhejiang University, Hangzhou, 310027, China.

ORCID-Profile: Yaoyao Hao

Zitieren

APA

Xu, G., Wang, Z., Xu, K., Zhu, J., Zhang, J., Wang, Y., & Hao, Y. (2025). Decoding Handwriting Trajectories from Intracortical Brain Signals for Brain‐to‐Text Communication. Advanced Science, 12(40). https://doi.org/10.1002/advs.202505492

Vancouver

Xu G, Wang Z, Xu K, Zhu J, Zhang J, Wang Y, et al. Decoding Handwriting Trajectories from Intracortical Brain Signals for Brain‐to‐Text Communication. Advanced Science. 2025;12(40). doi:10.1002/advs.202505492

BibTeX
@article{Xu2025,
  author = {Xu, Guangxiang and Wang, Zebin and Xu, Kedi and Zhu, Junming and Zhang, Jianmin and Wang, Yueming and Hao, Yaoyao},
  title = {Decoding Handwriting Trajectories from Intracortical Brain Signals for Brain‐to‐Text Communication},
  journal = {Advanced Science},
  year = {2025},
  volume = {12},
  number = {40},
  doi = {10.1002/advs.202505492}
}
Kostenlos starten →