EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Representation learning for neural population activity with Neural Data Transformers

Joel Ye, Chethan Pandarinath

Neurons, Behavior, Data analysis, and Theory · 2021

DOI: 10.51628/001c.27358 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neurons, Behavior, Data analysis, and Theory, 2021. Verfasst von Joel Ye und 1 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Neural population activity is theorized to reflect an underlying dynamical structure. This structure can be accurately captured using state space models with explicit dynamics, such as those based on recurrent neural networks (RNNs). However, using recurrence to explicitly model dynamics necessitates sequential processing of data, slowing real-time applications such as brain-computer interfaces. Here we introduce the Neural Data Transformer (NDT), a non-recurrent alternative. We test the NDT’s ability to capture autonomous dynamical systems by applying it to synthetic datasets with known dynamics and data from monkey motor cortex during a reaching task well-modeled by RNNs. The NDT models these datasets as well as state-of-the-art recurrent models. Further, its non-recurrence enables 3.9ms inference, well within the loop time of real-time applications and more than 6 times faster than recurrent baselines on the monkey reaching dataset. These results suggest that an explicit dynamics model is not necessary to model autonomous neural population dynamics. Code: https://github.com/snel-repo/neural-data-transformers

Zitieren

APA

Ye, J., & Pandarinath, C. (2021). Representation learning for neural population activity with Neural Data Transformers. Neurons, Behavior, Data analysis, and Theory. https://doi.org/10.51628/001c.27358

Vancouver

Ye J, Pandarinath C. Representation learning for neural population activity with Neural Data Transformers. Neurons, Behavior, Data analysis, and Theory. 2021. doi:10.51628/001c.27358

BibTeX
@article{Ye2021,
  author = {Ye, Joel and Pandarinath, Chethan},
  title = {Representation learning for neural population activity with Neural Data Transformers},
  journal = {Neurons, Behavior, Data analysis, and Theory},
  year = {2021},
  doi = {10.51628/001c.27358}
}
Kostenlos starten →