EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Contrasting action and posture coding with hierarchical deep neural network models of proprioception

Kai J Sandbrink, Pranav Mamidanna iD, Claudio Michaelis, Matthias Bethge iD, Mackenzie Weygandt Mathis iD, Alexander Mathis iD

eLife · 2023

DOI: 10.7554/elife.81499 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, 2023. Verfasst von Kai J Sandbrink und 5 weiteren Autor:innen. Beteiligte Einrichtung: The Rowland Institute at Harvard, Harvard University, Cambridge, United States. Hauptthemen laut MEDLINE: Proprioception, Posture. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swiss National Science Foundation, Rowland Institute at Harvard, EPFL.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body’s state. The canonical role of proprioception is representing the body state. We hypothesize that the proprioceptive system could also be critical for high-level tasks such as action recognition. To test this theory, we pursued a task-driven modeling approach, which allowed us to isolate the study of proprioception. We generated a large synthetic dataset of human arm trajectories tracing characters of the Latin alphabet in 3D space, together with muscle activities obtained from a musculoskeletal model and model-based muscle spindle activity. Next, we compared two classes of tasks: trajectory decoding and action recognition, which allowed us to train hierarchical models to decode either the position and velocity of the end-effector of one’s posture or the character (action) identity from the spindle firing patterns. We found that artificial neural networks could robustly solve both tasks, and the networks’ units show tuning properties similar to neurons in the primate somatosensory cortex and the brainstem. Remarkably, we found uniformly distributed directional selective units only with the action-recognition-trained models and not the trajectory-decoding-trained models. This suggests that proprioceptive encoding is additionally associated with higher-level functions such as action recognition and therefore provides new, experimentally testable hypotheses of how proprioception aids in adaptive motor control.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ProprioceptionPostureAnimalsHumansNeural Networks, ComputerMuscle SpindlesNeurons

Stichwörter der Autor:innen

biomechanicscomputational biologydeep learningneurosciencenoneproprioceptionsensory systemssomatosensorysystems biologytask-driven modeling

Autor:innen und Institutionen

  • The Rowland Institute at Harvard, Harvard University, Cambridge, United States.
  • Tübingen AI Center, Eberhard Karls Universität Tübingen & Institute for Theoretical Physics, Tübingen, Germany.
  • Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, Genève, Switzerland.

ORCID-Profile: Pranav Mamidanna, Matthias Bethge, Mackenzie Weygandt Mathis, Alexander Mathis

Förderung

  • Swiss National Science Foundation
  • Rowland Institute at Harvard
  • EPFL

Zitieren

APA

Sandbrink, K. J., Mamidanna, P., Michaelis, C., Bethge, M., Mathis, M. W., & Mathis, A. (2023). Contrasting action and posture coding with hierarchical deep neural network models of proprioception. eLife. https://doi.org/10.7554/elife.81499

Vancouver

Sandbrink KJ, Mamidanna P, Michaelis C, Bethge M, Mathis MW, Mathis A. Contrasting action and posture coding with hierarchical deep neural network models of proprioception. eLife. 2023. doi:10.7554/elife.81499

BibTeX
@article{Sandbrink2023,
  author = {Sandbrink, Kai J and Mamidanna, Pranav and Michaelis, Claudio and Bethge, Matthias and Mathis, Mackenzie Weygandt and Mathis, Alexander},
  title = {Contrasting action and posture coding with hierarchical deep neural network models of proprioception},
  journal = {eLife},
  year = {2023},
  doi = {10.7554/elife.81499}
}
Kostenlos starten →