Contrasting action and posture coding with hierarchical deep neural network models of proprioception
eLife · 2023
DOI: 10.7554/elife.81499 ↗Kurz gefasst
Fachartikel in der Zeitschrift eLife, 2023. Verfasst von Kai J Sandbrink und 5 weiteren Autor:innen. Beteiligte Einrichtung: The Rowland Institute at Harvard, Harvard University, Cambridge, United States. Hauptthemen laut MEDLINE: Proprioception, Posture. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swiss National Science Foundation, Rowland Institute at Harvard, EPFL.
Abstract (Originalsprache)
Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body’s state. The canonical role of proprioception is representing the body state. We hypothesize that the proprioceptive system could also be critical for high-level tasks such as action recognition. To test this theory, we pursued a task-driven modeling approach, which allowed us to isolate the study of proprioception. We generated a large synthetic dataset of human arm trajectories tracing characters of the Latin alphabet in 3D space, together with muscle activities obtained from a musculoskeletal model and model-based muscle spindle activity. Next, we compared two classes of tasks: trajectory decoding and action recognition, which allowed us to train hierarchical models to decode either the position and velocity of the end-effector of one’s posture or the character (action) identity from the spindle firing patterns. We found that artificial neural networks could robustly solve both tasks, and the networks’ units show tuning properties similar to neurons in the primate somatosensory cortex and the brainstem. Remarkably, we found uniformly distributed directional selective units only with the action-recognition-trained models and not the trajectory-decoding-trained models. This suggests that proprioceptive encoding is additionally associated with higher-level functions such as action recognition and therefore provides new, experimentally testable hypotheses of how proprioception aids in adaptive motor control.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- The Rowland Institute at Harvard, Harvard University, Cambridge, United States.
- Tübingen AI Center, Eberhard Karls Universität Tübingen & Institute for Theoretical Physics, Tübingen, Germany.
- Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, Genève, Switzerland.
ORCID-Profile: Pranav Mamidanna, Matthias Bethge, Mackenzie Weygandt Mathis, Alexander Mathis
Förderung
- Swiss National Science Foundation
- Rowland Institute at Harvard
- EPFL
Zitieren
APA
Sandbrink, K. J., Mamidanna, P., Michaelis, C., Bethge, M., Mathis, M. W., & Mathis, A. (2023). Contrasting action and posture coding with hierarchical deep neural network models of proprioception. eLife. https://doi.org/10.7554/elife.81499
Vancouver
Sandbrink KJ, Mamidanna P, Michaelis C, Bethge M, Mathis MW, Mathis A. Contrasting action and posture coding with hierarchical deep neural network models of proprioception. eLife. 2023. doi:10.7554/elife.81499
BibTeX
@article{Sandbrink2023,
author = {Sandbrink, Kai J and Mamidanna, Pranav and Michaelis, Claudio and Bethge, Matthias and Mathis, Mackenzie Weygandt and Mathis, Alexander},
title = {Contrasting action and posture coding with hierarchical deep neural network models of proprioception},
journal = {eLife},
year = {2023},
doi = {10.7554/elife.81499}
}
EUVIMED