How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning
Biological Cybernetics · 12.07.2024 · 118 (3-4) · 229-248
DOI: 10.1007/s00422-024-00993-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biological Cybernetics, online erschienen am 12.07.2024. Verfasst von Tomoki Takazawa und 5 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan. Hauptthemen laut MEDLINE: Postural Balance, Reinforcement, Psychology, Brain. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.
Abstract (Originalsprache)
The stabilization of human quiet stance is achieved by a combination of the intrinsic elastic properties of ankle muscles and an active closed-loop activation of the ankle muscles, driven by the delayed feedback of the ongoing sway angle and the corresponding angular velocity in a way of a delayed proportional (P) and derivative (D) feedback controller. It has been shown that the active component of the stabilization process is likely to operate in an intermittent manner rather than as a continuous controller: the switching policy is defined in the phase-plane, which is divided in dangerous and safe regions, separated by appropriate switching boundaries. When the state enters a dangerous region, the delayed PD control is activated, and it is switched off when it enters a safe region, leaving the system to evolve freely. In comparison with continuous feedback control, the intermittent mechanism is more robust and capable to better reproduce postural sway patterns in healthy people. However, the superior performance of the intermittent control paradigm as well as its biological plausibility, suggested by experimental evidence of the intermittent activation of the ankle muscles, leaves open the quest of a feasible learning process, by which the brain can identify the appropriate state-dependent switching policy and tune accordingly the P and D parameters. In this work, it is shown how such a goal can be achieved with a reinforcement motor learning paradigm, building upon the evidence that, in general, the basal ganglia are known to play a central role in reinforcement learning for action selection and, in particular, were found to be specifically involved in postural stabilization.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan.
- Istituto Italiano di Tecnologia, Via Enrico Melen 83, Bldg B, 16152, Genoa, Italy.
- Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan. taishin@i.kyoto-u.ac.jp.
- Graduate School of Informatics, Kyoto University, Yoshida Honmachi, Sakyo-ku, Kyoto, 6068501, Japan. taishin@i.kyoto-u.ac.jp.
Förderung
- Japan Society for the Promotion of Science
Zitieren
APA
Takazawa, T., Suzuki, Y., Nakamura, A., Matsuo, R., Morasso, P., & Nomura, T. (2024). How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning. Biological Cybernetics, 118(3-4), 229-248. https://doi.org/10.1007/s00422-024-00993-0
Vancouver
Takazawa T, Suzuki Y, Nakamura A, Matsuo R, Morasso P, Nomura T. How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning. Biological Cybernetics. 2024;118(3-4):229-248. doi:10.1007/s00422-024-00993-0
BibTeX
@article{Takazawa2024,
author = {Takazawa, Tomoki and Suzuki, Yasuyuki and Nakamura, Akihiro and Matsuo, Risa and Morasso, Pietro and Nomura, Taishin},
title = {How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning},
journal = {Biological Cybernetics},
year = {2024},
volume = {118},
number = {3-4},
pages = {229--248},
doi = {10.1007/s00422-024-00993-0}
}
EUVIMED