EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning

Tomoki Takazawa, Yasuyuki Suzuki, Akihiro Nakamura, Risa Matsuo, Pietro Morasso, Taishin Nomura

Biological Cybernetics · 12.07.2024 · 118 (3-4) · 229-248

DOI: 10.1007/s00422-024-00993-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biological Cybernetics, online erschienen am 12.07.2024. Verfasst von Tomoki Takazawa und 5 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan. Hauptthemen laut MEDLINE: Postural Balance, Reinforcement, Psychology, Brain. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The stabilization of human quiet stance is achieved by a combination of the intrinsic elastic properties of ankle muscles and an active closed-loop activation of the ankle muscles, driven by the delayed feedback of the ongoing sway angle and the corresponding angular velocity in a way of a delayed proportional (P) and derivative (D) feedback controller. It has been shown that the active component of the stabilization process is likely to operate in an intermittent manner rather than as a continuous controller: the switching policy is defined in the phase-plane, which is divided in dangerous and safe regions, separated by appropriate switching boundaries. When the state enters a dangerous region, the delayed PD control is activated, and it is switched off when it enters a safe region, leaving the system to evolve freely. In comparison with continuous feedback control, the intermittent mechanism is more robust and capable to better reproduce postural sway patterns in healthy people. However, the superior performance of the intermittent control paradigm as well as its biological plausibility, suggested by experimental evidence of the intermittent activation of the ankle muscles, leaves open the quest of a feasible learning process, by which the brain can identify the appropriate state-dependent switching policy and tune accordingly the P and D parameters. In this work, it is shown how such a goal can be achieved with a reinforcement motor learning paradigm, building upon the evidence that, in general, the basal ganglia are known to play a central role in reinforcement learning for action selection and, in particular, were found to be specifically involved in postural stabilization.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Postural BalanceReinforcement, PsychologyBrainHumansLearningMuscle, SkeletalPosture

Stichwörter der Autor:innen

Intermittent controlPostural controlPostural swayReinforcement learning

Autor:innen und Institutionen

  • Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan.
  • Istituto Italiano di Tecnologia, Via Enrico Melen 83, Bldg B, 16152, Genoa, Italy.
  • Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan. taishin@i.kyoto-u.ac.jp.
  • Graduate School of Informatics, Kyoto University, Yoshida Honmachi, Sakyo-ku, Kyoto, 6068501, Japan. taishin@i.kyoto-u.ac.jp.

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Takazawa, T., Suzuki, Y., Nakamura, A., Matsuo, R., Morasso, P., & Nomura, T. (2024). How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning. Biological Cybernetics, 118(3-4), 229-248. https://doi.org/10.1007/s00422-024-00993-0

Vancouver

Takazawa T, Suzuki Y, Nakamura A, Matsuo R, Morasso P, Nomura T. How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning. Biological Cybernetics. 2024;118(3-4):229-248. doi:10.1007/s00422-024-00993-0

BibTeX
@article{Takazawa2024,
  author = {Takazawa, Tomoki and Suzuki, Yasuyuki and Nakamura, Akihiro and Matsuo, Risa and Morasso, Pietro and Nomura, Taishin},
  title = {How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning},
  journal = {Biological Cybernetics},
  year = {2024},
  volume = {118},
  number = {3-4},
  pages = {229--248},
  doi = {10.1007/s00422-024-00993-0}
}
Kostenlos starten →