Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning
PLOS Computational Biology · 2025
DOI: 10.1371/journal.pcbi.1013089 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2025. Verfasst von Jan Babič und 3 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory for Neuromechanics and Biorobotics, Department of Automatics, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Learning. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 96 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon 2020, Slovenian Research Agency, JSPS KAKENHI.
Abstract (Originalsprache)
Our study explores how ecological aspects of motor learning enhance survival by improving movement efficiency and mitigating injury risks during task failures. Traditional motor control theories mainly address isolated body movements and often overlook these ecological factors. We introduce a novel computational motor control approach, incorporating ecological fitness and a strategy that alternates between success-driven movement efficiency and failure-driven safety, akin to win-stay/lose-shift tactics. In our experiments, participants performed squat-to-stand movements under novel force perturbations. They adapted effectively through various adaptive motor control mechanisms to avoid falls, reducing failure rates rapidly. The results indicate a high-level ecological controller in human motor learning that switches objectives between safety and movement efficiency, depending on failure or success. This approach is supported by policy learning, internal model adaptation, and adaptive feedback control. Our findings offer a comprehensive perspective on human motor control, integrating risk management in a hierarchical reinforcement learning framework for real-world environments.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Laboratory for Neuromechanics and Biorobotics, Department of Automatics, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia.
- Jožef Stefan International Postgraduate School, Ljubljana, Slovenia.
- Ozyegin University, Istanbul, Turkiye.
- Osaka University, Osaka, Japan.
- Brain Information Communication Research Laboratory Group, Advanced Telecommunications Research Institute International, Kyoto, Japan.
ORCID-Profile: Jan Babič, Tjasa Kunavar
Förderung
- European Union’s Horizon 2020
- Slovenian Research Agency
- JSPS KAKENHI
- Japan Agency for Medical Research and Development (AMED)
- Horizon 2020
- Javna Agencija za Raziskovalno Dejavnost RS
- Japan Society for the Promotion of Science London
- Grants-in-Aid for Transformative Research Areas
Zitieren
APA
Babič, J., Kunavar, T., Oztop, E., & Kawato, M. (2025). Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1013089
Vancouver
Babič J, Kunavar T, Oztop E, Kawato M. Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning. PLOS Computational Biology. 2025. doi:10.1371/journal.pcbi.1013089
BibTeX
@article{Babi2025,
author = {Babič, Jan and Kunavar, Tjasa and Oztop, Erhan and Kawato, Mitsuo},
title = {Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning},
journal = {PLOS Computational Biology},
year = {2025},
doi = {10.1371/journal.pcbi.1013089}
}
EUVIMED