EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning

Jan Babič iD, Tjasa Kunavar iD, Erhan Oztop, Mitsuo Kawato

PLOS Computational Biology · 2025

DOI: 10.1371/journal.pcbi.1013089 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2025. Verfasst von Jan Babič und 3 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory for Neuromechanics and Biorobotics, Department of Automatics, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Learning. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 96 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon 2020, Slovenian Research Agency, JSPS KAKENHI.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Our study explores how ecological aspects of motor learning enhance survival by improving movement efficiency and mitigating injury risks during task failures. Traditional motor control theories mainly address isolated body movements and often overlook these ecological factors. We introduce a novel computational motor control approach, incorporating ecological fitness and a strategy that alternates between success-driven movement efficiency and failure-driven safety, akin to win-stay/lose-shift tactics. In our experiments, participants performed squat-to-stand movements under novel force perturbations. They adapted effectively through various adaptive motor control mechanisms to avoid falls, reducing failure rates rapidly. The results indicate a high-level ecological controller in human motor learning that switches objectives between safety and movement efficiency, depending on failure or success. This approach is supported by policy learning, internal model adaptation, and adaptive feedback control. Our findings offer a comprehensive perspective on human motor control, integrating risk management in a hierarchical reinforcement learning framework for real-world environments.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Reinforcement, PsychologyLearningHumansMaleFemaleComputational BiologyMovementAdultYoung AdultPsychomotor PerformanceMotor Skills

Autor:innen und Institutionen

  • Laboratory for Neuromechanics and Biorobotics, Department of Automatics, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia.
  • Jožef Stefan International Postgraduate School, Ljubljana, Slovenia.
  • Ozyegin University, Istanbul, Turkiye.
  • Osaka University, Osaka, Japan.
  • Brain Information Communication Research Laboratory Group, Advanced Telecommunications Research Institute International, Kyoto, Japan.

ORCID-Profile: Jan Babič, Tjasa Kunavar

Förderung

  • European Union’s Horizon 2020
  • Slovenian Research Agency
  • JSPS KAKENHI
  • Japan Agency for Medical Research and Development (AMED)
  • Horizon 2020
  • Javna Agencija za Raziskovalno Dejavnost RS
  • Japan Society for the Promotion of Science London
  • Grants-in-Aid for Transformative Research Areas

Zitieren

APA

Babič, J., Kunavar, T., Oztop, E., & Kawato, M. (2025). Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1013089

Vancouver

Babič J, Kunavar T, Oztop E, Kawato M. Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning. PLOS Computational Biology. 2025. doi:10.1371/journal.pcbi.1013089

BibTeX
@article{Babi2025,
  author = {Babič, Jan and Kunavar, Tjasa and Oztop, Erhan and Kawato, Mitsuo},
  title = {Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning},
  journal = {PLOS Computational Biology},
  year = {2025},
  doi = {10.1371/journal.pcbi.1013089}
}
Kostenlos starten →