EUVIMEDEUVIMED entdecken
Open Access

Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds

Adam M Roth iD, Jan A Calalo, Rakshith Lokesh, Seth R Sullivan, Stephen Grill, John J Jeka, Katinka van der Kooij, Michael J Carter, Joshua G A Cashaback

Proceedings of the Royal Society B: Biological Sciences · 2023

DOI: 10.1098/rspb.2023.1475 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the Royal Society B: Biological Sciences, 2023. Verfasst von Adam M Roth und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mechanical Engineering, University of Delaware, Newark, DE 19716, USA. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Learning. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIGMS NIH HHS, NIH, NSERC.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

From a baby’s babbling to a songbird practising a new tune, exploration is critical to motor learning. A hallmark of exploration is the emergence of random walk behaviour along solution manifolds, where successive motor actions are not independent but rather become serially dependent. Such exploratory random walk behaviour is ubiquitous across species' neural firing, gait patterns and reaching behaviour. The past work has suggested that exploratory random walk behaviour arises from an accumulation of movement variability and a lack of error-based corrections. Here, we test a fundamentally different idea—that reinforcement-based processes regulate random walk behaviour to promote continual motor exploration to maximize success. Across three human reaching experiments, we manipulated the size of both the visually displayed target and an unseen reward zone, as well as the probability of reinforcement feedback. Our empirical and modelling results parsimoniously support the notion that exploratory random walk behaviour emerges by utilizing knowledge of movement variability to update intended reach aim towards recently reinforced motor actions. This mechanism leads to active and continuous exploration of the solution manifold, currently thought by prominent theories to arise passively. The ability to continually explore muscle, joint and task redundant solution manifolds is beneficial while acting in uncertain environments, during motor development or when recovering from a neurological disorder to discover and learn new motor actions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Reinforcement, PsychologyLearningHumansRewardMovementFeedbackPsychomotor Performance

Stichwörter der Autor:innen

explorationlearningredundantreinforcementsensorimotor

Autor:innen und Institutionen

  • Department of Mechanical Engineering, University of Delaware, Newark, DE 19716, USA.
  • Department of Biomedical Engineering, University of Delaware, Newark, DE 19716, USA.
  • Kinesiology and Applied Physiology, University of Delaware, Newark, DE 19716, USA.
  • Interdisciplinary Neuroscience Graduate Program, University of Delaware, Newark, DE 19716, USA.
  • Biomechanics and Movement Science Program, University of Delaware, Newark, DE 19716, USA.
  • Faculty of Behavioural and Movement Science, Vrije University Amsterdam, Amsterdam, 1081HV, The Netherlands.

ORCID-Profile: Adam M Roth

Förderung

  • NIGMS NIH HHS
  • NIH
  • NSERC
  • NSF

Zitieren

APA

Roth, A. M., Calalo, J. A., Lokesh, R., Sullivan, S. R., Grill, S., Jeka, J. J., van der Kooij, K., Carter, M. J., & Cashaback, J. G. A. (2023). Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds. Proceedings of the Royal Society B: Biological Sciences. https://doi.org/10.1098/rspb.2023.1475

Vancouver

Roth AM, Calalo JA, Lokesh R, Sullivan SR, Grill S, Jeka JJ, et al. Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds. Proceedings of the Royal Society B: Biological Sciences. 2023. doi:10.1098/rspb.2023.1475

BibTeX
@article{Roth2023,
  author = {Roth, Adam M and Calalo, Jan A and Lokesh, Rakshith and Sullivan, Seth R and Grill, Stephen and Jeka, John J and van der Kooij, Katinka and Carter, Michael J and Cashaback, Joshua G A},
  title = {Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds},
  journal = {Proceedings of the Royal Society B: Biological Sciences},
  year = {2023},
  doi = {10.1098/rspb.2023.1475}
}
Kostenlos starten →