Data-driven equation discovery reveals nonlinear reinforcement learning in humans
Proceedings of the National Academy of Sciences · 05.08.2025 · 122 (31)
DOI: 10.1073/pnas.2413441122 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 31.07.2025. Verfasst von Kyle J LaFollette und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological Sciences, Case Western Reserve University, Cleveland, OH 44106. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Learning. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Computational models of reinforcement learning (RL) have significantly contributed to our understanding of human behavior and decision-making. Traditional RL models, however, often adopt a linear approach to updating reward expectations, potentially oversimplifying the nuanced relationship between human behavior and rewards. To address these challenges and explore models of RL, we utilized a method of model discovery using equation discovery algorithms. This method, currently used mainly in physics and biology, attempts to capture data by proposing a differential equation from an array of suggested linear and nonlinear functions. Using this method, we were able to identify a model of RL which we termed the Quadratic Q-Weighted model. The model suggests that reward prediction errors obey nonlinear dynamics and exhibit negativity biases, resulting in an underweighting of reward when expectations are low, and an overweighting of the absence of reward when expectations are high. We tested the generalizability of our model by comparing it to classical models used in nine published studies. Our model surpassed traditional models in predictive accuracy across eight out of these nine published datasets, demonstrating not only its generalizability but also its potential to offer insights into the complexities of human learning. This work showcases the integration of a behavioral task with advanced computational methodologies as a potent strategy for uncovering the intricate patterns of human cognition, marking a significant step forward in the development of computational models that are both interpretable and broadly applicable.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychological Sciences, Case Western Reserve University, Cleveland, OH 44106.
- Booth School of Business, University of Chicago, Chicago, IL 60637.
- Department of Earth, Atmospheric and Planetary Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139.
- Department of Psychology, Harvard University, Cambridge, MA 02138.
- Graduate School of Business, Stanford University, Stanford CA 94305.
- Harvard Business School, Harvard University, Boston, MA 02163.
ORCID-Profile: Kyle J LaFollette, Janni Yuval, Roey Schurr
Zitieren
APA
LaFollette, K. J., Yuval, J., Schurr, R., Melnikoff, D., & Goldenberg, A. (2025). Data-driven equation discovery reveals nonlinear reinforcement learning in humans. Proceedings of the National Academy of Sciences, 122(31). https://doi.org/10.1073/pnas.2413441122
Vancouver
LaFollette KJ, Yuval J, Schurr R, Melnikoff D, Goldenberg A. Data-driven equation discovery reveals nonlinear reinforcement learning in humans. Proceedings of the National Academy of Sciences. 2025;122(31). doi:10.1073/pnas.2413441122
BibTeX
@article{LaFollette2025,
author = {LaFollette, Kyle J and Yuval, Janni and Schurr, Roey and Melnikoff, David and Goldenberg, Amit},
title = {Data-driven equation discovery reveals nonlinear reinforcement learning in humans},
journal = {Proceedings of the National Academy of Sciences},
year = {2025},
volume = {122},
number = {31},
doi = {10.1073/pnas.2413441122}
}
EUVIMED