EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The functional form of value normalization in human reinforcement learning

Sophie Bavard iD, Stefano Palminteri iD

eLife · 10.07.2023 · 12

DOI: 10.7554/elife.83891 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, online erschienen am 10.07.2023. Verfasst von Sophie Bavard und 1 weiteren Autor:innen. Beteiligte Einrichtung: Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et Recherche Médicale, Paris, France. Hauptthemen laut MEDLINE: Decision Making, Reinforcement, Psychology. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Research Council, Agence Nationale de la Recherche.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning research in humans and other species indicates that rewards are represented in a context-dependent manner. More specifically, reward representations seem to be normalized as a function of the value of the alternative options. The dominant view postulates that value context-dependence is achieved via a divisive normalization rule, inspired by perceptual decision-making research. However, behavioral and neural evidence points to another plausible mechanism: range normalization. Critically, previous experimental designs were ill-suited to disentangle the divisive and the range normalization accounts, which generate similar behavioral predictions in many circumstances. To address this question, we designed a new learning task where we manipulated, across learning contexts, the number of options and the value ranges. Behavioral and computational analyses falsify the divisive normalization account and rather provide support for the range normalization rule. Together, these results shed new light on the computational mechanisms underlying context-dependence in learning and decision-making.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Decision MakingReinforcement, PsychologyHumansLearningReward

Stichwörter der Autor:innen

cognitive sciencecomputational biologycomputational modeldecision-makingefficient codinghumanreinforcement learningrelative valuesystems biology

Autor:innen und Institutionen

  • Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et Recherche Médicale, Paris, France.
  • Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France.
  • Department of Psychology, University of Hamburg, Hamburg, Germany.

ORCID-Profile: Sophie Bavard, Stefano Palminteri

Förderung

  • European Research Council
  • Agence Nationale de la Recherche

Zitieren

APA

Bavard, S., & Palminteri, S. (2023). The functional form of value normalization in human reinforcement learning. eLife, 12. https://doi.org/10.7554/elife.83891

Vancouver

Bavard S, Palminteri S. The functional form of value normalization in human reinforcement learning. eLife. 2023;12. doi:10.7554/elife.83891

BibTeX
@article{Bavard2023,
  author = {Bavard, Sophie and Palminteri, Stefano},
  title = {The functional form of value normalization in human reinforcement learning},
  journal = {eLife},
  year = {2023},
  volume = {12},
  doi = {10.7554/elife.83891}
}
Kostenlos starten →