Moderate confirmation bias enhances decision-making in groups of reinforcement-learning agents
PLOS Computational Biology · 2024
DOI: 10.1371/journal.pcbi.1012404 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Clémence Bergerot und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biology, Humboldt Universität zu Berlin, Berlin, Germany. Hauptthemen laut MEDLINE: Decision Making, Reinforcement, Psychology. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Einstein Center for Neurosciences Berlin, Charité – Universitätsmedizin Berlin, German Research Foundation under Germany’s Excellence Strategy, Einstein Center for Neurosciences Berlin.
Abstract (Originalsprache)
Humans tend to give more weight to information confirming their beliefs than to information that disconfirms them. Nevertheless, this apparent irrationality has been shown to improve individual decision-making under uncertainty. However, little is known about this bias’ impact on decision-making in a social context. Here, we investigate the conditions under which confirmation bias is beneficial or detrimental to decision-making under social influence. To do so, we develop a Collective Asymmetric Reinforcement Learning (CARL) model in which artificial agents observe others’ actions and rewards, and update this information asymmetrically. We use agent-based simulations to study how confirmation bias affects collective performance on a two-armed bandit task, and how resource scarcity, group size and bias strength modulate this effect. We find that a confirmation bias benefits group learning across a wide range of resource-scarcity conditions. Moreover, we discover that, past a critical bias strength, resource abundance favors the emergence of two different performance regimes, one of which is suboptimal. In addition, we find that this regime bifurcation comes with polarization in small groups of agents. Overall, our results suggest the existence of an optimal, moderate level of confirmation bias for decision-making in a social context.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Biology, Humboldt Universität zu Berlin, Berlin, Germany.
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences Berlin, Berlin, Germany.
- Transdisciplinary Research Area: Sustainable Futures, University of Bonn, Bonn, Germany.
- Center for Development Research (ZEF), University of Bonn, Bonn, Germany.
- Science of Intelligence, Research Cluster of Excellence, Berlin, Germany.
ORCID-Profile: Clémence Bergerot
Förderung
- Einstein Center for Neurosciences Berlin, Charité – Universitätsmedizin Berlin
- German Research Foundation under Germany’s Excellence Strategy
- Einstein Center for Neurosciences Berlin
- Deutsche Forschungsgemeinschaft
Zitieren
APA
Bergerot, C., Barfuss, W., & Romanczuk, P. (2024). Moderate confirmation bias enhances decision-making in groups of reinforcement-learning agents. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012404
Vancouver
Bergerot C, Barfuss W, Romanczuk P. Moderate confirmation bias enhances decision-making in groups of reinforcement-learning agents. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012404
BibTeX
@article{Bergerot2024,
author = {Bergerot, Clémence and Barfuss, Wolfram and Romanczuk, Pawel},
title = {Moderate confirmation bias enhances decision-making in groups of reinforcement-learning agents},
journal = {PLOS Computational Biology},
year = {2024},
doi = {10.1371/journal.pcbi.1012404}
}
EUVIMED