Cooperation in public goods games: Leveraging other-regarding reinforcement learning on hypergraphs
Physical Review E · 09.01.2025 · 111 (1)
DOI: 10.1103/physreve.111.014304 ↗Kurz gefasst
Fachartikel in der Zeitschrift Physical Review E, online erschienen am 09.01.2025. Verfasst von Bo-Ying Li und 5 weiteren Autor:innen. Beteiligte Einrichtung: Ningxia University, School of Physics, Yinchuan 750021, People's Republic of China. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Ningxia.
Abstract (Originalsprache)
Cooperation is a self-organized collective behavior. It plays a significant role in the evolution of both ecosystems and human society. Reinforcement learning is different from imitation learning, offering a new perspective for exploring cooperation mechanisms. However, most existing studies with the public goods game (PGG) employ a self-regarding setup or are on pairwise interaction networks. Players in the real world, however, optimize their policies based not only on their histories but also on the histories of their coplayers, and the game is played in a group manner. In this work, we investigate the evolution of cooperation in the PGG under the other-regarding reinforcement learning evolutionary game on hypergraph by combining the Q-learning algorithm and evolutionary game framework, where other players' action history is incorporated and the game is played on hypergraphs. Our results show that as the synergy factor r[over ̂] increases, the parameter interval divides into three distinct regions-the absence of cooperation, medium cooperation, and high cooperation-accompanied by two abrupt transitions in the cooperation level near r[over ̂]_{1}^{*} and r[over ̂]_{2}^{*}, respectively. Interestingly, we identify regular and anticoordinated chessboard structures in the spatial pattern that positively contribute to the first cooperation transition but adversely affect the second. Furthermore, we provide a theoretical treatment for the first transition with an approximated r[over ̂]_{1}^{*} and reveal that players with a long-sighted perspective and low exploration rate are more likely to reciprocate kindness with each other, thus facilitating the emergence of cooperation. Our findings contribute to understanding the evolution of human cooperation, where other-regarding information and group interactions are commonplace.
Autor:innen und Institutionen
- Ningxia University, School of Physics, Yinchuan 750021, People's Republic of China.
- Shaanxi Normal University, School of Physics and Information Technology, Xi'an 710062, People's Republic of China.
- Northwest University, School of Physics, Xi'an 710127, People's Republic of China.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Program of Ningxia
Zitieren
APA
Li, B. Y., Zhang, Z. N., Zheng, G. Z., Cai, C. R., Zhang, J. Q., & Chen, L. (2025). Cooperation in public goods games: Leveraging other-regarding reinforcement learning on hypergraphs. Physical Review E, 111(1). https://doi.org/10.1103/physreve.111.014304
Vancouver
Li BY, Zhang ZN, Zheng GZ, Cai CR, Zhang JQ, Chen L. Cooperation in public goods games: Leveraging other-regarding reinforcement learning on hypergraphs. Physical Review E. 2025;111(1). doi:10.1103/physreve.111.014304
BibTeX
@article{Li2025,
author = {Li, Bo-Ying and Zhang, Zhen-Na and Zheng, Guo-Zhong and Cai, Chao-Ran and Zhang, Ji-Qiang and Chen, Li},
title = {Cooperation in public goods games: Leveraging other-regarding reinforcement learning on hypergraphs},
journal = {Physical Review E},
year = {2025},
volume = {111},
number = {1},
doi = {10.1103/physreve.111.014304}
}
EUVIMED