EUVIMEDEUVIMED entdecken
Crossref

A spatiotemporal cell theory for cooperative pattern formation in reinforcement learning-driven evolutionary games

Hui-Yu Zhang iD, Yi-Hao Gu iD, Nan Yao iD, Xiao-Long Liang iD, Zi-Gang Huang iD, Si-Ping Zhang iD

Chaos: An Interdisciplinary Journal of Nonlinear Science · 01.05.2026 · 36 (5)

DOI: 10.1063/5.0332366 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Chaos: An Interdisciplinary Journal of Nonlinear Science, online erschienen am 01.05.2026. Verfasst von Hui-Yu Zhang und 5 weiteren Autor:innen. Beteiligte Einrichtung: The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Sci…. Hauptthemen laut MEDLINE: Game Theory, Cooperative Behavior, Biological Evolution. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: Brain Science and Brain-like Intelligence Technology-National Science and Technology Major Project, National Natural Science Foundation of China, China Postdoctoral Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The emergence and stable evolution of cooperation among self-interested individuals is a central issue spanning evolutionary biology, social dynamics, and artificial intelligence. Conventional imitation-based evolutionary game models, lacking mechanisms for active exploration and experiential accumulation, often trap populations in suboptimal steady states and fail to explain the persistence of complex cooperative patterns. In this study, we construct a multi-agent reinforcement learning framework for the spatial snowdrift game and propose a spatiotemporal cell theory that systematically elucidates the mechanisms underlying cooperation driven by autonomous learning. Our results show that agents accumulating interaction experience via Q-learning achieve cooperation levels significantly surpassing classical replicator dynamics across a broad parameter range, with the system self-organizing into robust collective decision-making structures. From an experiential learning perspective, we reveal an endogenous mechanism of cooperative emergence, demonstrating that efficient cooperation can arise solely from individual exploration and local feedback, without external punishment, reputation mechanisms, or centralized control. The spatiotemporal cell theory provides a unified analytical framework that quantifies the coupling between microscopic learning trajectories and macroscopic pattern evolution. Based on this theory, we derive a contour plot of the fraction of cooperators in the α–γ parameter plane that delineates cooperative stability, breakdown, and frozen defect-line phases, and uncover two distinct evolution pathways: cooperative amplification induced by synchronous exploration and noise accumulation driven by asynchronous exploration. This work deepens the understanding of cooperative evolution and provides theoretical support for designing decentralized adaptive multi-agent systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Game TheoryCooperative BehaviorBiological EvolutionReinforcement Machine LearningHumans

Autor:innen und Institutionen

  • The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an 710049, People's…
  • State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China.
  • Research Center for Brain-Inspired Intelligence, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China.
  • Shaanxi University Key Laboratory of Photonic Power Devices and Discharge Regulation & School of Optoelectronic Science and Intelligent Instrumentation, Xi'an University of Technology, Xi'an, 710048, People's Republic o…
  • Air Traffic Control and Navigation School, Air Force Engineering University, Xi'an 710051, People's Republic of China.

ORCID-Profile: Hui-Yu Zhang, Yi-Hao Gu, Nan Yao, Xiao-Long Liang, Zi-Gang Huang, Si-Ping Zhang

Förderung

  • Brain Science and Brain-like Intelligence Technology-National Science and Technology Major Project
  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation
  • Natural Science Basic Research Program of Shaanxi Province

Zitieren

APA

Zhang, H. Y., Gu, Y. H., Yao, N., Liang, X. L., Huang, Z. G., & Zhang, S. P. (2026). A spatiotemporal cell theory for cooperative pattern formation in reinforcement learning-driven evolutionary games. Chaos: An Interdisciplinary Journal of Nonlinear Science, 36(5). https://doi.org/10.1063/5.0332366

Vancouver

Zhang HY, Gu YH, Yao N, Liang XL, Huang ZG, Zhang SP. A spatiotemporal cell theory for cooperative pattern formation in reinforcement learning-driven evolutionary games. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2026;36(5). doi:10.1063/5.0332366

BibTeX
@article{Zhang2026,
  author = {Zhang, Hui-Yu and Gu, Yi-Hao and Yao, Nan and Liang, Xiao-Long and Huang, Zi-Gang and Zhang, Si-Ping},
  title = {A spatiotemporal cell theory for cooperative pattern formation in reinforcement learning-driven evolutionary games},
  journal = {Chaos: An Interdisciplinary Journal of Nonlinear Science},
  year = {2026},
  volume = {36},
  number = {5},
  doi = {10.1063/5.0332366}
}
Kostenlos starten →