EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey

Minghong Geng, Shubham Pateria, Budhitama Subagdja, Ah-Hwee Tan

ACM Computing Surveys · 31.10.2026 · 58 (14) · 1-37

DOI: 10.1145/3817113 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 10.07.2026. Verfasst von Minghong Geng und 3 weiteren Autor:innen. Die Arbeit nennt 155 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: DSO National Laboratories, Singapore, Presidential Doctoral Fellowship in Computing, Singapore Management University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-agent reinforcement learning (MARL) empowers multiple autonomous agents to acquire effective policies for collaborative problem-solving. Over the last decade, MARL has seen significant advancements, with numerous algorithms achieving impressive performance across various benchmarks and real-world applications. Nevertheless, the scalability of multi-agent systems, in terms of the number of agents and the length of the task horizon, remains a critical consideration for applying MARL methods to complex problem-solving. Given that a dedicated review of the existing approaches and challenges in scaling up multi-agent systems remains largely absent, this survey aims to bridge this gap by delivering a comprehensive review of MARL methods developed to tackle challenging, scaled-up tasks. To this end, a novel taxonomy of MARL studies is introduced, categorizing them based on the external organizational control structures over all agents and the internal policy structures of individual agents. The survey also discusses the scales of popular MARL environments and tasks, providing a snapshot of the current challenging problems of interest. Furthermore, this survey underscores a set of critical open problems that call for further investigation in the field of scalable MARL.

Förderung

  • DSO National Laboratories, Singapore
  • Presidential Doctoral Fellowship in Computing
  • Singapore Management University

Zitieren

APA

Geng, M., Pateria, S., Subagdja, B., & Tan, A. (2026). Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey. ACM Computing Surveys, 58(14), 1-37. https://doi.org/10.1145/3817113

Vancouver

Geng M, Pateria S, Subagdja B, Tan A. Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey. ACM Computing Surveys. 2026;58(14):1-37. doi:10.1145/3817113

BibTeX
@article{Geng2026,
  author = {Geng, Minghong and Pateria, Shubham and Subagdja, Budhitama and Tan, Ah-Hwee},
  title = {Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey},
  journal = {ACM Computing Surveys},
  year = {2026},
  volume = {58},
  number = {14},
  pages = {1--37},
  doi = {10.1145/3817113}
}
Kostenlos starten →