Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey
ACM Computing Surveys · 31.10.2026 · 58 (14) · 1-37
DOI: 10.1145/3817113 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 10.07.2026. Verfasst von Minghong Geng und 3 weiteren Autor:innen. Die Arbeit nennt 155 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: DSO National Laboratories, Singapore, Presidential Doctoral Fellowship in Computing, Singapore Management University.
Abstract (Originalsprache)
Multi-agent reinforcement learning (MARL) empowers multiple autonomous agents to acquire effective policies for collaborative problem-solving. Over the last decade, MARL has seen significant advancements, with numerous algorithms achieving impressive performance across various benchmarks and real-world applications. Nevertheless, the scalability of multi-agent systems, in terms of the number of agents and the length of the task horizon, remains a critical consideration for applying MARL methods to complex problem-solving. Given that a dedicated review of the existing approaches and challenges in scaling up multi-agent systems remains largely absent, this survey aims to bridge this gap by delivering a comprehensive review of MARL methods developed to tackle challenging, scaled-up tasks. To this end, a novel taxonomy of MARL studies is introduced, categorizing them based on the external organizational control structures over all agents and the internal policy structures of individual agents. The survey also discusses the scales of popular MARL environments and tasks, providing a snapshot of the current challenging problems of interest. Furthermore, this survey underscores a set of critical open problems that call for further investigation in the field of scalable MARL.
Förderung
- DSO National Laboratories, Singapore
- Presidential Doctoral Fellowship in Computing
- Singapore Management University
Zitieren
APA
Geng, M., Pateria, S., Subagdja, B., & Tan, A. (2026). Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey. ACM Computing Surveys, 58(14), 1-37. https://doi.org/10.1145/3817113
Vancouver
Geng M, Pateria S, Subagdja B, Tan A. Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey. ACM Computing Surveys. 2026;58(14):1-37. doi:10.1145/3817113
BibTeX
@article{Geng2026,
author = {Geng, Minghong and Pateria, Shubham and Subagdja, Budhitama and Tan, Ah-Hwee},
title = {Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {14},
pages = {1--37},
doi = {10.1145/3817113}
}
EUVIMED