EUVIMEDEUVIMED entdecken
Crossref

Predictive Auxiliary Learning for Belief-based Multi-Agent Systems

Qinwei Huang, Simon Khan, Rui Zuo, Stefan Wang, Garrett E. Katz, Qinru Qiu

Proceedings of the AAAI Symposium Series · 18.05.2026 · 8 (1) · 50-58

DOI: 10.1609/aaaiss.v8i1.42517 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 18.05.2026. Verfasst von Qinwei Huang und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-agent reinforcement learning (MARL) under partial observability requires agents to construct reliable belief representations from limited local observations and partial information exchange. Conventional approaches rely primarily on sparse task rewards to shape these internal representations, which often leads to unstable training dynamics and slow convergence. We propose BElief-based Predictive Auxiliary Learning (BEPAL), a decentralized MARL framework that improves belief representation quality through predictive auxiliary tasks. BEPAL trains agents to maintain a "world model" that accurately estimates the global environment state and predict future dynamics from accumulated local observations and communication, providing another channel of feedback that complements sparse reward in reinforcement learning. By encouraging the hidden state to serve as a compact and informative summary of historical input, BEPAL stabilizes decentralized policy learning and accelerates convergence. The proposed approach is compatible with any decentralized MARL architectures with homogeneous agents and does not increase execution-time complexity. Experiments on Predator–Prey, Traffic Junction, Google Research Football, and RWARE show that BEPAL consistently improves learning stability and task performance compared to strong baselines, highlighting the effectiveness of predictive auxiliary learning for belief formation under partial observability.

Zitieren

APA

Huang, Q., Khan, S., Zuo, R., Wang, S., Katz, G. E., & Qiu, Q. (2026). Predictive Auxiliary Learning for Belief-based Multi-Agent Systems. Proceedings of the AAAI Symposium Series, 8(1), 50-58. https://doi.org/10.1609/aaaiss.v8i1.42517

Vancouver

Huang Q, Khan S, Zuo R, Wang S, Katz GE, Qiu Q. Predictive Auxiliary Learning for Belief-based Multi-Agent Systems. Proceedings of the AAAI Symposium Series. 2026;8(1):50-58. doi:10.1609/aaaiss.v8i1.42517

BibTeX
@article{Huang2026,
  author = {Huang, Qinwei and Khan, Simon and Zuo, Rui and Wang, Stefan and Katz, Garrett E. and Qiu, Qinru},
  title = {Predictive Auxiliary Learning for Belief-based Multi-Agent Systems},
  journal = {Proceedings of the AAAI Symposium Series},
  year = {2026},
  volume = {8},
  number = {1},
  pages = {50--58},
  doi = {10.1609/aaaiss.v8i1.42517}
}
Kostenlos starten →