Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning
Sensors · 28.05.2026 · 26 (11) · 3413
DOI: 10.3390/s26113413 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 28.05.2026. Verfasst von Jiahao Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronic Engineering, Faculty of Information Science and Engineering, Ocean University of China, Qingdao 266000, China. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Efficient coordination under limited communication is a central challenge in multi-agent reinforcement learning (MARL). Existing approaches often focus on message exchange without explicitly modeling how communication affects policy learning, leading to redundant interactions and limited coordination gains. In this paper, we propose a threshold-gated sparse communication framework built upon QMIX, a monotonic value-decomposition method that mixes individual agent action values into a global team action value. In the proposed framework, communication is integrated into the agent utility function to directly influence policy learning. Each agent encodes local observations into structured representations and activates communication through a learned trigger mechanism. Messages are aggregated via neighbor-constrained attention and incorporated into utility estimation for decentralized decision-making. Experimental results on the StarCraft Multi-Agent Challenge (SMAC) benchmark show that the proposed method improves coordination quality and training stability while significantly reducing communication frequency. On MMM, the Marine–Marauder–Medivac heterogeneous scenario, the communication rate is reduced to approximately 30–38% while achieving up to 96.6% win rate, compared to 92.1% for QMIX. On 10m_vs_11m, a homogeneous scenario where ten allied Marines fight against eleven enemy Marines, communication remains within 28–37% while reaching 88.4% win rate, compared to 85.6% for QMIX. Moreover, on the same task, varying communication thresholds induce clearly differentiated policy behaviors, indicating that sparse communication not only reduces overhead but also plays a critical role in shaping coordination policies. These results demonstrate that selective communication enables efficient coordination while explicitly regulating policy formation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronic Engineering, Faculty of Information Science and Engineering, Ocean University of China, Qingdao 266000, China.
Zitieren
APA
Li, J., Li, R., & Wang, N. (2026). Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning. Sensors, 26(11), 3413. https://doi.org/10.3390/s26113413
Vancouver
Li J, Li R, Wang N. Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning. Sensors. 2026;26(11):3413. doi:10.3390/s26113413
BibTeX
@article{Li2026,
author = {Li, Jiahao and Li, Renjie and Wang, Nan},
title = {Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning},
journal = {Sensors},
year = {2026},
volume = {26},
number = {11},
pages = {3413},
doi = {10.3390/s26113413}
}
EUVIMED