EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning

Jiahao Li iD, Renjie Li iD, Nan Wang

Sensors · 28.05.2026 · 26 (11) · 3413

DOI: 10.3390/s26113413 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 28.05.2026. Verfasst von Jiahao Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronic Engineering, Faculty of Information Science and Engineering, Ocean University of China, Qingdao 266000, China. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Efficient coordination under limited communication is a central challenge in multi-agent reinforcement learning (MARL). Existing approaches often focus on message exchange without explicitly modeling how communication affects policy learning, leading to redundant interactions and limited coordination gains. In this paper, we propose a threshold-gated sparse communication framework built upon QMIX, a monotonic value-decomposition method that mixes individual agent action values into a global team action value. In the proposed framework, communication is integrated into the agent utility function to directly influence policy learning. Each agent encodes local observations into structured representations and activates communication through a learned trigger mechanism. Messages are aggregated via neighbor-constrained attention and incorporated into utility estimation for decentralized decision-making. Experimental results on the StarCraft Multi-Agent Challenge (SMAC) benchmark show that the proposed method improves coordination quality and training stability while significantly reducing communication frequency. On MMM, the Marine–Marauder–Medivac heterogeneous scenario, the communication rate is reduced to approximately 30–38% while achieving up to 96.6% win rate, compared to 92.1% for QMIX. On 10m_vs_11m, a homogeneous scenario where ten allied Marines fight against eleven enemy Marines, communication remains within 28–37% while reaching 88.4% win rate, compared to 85.6% for QMIX. Moreover, on the same task, varying communication thresholds induce clearly differentiated policy behaviors, indicating that sparse communication not only reduces overhead but also plays a critical role in shaping coordination policies. These results demonstrate that selective communication enables efficient coordination while explicitly regulating policy formation.

Schlagwörter

Stichwörter der Autor:innen

communication efficiencymulti-agent reinforcement learningsparse communicationthreshold-gated mechanism

Autor:innen und Institutionen

  • Department of Electronic Engineering, Faculty of Information Science and Engineering, Ocean University of China, Qingdao 266000, China.

ORCID-Profile: Jiahao Li, Renjie Li

Zitieren

APA

Li, J., Li, R., & Wang, N. (2026). Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning. Sensors, 26(11), 3413. https://doi.org/10.3390/s26113413

Vancouver

Li J, Li R, Wang N. Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning. Sensors. 2026;26(11):3413. doi:10.3390/s26113413

BibTeX
@article{Li2026,
  author = {Li, Jiahao and Li, Renjie and Wang, Nan},
  title = {Sparse Communication for Policy Shaping in Multi-Agent Reinforcement Learning},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {11},
  pages = {3413},
  doi = {10.3390/s26113413}
}
Kostenlos starten →