EUVIMEDEUVIMED entdecken
Crossref

Safe Multi-Agent Reinforcement Learning via Distributional Safety Critic and Maximum Entropy Optimization

Qiwei Liu, Ye Yuan, Lingyue Zhang, Kaitian Chen, Yunkai Lv, Sheng Gao, Huaicheng Yan

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (35) · 29555-29563

DOI: 10.1609/aaai.v40i35.40198 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Qiwei Liu und 6 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deploying multi-agent reinforcement learning (MARL) in safety-critical systems faces significant challenges due to insufficient agent exploration and inadequate safety constraint guarantees. Current approaches are constrained by two fundamental limitations: inefficient exploration leading to suboptimal policies, and expected-cost-based constraint frameworks failing to ensure full-process safety. To address these challenges, this paper proposes a novel safety-aware maximum entropy MARL framework using Conditional Value-at-Risk (CVaR) as a joint safety metric, which quantifies constraint satisfaction under worst-case scenarios for multi-agent systems. Moreover, we develop the Worst-Case Multi-Agent Soft Actor-Critic (WCMASAC) algorithm, incorporating sequential update mechanisms and maximum entropy optimization for heterogeneous agents, enhanced with distributed safety critics. Theoretically, we establish the monotonic improvement property, guaranteed constraint satisfaction, and convergence to a generalized Nash equilibrium for WCMASAC. Extensive experiments on Safety-Gymnasium based benchmarks demonstrate that WCMASAC outperforms state-of-the-art baselines in both task reward acquisition and safety constraint violation reduction, while exhibiting superior exploration efficiency and risk-aware control capabilities.

Zitieren

APA

Liu, Q., Yuan, Y., Zhang, L., Chen, K., Lv, Y., Gao, S., & Yan, H. (2026). Safe Multi-Agent Reinforcement Learning via Distributional Safety Critic and Maximum Entropy Optimization. Proceedings of the AAAI Conference on Artificial Intelligence, 40(35), 29555-29563. https://doi.org/10.1609/aaai.v40i35.40198

Vancouver

Liu Q, Yuan Y, Zhang L, Chen K, Lv Y, Gao S, et al. Safe Multi-Agent Reinforcement Learning via Distributional Safety Critic and Maximum Entropy Optimization. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(35):29555-29563. doi:10.1609/aaai.v40i35.40198

BibTeX
@article{Liu2026,
  author = {Liu, Qiwei and Yuan, Ye and Zhang, Lingyue and Chen, Kaitian and Lv, Yunkai and Gao, Sheng and Yan, Huaicheng},
  title = {Safe Multi-Agent Reinforcement Learning via Distributional Safety Critic and Maximum Entropy Optimization},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {35},
  pages = {29555--29563},
  doi = {10.1609/aaai.v40i35.40198}
}
Kostenlos starten →