EUVIMEDEUVIMED entdecken
Crossref

TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference

Chuxiong Sun, Dunqi Yao, Rui Wang, Wenwen Qiang, Changwen Zheng, Jiangmeng Li

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (30) · 25682-25690

DOI: 10.1609/aaai.v40i30.39765 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Chuxiong Sun und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Exploration in sparse-reward tasks remains a fundamental challenge in multi-agent reinforcement learning (MARL) due to complex inter-agent interactions and the expansive exploration space. To address this issue, we propose Targeted Multi-Agent Exploration (TMAE), a novel framework that uncovers the causal relationships between the state space and the reward function, thereby reducing the exploration space and enabling more targeted exploration. Specifically, we construct a structural causal model (SCM) to model the causality between sub-state variables and sparse rewards, providing a robust analytical foundation for subsequent causal inference. Through counterfactual causal intervention, TMAE identifies the most critical subspaces for discovering rare but pivotal events while filtering out confounders. By incorporating these causal insights into the exploration process, TMAE prioritizes subspaces with stronger causal effects on sparse rewards, significantly enhancing exploration efficiency. We evaluate TMAE on a range of MARL benchmarks featuring sparse rewards, consistently demonstrating superior exploration efficiency compared to state-of-the-art methods. Furthermore, visualized causal insights derived from TMAE reveal its ability to effectively capture intricate dependencies and priorities in targeted exploration, showcasing strong alignment with prior domain knowledge.

Zitieren

APA

Sun, C., Yao, D., Wang, R., Qiang, W., Zheng, C., & Li, J. (2026). TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference. Proceedings of the AAAI Conference on Artificial Intelligence, 40(30), 25682-25690. https://doi.org/10.1609/aaai.v40i30.39765

Vancouver

Sun C, Yao D, Wang R, Qiang W, Zheng C, Li J. TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(30):25682-25690. doi:10.1609/aaai.v40i30.39765

BibTeX
@article{Sun2026,
  author = {Sun, Chuxiong and Yao, Dunqi and Wang, Rui and Qiang, Wenwen and Zheng, Changwen and Li, Jiangmeng},
  title = {TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {30},
  pages = {25682--25690},
  doi = {10.1609/aaai.v40i30.39765}
}
Kostenlos starten →