TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (30) · 25682-25690
DOI: 10.1609/aaai.v40i30.39765 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Chuxiong Sun und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Exploration in sparse-reward tasks remains a fundamental challenge in multi-agent reinforcement learning (MARL) due to complex inter-agent interactions and the expansive exploration space. To address this issue, we propose Targeted Multi-Agent Exploration (TMAE), a novel framework that uncovers the causal relationships between the state space and the reward function, thereby reducing the exploration space and enabling more targeted exploration. Specifically, we construct a structural causal model (SCM) to model the causality between sub-state variables and sparse rewards, providing a robust analytical foundation for subsequent causal inference. Through counterfactual causal intervention, TMAE identifies the most critical subspaces for discovering rare but pivotal events while filtering out confounders. By incorporating these causal insights into the exploration process, TMAE prioritizes subspaces with stronger causal effects on sparse rewards, significantly enhancing exploration efficiency. We evaluate TMAE on a range of MARL benchmarks featuring sparse rewards, consistently demonstrating superior exploration efficiency compared to state-of-the-art methods. Furthermore, visualized causal insights derived from TMAE reveal its ability to effectively capture intricate dependencies and priorities in targeted exploration, showcasing strong alignment with prior domain knowledge.
Zitieren
APA
Sun, C., Yao, D., Wang, R., Qiang, W., Zheng, C., & Li, J. (2026). TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference. Proceedings of the AAAI Conference on Artificial Intelligence, 40(30), 25682-25690. https://doi.org/10.1609/aaai.v40i30.39765
Vancouver
Sun C, Yao D, Wang R, Qiang W, Zheng C, Li J. TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(30):25682-25690. doi:10.1609/aaai.v40i30.39765
BibTeX
@article{Sun2026,
author = {Sun, Chuxiong and Yao, Dunqi and Wang, Rui and Qiang, Wenwen and Zheng, Changwen and Li, Jiangmeng},
title = {TMAE:Learning Targeted Multi-Agent Exploration via Causal Inference},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {30},
pages = {25682--25690},
doi = {10.1609/aaai.v40i30.39765}
}
EUVIMED