LINDA: multi-agent local information decomposition for awareness of teammates
Science China Information Sciences · 2023-08 · 66 (8)
DOI: 10.1007/s11432-021-3479-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science China Information Sciences, online erschienen am 26.07.2023. Verfasst von Jiahan Cao und 6 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben.
Abstract (Originalsprache)
In cooperative multi-agent reinforcement learning (MARL), where agents only have access to partial observations, efficiently leveraging local information is critical. During long-time observations, agents can build awareness for teammates to alleviate the restriction of partial observability. However, previous MARL methods usually neglect awareness learning from local information for better collaboration. To address this problem, we propose a novel framework, multi-agent local information decomposition for awareness of teammates (LINDA), with which agents learn to decompose local information and build awareness for each teammate. We model the awareness as stochastic random variables and perform representation learning to ensure the informativeness of awareness representations by maximizing the mutual information between awareness and the actual trajectory of the corresponding agent. LINDA is agnostic to specific algorithms and can be flexibly integrated with different MARL methods. Sufficient experiments show that the proposed framework learns informative awareness from local partial observations for better collaboration and significantly improves the learning performance, especially on challenging tasks.
Zitieren
APA
Cao, J., Yuan, L., Wang, J., Zhang, S., Zhang, C., Yu, Y., & Zhan, D. (2023). LINDA: multi-agent local information decomposition for awareness of teammates. Science China Information Sciences, 66(8). https://doi.org/10.1007/s11432-021-3479-9
Vancouver
Cao J, Yuan L, Wang J, Zhang S, Zhang C, Yu Y, et al. LINDA: multi-agent local information decomposition for awareness of teammates. Science China Information Sciences. 2023;66(8). doi:10.1007/s11432-021-3479-9
BibTeX
@article{Cao2023,
author = {Cao, Jiahan and Yuan, Lei and Wang, Jianhao and Zhang, Shaowei and Zhang, Chongjie and Yu, Yang and Zhan, De-Chuan},
title = {LINDA: multi-agent local information decomposition for awareness of teammates},
journal = {Science China Information Sciences},
year = {2023},
volume = {66},
number = {8},
doi = {10.1007/s11432-021-3479-9}
}
EUVIMED