Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD
Drones · 24.07.2025 · 9 (8) · 521
DOI: 10.3390/drones9080521 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 24.07.2025. Verfasst von Yuebin Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Major Program (JD) of Hubei Province.
Abstract (Originalsprache)
Target tracking is a representative task in multi-agent reinforcement learning (MARL), where agents must collaborate effectively in environments with dense obstacles, evasive targets, and high-dimensional observations—conditions that often lead to local optima and training inefficiencies. To address these challenges, this paper proposes a collaborative tracking algorithm for UAVs that integrates behavior cloning with temporal difference (BCTD) and multi-agent proximal policy optimization (MAPPO). Expert trajectories are generated using the artificial potential field (APF), followed by policy pre-training via behavior cloning and TD-based value optimization. MAPPO is then employed for dynamic fine-tuning, enhancing robustness and coordination. Experiments in a simulated environment show that the proposed MAPPO+BCTD framework outperforms MAPPO, QMIX, and MADDPG in success rate, convergence speed, and tracking efficiency. The proposed method effectively alleviates the local optimization problem of APF and the training inefficiency problem of RL, offering a scalable and reliable solution for dynamic multi-agent coordination.
Förderung
- Major Program (JD) of Hubei Province
Zitieren
APA
Zhou, Y., Yue, Y., Yan, B., Li, L., Xiao, J., & Yao, Y. (2025). Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD. Drones, 9(8), 521. https://doi.org/10.3390/drones9080521
Vancouver
Zhou Y, Yue Y, Yan B, Li L, Xiao J, Yao Y. Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD. Drones. 2025;9(8):521. doi:10.3390/drones9080521
BibTeX
@article{Zhou2025,
author = {Zhou, Yuebin and Yue, Yunling and Yan, Bolun and Li, Linkun and Xiao, Jinsheng and Yao, Yuan},
title = {Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD},
journal = {Drones},
year = {2025},
volume = {9},
number = {8},
pages = {521},
doi = {10.3390/drones9080521}
}
EUVIMED