EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD

Yuebin Zhou, Yunling Yue, Bolun Yan, Linkun Li, Jinsheng Xiao, Yuan Yao

Drones · 24.07.2025 · 9 (8) · 521

DOI: 10.3390/drones9080521 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 24.07.2025. Verfasst von Yuebin Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Major Program (JD) of Hubei Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Target tracking is a representative task in multi-agent reinforcement learning (MARL), where agents must collaborate effectively in environments with dense obstacles, evasive targets, and high-dimensional observations—conditions that often lead to local optima and training inefficiencies. To address these challenges, this paper proposes a collaborative tracking algorithm for UAVs that integrates behavior cloning with temporal difference (BCTD) and multi-agent proximal policy optimization (MAPPO). Expert trajectories are generated using the artificial potential field (APF), followed by policy pre-training via behavior cloning and TD-based value optimization. MAPPO is then employed for dynamic fine-tuning, enhancing robustness and coordination. Experiments in a simulated environment show that the proposed MAPPO+BCTD framework outperforms MAPPO, QMIX, and MADDPG in success rate, convergence speed, and tracking efficiency. The proposed method effectively alleviates the local optimization problem of APF and the training inefficiency problem of RL, offering a scalable and reliable solution for dynamic multi-agent coordination.

Förderung

  • Major Program (JD) of Hubei Province

Zitieren

APA

Zhou, Y., Yue, Y., Yan, B., Li, L., Xiao, J., & Yao, Y. (2025). Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD. Drones, 9(8), 521. https://doi.org/10.3390/drones9080521

Vancouver

Zhou Y, Yue Y, Yan B, Li L, Xiao J, Yao Y. Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD. Drones. 2025;9(8):521. doi:10.3390/drones9080521

BibTeX
@article{Zhou2025,
  author = {Zhou, Yuebin and Yue, Yunling and Yan, Bolun and Li, Linkun and Xiao, Jinsheng and Yao, Yuan},
  title = {Collaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTD},
  journal = {Drones},
  year = {2025},
  volume = {9},
  number = {8},
  pages = {521},
  doi = {10.3390/drones9080521}
}
Kostenlos starten →