Autonomous Maneuver Decision‐Making for Unmanned Aerial Vehicles via Transfer Reinforcement Learning
International Journal of Robust and Nonlinear Control · 15.05.2026
DOI: 10.1002/rnc.70586 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Robust and Nonlinear Control, online erschienen am 15.05.2026. Verfasst von Yuzhou Huang und 4 weiteren Autor:innen. Die Arbeit nennt 32 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Aerial multi‐agent reinforcement learning for within‐visual‐range air combat remains challenging due to exploration difficulty, delayed task feedback, high‐dimensional continuous control, non‐stationary opponents, and instability when adapting policies from single‐agent to multi‐agent training. This paper proposes a transfer reinforcement learning via self‐play (TRLSP) framework that integrates curriculum learning, transfer adaptation, and multi‐agent twin delayed deep deterministic policy gradient for autonomous air combat decision‐making. TRLSP is organized as a three‐stage training pipeline. Stage 1 acquires a single‐agent expert policy through curriculum‐guided learning against progressively stronger opponents. Stage 2 transfers the expert policy to the multi‐agent setting through a progressive network unfreezing schedule with an explicit layer‐release order and learning‐rate scaling. Stage 3 performs MATD3‐based self‐play with a fixed‐size historical strategy pool, where opponent snapshots are sampled uniformly at random and updated through a FIFO rule. The framework is evaluated under matched budgets using terminal/combat metrics, cross‐play comparisons, and out‐of‐distribution (OOD) robustness tests with confidence intervals. Experimental results show that TRLSP achieves stronger competitive performance than representative baselines and remains more robust across held‐out opponents and shifted initial conditions.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Huang, Y., Long, Y., Cheng, Z., Shen, A., & Liu, M. (2026). Autonomous Maneuver Decision‐Making for Unmanned Aerial Vehicles via Transfer Reinforcement Learning. International Journal of Robust and Nonlinear Control. https://doi.org/10.1002/rnc.70586
Vancouver
Huang Y, Long Y, Cheng Z, Shen A, Liu M. Autonomous Maneuver Decision‐Making for Unmanned Aerial Vehicles via Transfer Reinforcement Learning. International Journal of Robust and Nonlinear Control. 2026. doi:10.1002/rnc.70586
BibTeX
@article{Huang2026,
author = {Huang, Yuzhou and Long, Yaosong and Cheng, Zhongtao and Shen, Ao and Liu, Mengru},
title = {Autonomous Maneuver Decision‐Making for Unmanned Aerial Vehicles via Transfer Reinforcement Learning},
journal = {International Journal of Robust and Nonlinear Control},
year = {2026},
doi = {10.1002/rnc.70586}
}
EUVIMED