An air combat maneuver decision-making approach using coupled reward in deep reinforcement learning
Complex & Intelligent Systems · 2025-08 · 11 (8)
DOI: 10.1007/s40747-025-01992-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Complex & Intelligent Systems, online erschienen am 27.06.2025. Verfasst von Jian Yang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
In the domain of unmanned air combat, achieving efficient autonomous maneuvering decisions presents challenges. Deep Reinforcement learning(DRL) is one of the approaches to tackle this problem. The final performance of the DRL algorithm is directly affected by the design of the reward functions. However, the performance and convergence speed of the models suffer from unreasonable reward weights. Therefore, a method named Coupled Reward-Deep Reinforcement Learning(CR-DRL) is introduced to deal with this problem. Specifically, we propose a novel coupled-weight reward function for DRL within the air combat framework. The novel reward function integrates angle and distance so that our DRL maneuver decision model can be trained faster and perform better compared to that of the models use conventional reward functions. Additionally, we establish a brand new competitive training framework designed to enhance the performance of our model against personalized opponents. The experimental results show that our CR-DRL model outperforms the traditional model that uses the fixed-weight reward functions in this training framework, with a 6.3% increase in average reward in fixed scenarios and a 22.8% increase in changeable scenarios. Moreover, the performance of our model continually improves with the increase of iterations, ultimately yielding a certain degree of generalization performance against similar opponents. Finally, we develop a simulation environment that supports real-time air combat based on Unity3D, called Airfightsim, to demonstrate the performance of the proposed algorithm.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Yang, J., Wang, L., Han, J., Chen, C., Yuan, Y., Yu, Z. L., & Yang, G. (2025). An air combat maneuver decision-making approach using coupled reward in deep reinforcement learning. Complex & Intelligent Systems, 11(8). https://doi.org/10.1007/s40747-025-01992-9
Vancouver
Yang J, Wang L, Han J, Chen C, Yuan Y, Yu ZL, et al. An air combat maneuver decision-making approach using coupled reward in deep reinforcement learning. Complex & Intelligent Systems. 2025;11(8). doi:10.1007/s40747-025-01992-9
BibTeX
@article{Yang2025,
author = {Yang, Jian and Wang, Liangpei and Han, Jiale and Chen, Changdi and Yuan, Yinlong and Yu, Zhu Liang and Yang, Guoli},
title = {An air combat maneuver decision-making approach using coupled reward in deep reinforcement learning},
journal = {Complex & Intelligent Systems},
year = {2025},
volume = {11},
number = {8},
doi = {10.1007/s40747-025-01992-9}
}
EUVIMED