Enhancing BVR Air Combat Agent Development With Attention-Driven Reinforcement Learning
IEEE Access · 2025 · 13 · 70446-70463
DOI: 10.1109/access.2025.3561250 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Andre R. Kuroswiski und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Article Processing Charge, Coordination for the Improvement of Higher Education Personnel—CAPES, Brazilian Air Force.
Abstract (Originalsprache)
This study explores the use of Reinforcement Learning (RL) to develop autonomous agents for Beyond Visual Range (BVR) air combat, addressing the challenges of dynamic and uncertain adversarial scenarios. We propose a novel approach that introduces a task-based layer, leveraging domain expertise to optimize decision-making and training efficiency. By integrating multi-head attention mechanisms into the policy model and employing an improved DQN algorithm, agents dynamically select context-aware tasks, enabling the learning of efficient emergent behaviors for variable engagement conditions. Evaluations in single- and multi-agent BVR scenarios against adversaries with diverse tactical characteristics demonstrate superior training efficiency and enhanced agent capabilities compared to leading RL algorithms commonly applied in similar domains, including PPO, DDPG, and SAC. A robustness study underscores the critical role of diverse enemy selection in the RL process, showing that adversaries with variable tactical behaviors are essential for developing robust agents. This work advances RL methodologies for autonomous BVR air combat and provides insights applicable to other problems with challenging adversarial scenarios.
Förderung
- Article Processing Charge
- Coordination for the Improvement of Higher Education Personnel—CAPES
- Brazilian Air Force
Zitieren
APA
Kuroswiski, A. R., Wu, A. S., & Passaro, A. (2025). Enhancing BVR Air Combat Agent Development With Attention-Driven Reinforcement Learning. IEEE Access, 13, 70446-70463. https://doi.org/10.1109/access.2025.3561250
Vancouver
Kuroswiski AR, Wu AS, Passaro A. Enhancing BVR Air Combat Agent Development With Attention-Driven Reinforcement Learning. IEEE Access. 2025;13:70446-70463. doi:10.1109/access.2025.3561250
BibTeX
@article{Kuroswiski2025,
author = {Kuroswiski, Andre R. and Wu, Annie S. and Passaro, Angelo},
title = {Enhancing BVR Air Combat Agent Development With Attention-Driven Reinforcement Learning},
journal = {IEEE Access},
year = {2025},
volume = {13},
pages = {70446--70463},
doi = {10.1109/access.2025.3561250}
}
EUVIMED