EUVIMEDEUVIMED entdecken
Crossref

Reinforcement learning with embedded knowledge models for multi-agent airspace confrontation

Yong-Bo Jian, Hai-Gen Yang

The Computer Journal · 28.07.2026

DOI: 10.1093/comjnl/bxag076 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Computer Journal, online erschienen am 28.07.2026. Verfasst von Yong-Bo Jian und 1 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Gefördert von: National Defense Basic Scientific Research Program of China, National Defense Key Research Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To address the decision-making challenges in multi-aircraft cooperative air combat, this paper proposes a knowledge-model-embedded reinforcement learning framework tailored for multi-agent aerial combat scenarios. The proposed method enhances the QMIX algorithm by integrating prioritized experience replay, an ε-greedy decay strategy, a multi-head attention mechanism, and the weighted QMIX (WQMIX) approach, while embedding domain-specific air combat knowledge into the learning process. These enhancements significantly accelerate training convergence and improve learning efficiency. To optimize the parameters of the improved algorithm (IQMIX), including buffer size, batch size, discount factor (gamma), learning rate (lr), and soft update coefficient (tau), an improved hippo optimization algorithm (HOA) is developed and validated through 23 benchmark functions, demonstrating superior optimization performance. The refined HOA, combined with a surrogate-model-based identification technique, is then employed to determine the optimal parameter configuration for IQMIX. Extensive simulation and ablation experiments in three combat environments show that, compared with the original QMIX algorithm, the knowledge-embedded IQMIX (IQMIX3) achieves a 211% improvement in average reward. Compared with the knowledge-embedded QMIX3 variant, IQMIX3 further improves the average reward by 1.55% while reducing training time to 45.84% of QMIX3. These results demonstrate that the proposed knowledge-model-embedded IQMIX exhibits superior learning efficiency and adaptability in multi-agent aerial combat scenarios.

Förderung

  • National Defense Basic Scientific Research Program of China
  • National Defense Key Research Program of China

Zitieren

APA

Jian, Y., & Yang, H. (2026). Reinforcement learning with embedded knowledge models for multi-agent airspace confrontation. The Computer Journal. https://doi.org/10.1093/comjnl/bxag076

Vancouver

Jian Y, Yang H. Reinforcement learning with embedded knowledge models for multi-agent airspace confrontation. The Computer Journal. 2026. doi:10.1093/comjnl/bxag076

BibTeX
@article{Jian2026,
  author = {Jian, Yong-Bo and Yang, Hai-Gen},
  title = {Reinforcement learning with embedded knowledge models for multi-agent airspace confrontation},
  journal = {The Computer Journal},
  year = {2026},
  doi = {10.1093/comjnl/bxag076}
}
Kostenlos starten →