A Hierarchical Reinforcement Learning Framework for Multi-Agent Cooperative Maneuver Interception in Dynamic Environments
Journal of Marine Science and Engineering · 29.06.2025 · 13 (7) · 1271
DOI: 10.3390/jmse13071271 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 29.06.2025. Verfasst von Qinlong Huang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
To address the challenges of real-time decision-making and resource optimization in multi-agent cooperative interception tasks within dynamic environments, this paper proposes a hierarchical framework for reinforcement learning-based interception algorithm (HFRL-IA). By constructing a hierarchical Markov decision process (MDP) model based on dynamic game equilibrium theory, the complex interception task is decomposed into two hierarchically optimized stages: dynamic task allocation and distributed path planning. At the high level, a sequence-to-sequence reinforcement learning approach is employed to achieve dynamic bipartite graph matching, leveraging a graph neural network encoder–decoder architecture to handle dynamically expanding threat targets. At the low level, an improved prioritized experience replay multi-agent deep deterministic policy gradient algorithm (PER-MADDPG) is designed, integrating curriculum learning and prioritized experience replay mechanisms to effectively enhance the interception success rate against complex maneuvering targets. Extensive simulations in diverse scenarios and comparisons with conventional task assignment strategies demonstrate the superiority of the proposed algorithm. Taking a typical scenario of 10 agents intercepting as an example, the HFRL-IA algorithm achieves a 22.51% increase in training rewards compared to the traditional end-to-end MADDPG algorithm, and the interception success rate is improved by 26.37%. This study provides a new methodological framework for distributed cooperative decision-making in dynamic adversarial environments, with significant application potential in areas such as maritime multi-agent security defense and marine environment monitoring.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Huang, Q., Luo, Y., Liu, Z., Xia, J., Chang, M., & Li, J. (2025). A Hierarchical Reinforcement Learning Framework for Multi-Agent Cooperative Maneuver Interception in Dynamic Environments. Journal of Marine Science and Engineering, 13(7), 1271. https://doi.org/10.3390/jmse13071271
Vancouver
Huang Q, Luo Y, Liu Z, Xia J, Chang M, Li J. A Hierarchical Reinforcement Learning Framework for Multi-Agent Cooperative Maneuver Interception in Dynamic Environments. Journal of Marine Science and Engineering. 2025;13(7):1271. doi:10.3390/jmse13071271
BibTeX
@article{Huang2025,
author = {Huang, Qinlong and Luo, Yasong and Liu, Zhong and Xia, Jiawei and Chang, Ming and Li, Jiaqi},
title = {A Hierarchical Reinforcement Learning Framework for Multi-Agent Cooperative Maneuver Interception in Dynamic Environments},
journal = {Journal of Marine Science and Engineering},
year = {2025},
volume = {13},
number = {7},
pages = {1271},
doi = {10.3390/jmse13071271}
}
EUVIMED