Hierarchical Heterogeneous Multi-Agent Cross-Domain Search Method Based on Deep Reinforcement Learning
IEEE Transactions on Intelligent Transportation Systems · 2024-11 · 25 (11) · 18872-18883
DOI: 10.1109/tits.2024.3417698 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-11. Verfasst von Shangqun Dong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 24 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Joint Fund of Ministry of Education for Pre-Research of Equipment, Fundamental Research Funds for Xi’an Jiaotong University.
Abstract (Originalsprache)
Marine target searching is a complex task due to large search areas, unique signal propagation characteristics, and limited visibility, posing significant challenges for single-agent or homogeneous multi-agent systems. In response, we propose a novel hierarchical heterogeneous multi-agent (HHMA) framework designed for underwater search scenarios. This framework integrates three types of vehicles moving in different domains—unmanned aerial, surface, and underwater vehicles, effectively overcoming the limitations of single or double-agent configurations. We begin by elucidating the advantages of the HHMA system in target searching, providing the kinematic modeling, while also transforming sonar detecting data and defining the search problem. The mission is decomposed to three human-comprehensible subtasks that are adaptive to both environmental conditions and equipment capabilities: moving, target estimating and trajectory planning. The target estimating subtask is effectively modeled as a Markov Decision Process, retaining its memory capability. Additionally, we extend multi-agent reinforcement learning to multi-policy reinforcement learning, facilitating the training of interdependent policies. The efficacy of our approach is demonstrated through simulations, comparing it with rule-based methods. Simulation results underscore the significance of the HHMA system and validate the proposed training methodology.
Förderung
- National Natural Science Foundation of China
- Joint Fund of Ministry of Education for Pre-Research of Equipment
- Fundamental Research Funds for Xi’an Jiaotong University
Zitieren
APA
Dong, S., Liu, M., Dong, S., Zheng, R., & Wei, P. (2024). Hierarchical Heterogeneous Multi-Agent Cross-Domain Search Method Based on Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, 25(11), 18872-18883. https://doi.org/10.1109/tits.2024.3417698
Vancouver
Dong S, Liu M, Dong S, Zheng R, Wei P. Hierarchical Heterogeneous Multi-Agent Cross-Domain Search Method Based on Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems. 2024;25(11):18872-18883. doi:10.1109/tits.2024.3417698
BibTeX
@article{Dong2024,
author = {Dong, Shangqun and Liu, Meiqin and Dong, Shanling and Zheng, Ronghao and Wei, Ping},
title = {Hierarchical Heterogeneous Multi-Agent Cross-Domain Search Method Based on Deep Reinforcement Learning},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {25},
number = {11},
pages = {18872--18883},
doi = {10.1109/tits.2024.3417698}
}
EUVIMED