Distributional Soft Actor-Critic-Based Multi-AUV Cooperative Pursuit for Maritime Security Protection
IEEE Transactions on Intelligent Transportation Systems · 2024-06 · 25 (6) · 6049-6060
DOI: 10.1109/tits.2023.3341034 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-06. Verfasst von Yun Hou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Open fund of State Key Laboratory of Acoustics.
Abstract (Originalsprache)
Unauthorized underwater vehicles (UUVs) pose a serious threat to maritime security. To preserve maritime security, it is essential to pursue these UUVs. The majority of traditional pursuit methods are based on known environmental dynamics. However, the underwater environment is too complicated and unpredictable to describe these dynamics accurately. This study developed a novel online decision-making technique called multi-agent distributional soft actor-critic (MADA) to handle the issue of underwater cooperative pursuit. The method constructs a control-oriented framework based on multi-agent reinforcement learning that can map autonomous underwater vehicle (AUV) observations to pursuit actions. Multiple AUVs can combine to make prompt pursuit decisions. Then, the proposed method combines distributional soft actor-critic and curriculum learning to improve the success rates of multiple AUVs in pursuing UUVs. Experimental results show that the MADA can obtain a better cooperative pursuit strategy.
Förderung
- National Natural Science Foundation of China
- Open fund of State Key Laboratory of Acoustics
Zitieren
APA
Hou, Y., Han, G., Zhang, F., Lin, C., Peng, J., & Liu, L. (2024). Distributional Soft Actor-Critic-Based Multi-AUV Cooperative Pursuit for Maritime Security Protection. IEEE Transactions on Intelligent Transportation Systems, 25(6), 6049-6060. https://doi.org/10.1109/tits.2023.3341034
Vancouver
Hou Y, Han G, Zhang F, Lin C, Peng J, Liu L. Distributional Soft Actor-Critic-Based Multi-AUV Cooperative Pursuit for Maritime Security Protection. IEEE Transactions on Intelligent Transportation Systems. 2024;25(6):6049-6060. doi:10.1109/tits.2023.3341034
BibTeX
@article{Hou2024,
author = {Hou, Yun and Han, Guangjie and Zhang, Fan and Lin, Chuan and Peng, Jinlin and Liu, Li},
title = {Distributional Soft Actor-Critic-Based Multi-AUV Cooperative Pursuit for Maritime Security Protection},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {25},
number = {6},
pages = {6049--6060},
doi = {10.1109/tits.2023.3341034}
}
EUVIMED