EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Energy-Efficient, Multi-Agent Deep Reinforcement Learning Approach for Adaptive Beacon Selection in AUV-Based Underwater Localization

Zahid Ullah Khan, Hangyuan Gao, Farzana Kulsoom, Syed Agha Hassnain Mohsan, Aman Muhammad, Hassan Nazeer Chaudry

Journal of Marine Science and Engineering · 27.01.2026 · 14 (3) · 262

DOI: 10.3390/jmse14030262 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 27.01.2026. Verfasst von Zahid Ullah Khan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Heilongjiang Province, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate and energy-efficient localization of autonomous underwater vehicles (AUVs) remains a fundamental challenge due to the complex, bandwidth-limited, and highly dynamic nature of underwater acoustic environments. This paper proposes a fully adaptive deep reinforcement learning (DRL)-driven localization framework for AUVs operating in Underwater Acoustic Sensor Networks (UAWSNs). The localization problem is formulated as a Markov Decision Process (MDP) in which an intelligent agent jointly optimizes beacon selection and transmit power allocation to minimize long-term localization error and energy consumption. A hierarchical learning architecture is developed by integrating four actor–critic algorithms, which are (i) Twin Delayed Deep Deterministic Policy Gradient (TD3), (ii) Soft Actor–Critic (SAC), (iii) Multi-Agent Deep Deterministic Policy Gradient (MADDPG), and (iv) Distributed DDPG (D2DPG), enabling robust learning under non-stationary channels, cooperative multi-AUV scenarios, and large-scale deployments. A round-trip time (RTT)-based geometric localization model incorporating a depth-dependent sound speed gradient is employed to accurately capture realistic underwater acoustic propagation effects. A multi-objective reward function jointly balances localization accuracy, energy efficiency, and ranging reliability through a risk-aware metric. Furthermore, the Cramér–Rao Lower Bound (CRLB) is derived to characterize the theoretical performance limits, and a comprehensive complexity analysis is performed to demonstrate the scalability of the proposed framework. Extensive Monte Carlo simulations show that the proposed DRL-based methods achieve significantly lower localization error, lower energy consumption, faster convergence, and higher overall system utility than classical TD3. These results confirm the effectiveness and robustness of DRL for next-generation adaptive underwater localization systems.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Heilongjiang Province
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Khan, Z. U., Gao, H., Kulsoom, F., Mohsan, S. A. H., Muhammad, A., & Chaudry, H. N. (2026). Energy-Efficient, Multi-Agent Deep Reinforcement Learning Approach for Adaptive Beacon Selection in AUV-Based Underwater Localization. Journal of Marine Science and Engineering, 14(3), 262. https://doi.org/10.3390/jmse14030262

Vancouver

Khan ZU, Gao H, Kulsoom F, Mohsan SAH, Muhammad A, Chaudry HN. Energy-Efficient, Multi-Agent Deep Reinforcement Learning Approach for Adaptive Beacon Selection in AUV-Based Underwater Localization. Journal of Marine Science and Engineering. 2026;14(3):262. doi:10.3390/jmse14030262

BibTeX
@article{Khan2026,
  author = {Khan, Zahid Ullah and Gao, Hangyuan and Kulsoom, Farzana and Mohsan, Syed Agha Hassnain and Muhammad, Aman and Chaudry, Hassan Nazeer},
  title = {Energy-Efficient, Multi-Agent Deep Reinforcement Learning Approach for Adaptive Beacon Selection in AUV-Based Underwater Localization},
  journal = {Journal of Marine Science and Engineering},
  year = {2026},
  volume = {14},
  number = {3},
  pages = {262},
  doi = {10.3390/jmse14030262}
}
Kostenlos starten →