EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Deep Reinforcement Learning Approach for Joint Resource Allocation in Time-Varying Underwater Acoustic Cooperative Networks

Liangliang Zeng, Tongxing Zheng, Yifan Wu, Yimeng Ge, Jiahao Gao

Journal of Marine Science and Engineering · 27.03.2026 · 14 (7) · 616

DOI: 10.3390/jmse14070616 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 27.03.2026. Verfasst von Liangliang Zeng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Xi’an Association for Science and Technology Youth Talent Support Program Project, General Project of Shaanxi Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Underwater acoustic sensor networks (UASNs) have emerged as a pivotal technology for ocean exploration, tactical surveillance, and environmental monitoring. However, the underwater acoustic channel poses severe challenges, including high propagation delay, limited bandwidth, and rapid time-varying multipath fading, which significantly degrade communication reliability. Cooperative communication, which exploits spatial diversity via relay nodes, offers a promising solution to these impairments. In this paper, we investigate the joint optimization of relay selection and power allocation in UASNs to maximize the long-term system energy efficiency and throughput. This problem is inherently complex due to the hybrid action space, which couples the discrete selection of relay nodes with the continuous allocation of transmission power, and the absence of real-time, perfect channel state information (CSI). To address these challenges, we propose a novel deep hybrid reinforcement learning (DHRL) framework utilizing a parameterized deep Q-Network (P-DQN) architecture. Unlike traditional approaches that discretize power levels or relax discrete constraints, our approach seamlessly integrates a deterministic policy network for continuous power control and a value-based network for discrete relay evaluation. Furthermore, we incorporate a prioritized experience replay (PER) mechanism to improve sample efficiency by focusing on rare but significant channel transition events. We provide a comprehensive theoretical analysis of the algorithm’s complexity and convergence properties. Extensive simulation results demonstrate that the proposed DHRL algorithm outperforms state-of-the-art combinatorial bandit algorithms and conventional deep reinforcement learning baselines in terms of system energy efficiency, and also exhibits superior robustness against channel estimation errors.

Förderung

  • Xi’an Association for Science and Technology Youth Talent Support Program Project
  • General Project of Shaanxi Province

Zitieren

APA

Zeng, L., Zheng, T., Wu, Y., Ge, Y., & Gao, J. (2026). A Deep Reinforcement Learning Approach for Joint Resource Allocation in Time-Varying Underwater Acoustic Cooperative Networks. Journal of Marine Science and Engineering, 14(7), 616. https://doi.org/10.3390/jmse14070616

Vancouver

Zeng L, Zheng T, Wu Y, Ge Y, Gao J. A Deep Reinforcement Learning Approach for Joint Resource Allocation in Time-Varying Underwater Acoustic Cooperative Networks. Journal of Marine Science and Engineering. 2026;14(7):616. doi:10.3390/jmse14070616

BibTeX
@article{Zeng2026,
  author = {Zeng, Liangliang and Zheng, Tongxing and Wu, Yifan and Ge, Yimeng and Gao, Jiahao},
  title = {A Deep Reinforcement Learning Approach for Joint Resource Allocation in Time-Varying Underwater Acoustic Cooperative Networks},
  journal = {Journal of Marine Science and Engineering},
  year = {2026},
  volume = {14},
  number = {7},
  pages = {616},
  doi = {10.3390/jmse14070616}
}
Kostenlos starten →