EUVIMEDEUVIMED entdecken
StudienprotokollOpen Access · CC BY 4.0

A Q-Learning-Based Distributed Energy-Efficient Routing Protocol in UASNs

Xuan Geng, Qingyuan Li iD, Xiaowei Pan, Fang Cao

Entropy · 19.03.2026 · 28 (3) · 346

DOI: 10.3390/e28030346 ↗

Kurz gefasst

Studienprotokoll in der Zeitschrift Entropy, online erschienen am 19.03.2026. Verfasst von Xuan Geng und 3 weiteren Autor:innen. Beteiligte Einrichtung: Collage of Information Engineering, Shanghai Maritime University, Shanghai 201306, China. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Soft Science Project of Shanghai, Key Research and Development Program of Shanghai, Joint Funds of the National Natural Science Foundation 372 of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper proposes a Q-Learning-Based Distributed Energy-Efficient Routing (QDER) protocol for underwater acoustic sensor networks (UASNs). The routing problem is formulated as a Markov Decision Process (MDP) and a distributed Q-learning approach is proposed. Each sensor node is treated as an agent that independently selects its next-hop node based on a Q-table. The rewards function is designed that jointly considers node residual energy and depth information, enabling each node to learn an effective routing policy through distributed decision-making. Unlike centralized routing approaches that rely on extensive global information exchange, the proposed scheme allows nodes to make local decisions, thereby reducing communication overhead and energy consumption while maintaining efficient routing paths. In addition, link quality is designed in the reward to account for channel conditions, which improves the robustness of the routing strategy under noisy underwater acoustic environments. Simulation results demonstrate that the QDER achieves better system performance compared with Depth-Based Routing (DBR) and Deep Q-Network-Based Intelligent Routing (DQIR). Considering channel attenuation and noise, the proposed method with the link quality metric achieves improved network lifetime and energy efficiency. It also shows good robustness and adaptability under different signal-to-noise ratio (SNR) conditions.

Schlagwörter

Stichwörter der Autor:innen

Q-learningdistributed routingunderwater acoustic sensor network

Autor:innen und Institutionen

  • Collage of Information Engineering, Shanghai Maritime University, Shanghai 201306, China.

ORCID-Profile: Qingyuan Li

Förderung

  • Soft Science Project of Shanghai
  • Key Research and Development Program of Shanghai
  • Joint Funds of the National Natural Science Foundation 372 of China
  • Joint Funds of the National Natural Science Foundation of China

Zitieren

APA

Geng, X., Li, Q., Pan, X., & Cao, F. (2026). A Q-Learning-Based Distributed Energy-Efficient Routing Protocol in UASNs. Entropy, 28(3), 346. https://doi.org/10.3390/e28030346

Vancouver

Geng X, Li Q, Pan X, Cao F. A Q-Learning-Based Distributed Energy-Efficient Routing Protocol in UASNs. Entropy. 2026;28(3):346. doi:10.3390/e28030346

BibTeX
@article{Geng2026,
  author = {Geng, Xuan and Li, Qingyuan and Pan, Xiaowei and Cao, Fang},
  title = {A Q-Learning-Based Distributed Energy-Efficient Routing Protocol in UASNs},
  journal = {Entropy},
  year = {2026},
  volume = {28},
  number = {3},
  pages = {346},
  doi = {10.3390/e28030346}
}
Kostenlos starten →