EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems

Xi Yao iD, Yingdong Hu iD, Yicheng Xu iD, Ruifeng Gao iD

Sensors · 31.03.2024 · 24 (7) · 2247

DOI: 10.3390/s24072247 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 31.03.2024. Verfasst von Xi Yao und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Technology, Nantong University, Nantong 226019, China. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jiangsu Provincial Higher Education Institutions General Program of Basic Science Research, Fujian Province Special Fund Project for Promoting High-Quality Development of Marine and Fisheries Industries, the Natural Science Foundation of Nantong.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the growing maritime economy, ensuring the quality of communication for maritime users has become imperative. The maritime communication system based on nearshore base stations enhances the communication rate of maritime users through dynamic resource allocation. A virtual queue-based deep reinforcement learning beam allocation scheme is proposed in this paper, aiming to maximize the communication rate. More particularly, to reduce the complexity of resource management, we employ a grid-based method to discretize the maritime environment. For the combinatorial optimization problem of grid and beam allocation under unknown channel state information, we model it as a sequential decision process of resource allocation. The nearshore base station is modeled as a learning agent, continuously interacting with the environment to optimize beam allocation schemes using deep reinforcement learning techniques. Furthermore, we guarantee that grids with poor channel state information can be serviced through the virtual queue method. Finally, the simulation results provided show that our proposed beam allocation scheme is beneficial in terms of increasing the communication rate.

Schlagwörter

Stichwörter der Autor:innen

beam allocation schemedeep Q-networkdeep reinforcement learning

Autor:innen und Institutionen

  • School of Information Science and Technology, Nantong University, Nantong 226019, China.
  • School of Transportation and Civil Engineering, Nantong University, Nantong 226019, China.

ORCID-Profile: Xi Yao, Yingdong Hu, Yicheng Xu, Ruifeng Gao

Förderung

  • Jiangsu Provincial Higher Education Institutions General Program of Basic Science Research
  • Fujian Province Special Fund Project for Promoting High-Quality Development of Marine and Fisheries Industries
  • the Natural Science Foundation of Nantong
  • Natural Science Foundation of Nantong

Zitieren

APA

Yao, X., Hu, Y., Xu, Y., & Gao, R. (2024). Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems. Sensors, 24(7), 2247. https://doi.org/10.3390/s24072247

Vancouver

Yao X, Hu Y, Xu Y, Gao R. Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems. Sensors. 2024;24(7):2247. doi:10.3390/s24072247

BibTeX
@article{Yao2024,
  author = {Yao, Xi and Hu, Yingdong and Xu, Yicheng and Gao, Ruifeng},
  title = {Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {7},
  pages = {2247},
  doi = {10.3390/s24072247}
}
Kostenlos starten →