Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems
Sensors · 31.03.2024 · 24 (7) · 2247
DOI: 10.3390/s24072247 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 31.03.2024. Verfasst von Xi Yao und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Technology, Nantong University, Nantong 226019, China. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jiangsu Provincial Higher Education Institutions General Program of Basic Science Research, Fujian Province Special Fund Project for Promoting High-Quality Development of Marine and Fisheries Industries, the Natural Science Foundation of Nantong.
Abstract (Originalsprache)
With the growing maritime economy, ensuring the quality of communication for maritime users has become imperative. The maritime communication system based on nearshore base stations enhances the communication rate of maritime users through dynamic resource allocation. A virtual queue-based deep reinforcement learning beam allocation scheme is proposed in this paper, aiming to maximize the communication rate. More particularly, to reduce the complexity of resource management, we employ a grid-based method to discretize the maritime environment. For the combinatorial optimization problem of grid and beam allocation under unknown channel state information, we model it as a sequential decision process of resource allocation. The nearshore base station is modeled as a learning agent, continuously interacting with the environment to optimize beam allocation schemes using deep reinforcement learning techniques. Furthermore, we guarantee that grids with poor channel state information can be serviced through the virtual queue method. Finally, the simulation results provided show that our proposed beam allocation scheme is beneficial in terms of increasing the communication rate.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information Science and Technology, Nantong University, Nantong 226019, China.
- School of Transportation and Civil Engineering, Nantong University, Nantong 226019, China.
ORCID-Profile: Xi Yao, Yingdong Hu, Yicheng Xu, Ruifeng Gao
Förderung
- Jiangsu Provincial Higher Education Institutions General Program of Basic Science Research
- Fujian Province Special Fund Project for Promoting High-Quality Development of Marine and Fisheries Industries
- the Natural Science Foundation of Nantong
- Natural Science Foundation of Nantong
Zitieren
APA
Yao, X., Hu, Y., Xu, Y., & Gao, R. (2024). Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems. Sensors, 24(7), 2247. https://doi.org/10.3390/s24072247
Vancouver
Yao X, Hu Y, Xu Y, Gao R. Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems. Sensors. 2024;24(7):2247. doi:10.3390/s24072247
BibTeX
@article{Yao2024,
author = {Yao, Xi and Hu, Yingdong and Xu, Yicheng and Gao, Ruifeng},
title = {Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems},
journal = {Sensors},
year = {2024},
volume = {24},
number = {7},
pages = {2247},
doi = {10.3390/s24072247}
}
EUVIMED