Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints
Sensors · 2025-02-18 · 25 (4) · 1232
DOI: 10.3390/s25041232 ↗At a glance
Journal article in Sensors, published online on 2025-02-18. Written by Yan Chen and 6 co-authors. Institution: University of Chinese Academy of Sciences, Beijing 100049, China. Cited 30 times so far (Crossref); 54 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Key Research and Development Program of China, Jiangsu Key Research and Development Program.
Abstract (original language)
Low-orbit satellite communication networks have gradually become the research focus of fifth-generation (5G) beyond and sixth generation (6G) networks due to their advantages of wide coverage, large communication capacity, and low terrain influence. However, the low earth orbit mega satellite network (LEO-MSN) also has difficulty in constructing stable traffic transmission paths, network load imbalance and congestion due to the large scale of network nodes, a highly complex topology, and uneven distribution of traffic flow in time and space. In the service-based architecture proposed by 3GPP, the introduction of service function chain (SFC) constraints exacerbates these challenges. Therefore, in this paper, we propose GDRL-SFCR, an end-to-end routing decision method based on graph neural network (GNN) and deep reinforcement learning (DRL) which jointly optimize the end-to-end transmission delay and network load balancing under SFC constraints. Specifically, this method constructs the system model based on the latest NTN low-orbit satellite network end-to-end transmission architecture, taking into account the SFC constraints, transmission delays, and network node loads in the end-to-end traffic transmission, uses a GNN to extract node attributes and dynamic topology features, and uses the DRL method to design specific reward functions to train the model to learn routing policies that satisfy the SFC constraints. The simulation results demonstrate that, compared with graph theory-based methods and reinforcement learning-based methods, GDRL-SFCR can reduce the end-to-end traffic transmission delay by more than 11.3%, reduce the average network load by more than 14.1%, and increase the traffic access success rate and network capacity by more than 19.1% and two times, respectively.
Subjects
Author keywords
Authors and institutions
- University of Chinese Academy of Sciences, Beijing 100049, China.
- State Key Laboratory of Processors, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China.
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China.
- Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing 100190, China.
- Nanjing Mobile Communication and Computing Innovation Institute, Chinese Academy of Sciences, Nanjing 211135, China.
Funding
- National Key Research and Development Program of China
- Jiangsu Key Research and Development Program
Cite
APA
Chen, Y., Cao, H., Wang, L., Chen, D., Liu, Z., Zhou, Y., & Shi, J. (2025). Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints. Sensors, 25(4), 1232. https://doi.org/10.3390/s25041232
Vancouver
Chen Y, Cao H, Wang L, Chen D, Liu Z, Zhou Y, et al. Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints. Sensors. 2025;25(4):1232. doi:10.3390/s25041232
BibTeX
@article{Chen2025,
author = {Chen, Yan and Cao, Huan and Wang, Longhe and Chen, Daojin and Liu, Zifan and Zhou, Yiqing and Shi, Jinglin},
title = {Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints},
journal = {Sensors},
year = {2025},
volume = {25},
number = {4},
pages = {1232},
doi = {10.3390/s25041232}
}
EUVIMED