EUVIMEDAtklāt EUVIMED
Open access · CC BY 4.0

Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints

Yan Chen iD, Huan Cao, Longhe Wang, Daojin Chen, Zifan Liu iD, Yiqing Zhou, Jinglin Shi

Sensors · 2025-02-18 · 25 (4) · 1232

DOI: 10.3390/s25041232 ↗

At a glance

Journal article in Sensors, published online on 2025-02-18. Written by Yan Chen and 6 co-authors. Institution: University of Chinese Academy of Sciences, Beijing 100049, China. Cited 30 times so far (Crossref); 54 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Key Research and Development Program of China, Jiangsu Key Research and Development Program.

AbstraktsSubjectsBibliogrāfiskie datiCiteRelated studies

Abstract (original language)

Low-orbit satellite communication networks have gradually become the research focus of fifth-generation (5G) beyond and sixth generation (6G) networks due to their advantages of wide coverage, large communication capacity, and low terrain influence. However, the low earth orbit mega satellite network (LEO-MSN) also has difficulty in constructing stable traffic transmission paths, network load imbalance and congestion due to the large scale of network nodes, a highly complex topology, and uneven distribution of traffic flow in time and space. In the service-based architecture proposed by 3GPP, the introduction of service function chain (SFC) constraints exacerbates these challenges. Therefore, in this paper, we propose GDRL-SFCR, an end-to-end routing decision method based on graph neural network (GNN) and deep reinforcement learning (DRL) which jointly optimize the end-to-end transmission delay and network load balancing under SFC constraints. Specifically, this method constructs the system model based on the latest NTN low-orbit satellite network end-to-end transmission architecture, taking into account the SFC constraints, transmission delays, and network node loads in the end-to-end traffic transmission, uses a GNN to extract node attributes and dynamic topology features, and uses the DRL method to design specific reward functions to train the model to learn routing policies that satisfy the SFC constraints. The simulation results demonstrate that, compared with graph theory-based methods and reinforcement learning-based methods, GDRL-SFCR can reduce the end-to-end traffic transmission delay by more than 11.3%, reduce the average network load by more than 14.1%, and increase the traffic access success rate and network capacity by more than 19.1% and two times, respectively.

Subjects

Author keywords

LEO satellite networkdeep reinforcement learninggraph convolution networkroutingservice function constraints

Authors and institutions

  • University of Chinese Academy of Sciences, Beijing 100049, China.
  • State Key Laboratory of Processors, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China.
  • Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China.
  • Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing 100190, China.
  • Nanjing Mobile Communication and Computing Innovation Institute, Chinese Academy of Sciences, Nanjing 211135, China.

ORCID profiles: Yan Chen, Zifan Liu

Funding

  • National Key Research and Development Program of China
  • Jiangsu Key Research and Development Program

Cite

APA

Chen, Y., Cao, H., Wang, L., Chen, D., Liu, Z., Zhou, Y., & Shi, J. (2025). Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints. Sensors, 25(4), 1232. https://doi.org/10.3390/s25041232

Vancouver

Chen Y, Cao H, Wang L, Chen D, Liu Z, Zhou Y, et al. Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints. Sensors. 2025;25(4):1232. doi:10.3390/s25041232

BibTeX
@article{Chen2025,
  author = {Chen, Yan and Cao, Huan and Wang, Longhe and Chen, Daojin and Liu, Zifan and Zhou, Yiqing and Shi, Jinglin},
  title = {Deep Reinforcement Learning-Based Routing Method for Low Earth Orbit Mega-Constellation Satellite Networks with Service Function Constraints},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {4},
  pages = {1232},
  doi = {10.3390/s25041232}
}
Start for free →