Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks
Sensors · 29.05.2023 · 23 (11) · 5180
DOI: 10.3390/s23115180 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 29.05.2023. Verfasst von Zhaolong Ding und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China. Hauptthemen laut MEDLINE: Computer Communication Networks, Algorithms. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Fast convergence routing is a critical issue for Low Earth Orbit (LEO) constellation networks because these networks have dynamic topology changes, and transmission requirements can vary over time. However, most of the previous research has focused on the Open Shortest Path First (OSPF) routing algorithm, which is not well-suited to handle the frequent changes in the link state of the LEO satellite network. In this regard, we propose a Fast-Convergence Reinforcement Learning Satellite Routing Algorithm (FRL–SR) for LEO satellite networks, where the satellite can quickly obtain the network link status and adjust its routing strategy accordingly. In FRL–SR, each satellite node is considered an agent, and the agent selects the appropriate port for packet forwarding based on its routing policy. Whenever the satellite network state changes, the agent sends “hello” packets to the neighboring nodes to update their routing policy. Compared to traditional reinforcement learning algorithms, FRL–SR can perceive network information faster and converge faster. Additionally, FRL–SR can mask the dynamics of the satellite network topology and adaptively adjust the forwarding strategy based on the link state. The experimental results demonstrate that the proposed FRL–SR algorithm outperforms the Dijkstra algorithm in the performance of average delay, packet arriving ratio, and network load balance.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China.
- Innovation Academy for Microsatellites of CAS, Shanghai 201304, China.
ORCID-Profile: Zijian Yang
Zitieren
APA
Ding, Z., Liu, H., Tian, F., Yang, Z., & Wang, N. (2023). Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks. Sensors, 23(11), 5180. https://doi.org/10.3390/s23115180
Vancouver
Ding Z, Liu H, Tian F, Yang Z, Wang N. Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks. Sensors. 2023;23(11):5180. doi:10.3390/s23115180
BibTeX
@article{Ding2023,
author = {Ding, Zhaolong and Liu, Huijie and Tian, Feng and Yang, Zijian and Wang, Nan},
title = {Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks},
journal = {Sensors},
year = {2023},
volume = {23},
number = {11},
pages = {5180},
doi = {10.3390/s23115180}
}
EUVIMED