EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks

Zhaolong Ding, Huijie Liu, Feng Tian, Zijian Yang iD, Nan Wang

Sensors · 29.05.2023 · 23 (11) · 5180

DOI: 10.3390/s23115180 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 29.05.2023. Verfasst von Zhaolong Ding und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China. Hauptthemen laut MEDLINE: Computer Communication Networks, Algorithms. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fast convergence routing is a critical issue for Low Earth Orbit (LEO) constellation networks because these networks have dynamic topology changes, and transmission requirements can vary over time. However, most of the previous research has focused on the Open Shortest Path First (OSPF) routing algorithm, which is not well-suited to handle the frequent changes in the link state of the LEO satellite network. In this regard, we propose a Fast-Convergence Reinforcement Learning Satellite Routing Algorithm (FRL–SR) for LEO satellite networks, where the satellite can quickly obtain the network link status and adjust its routing strategy accordingly. In FRL–SR, each satellite node is considered an agent, and the agent selects the appropriate port for packet forwarding based on its routing policy. Whenever the satellite network state changes, the agent sends “hello” packets to the neighboring nodes to update their routing policy. Compared to traditional reinforcement learning algorithms, FRL–SR can perceive network information faster and converge faster. Additionally, FRL–SR can mask the dynamics of the satellite network topology and adaptively adjust the forwarding strategy based on the link state. The experimental results demonstrate that the proposed FRL–SR algorithm outperforms the Dijkstra algorithm in the performance of average delay, packet arriving ratio, and network load balance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Computer Communication NetworksAlgorithms

Stichwörter der Autor:innen

LEO satellite networksdistributed routingmulti-agent reinforcement learningsatellite routing

Autor:innen und Institutionen

  • School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China.
  • Innovation Academy for Microsatellites of CAS, Shanghai 201304, China.

ORCID-Profile: Zijian Yang

Zitieren

APA

Ding, Z., Liu, H., Tian, F., Yang, Z., & Wang, N. (2023). Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks. Sensors, 23(11), 5180. https://doi.org/10.3390/s23115180

Vancouver

Ding Z, Liu H, Tian F, Yang Z, Wang N. Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks. Sensors. 2023;23(11):5180. doi:10.3390/s23115180

BibTeX
@article{Ding2023,
  author = {Ding, Zhaolong and Liu, Huijie and Tian, Feng and Yang, Zijian and Wang, Nan},
  title = {Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {11},
  pages = {5180},
  doi = {10.3390/s23115180}
}
Kostenlos starten →