EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An LEO Constellation Early Warning System Decision-Making Method Based on Hierarchical Reinforcement Learning

Yu Cheng, Cheng Wei, Shengxin Sun, Bindi You, Yang Zhao

Sensors · 16.02.2023 · 23 (4) · 2225

DOI: 10.3390/s23042225 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 16.02.2023. Verfasst von Yu Cheng und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Aeronautics, Harbin Institute of Technology, Harbin 150006, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The Open Fund of National Defense Key Discipline Laboratory of Micro-Spacecraft Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The cooperative positioning problem of hypersonic vehicles regarding LEO constellations is the focus of this research study on space-based early warning systems. A hypersonic vehicle is highly maneuverable, and its trajectory is uncertain. New challenges are posed for the cooperative positioning capability of the constellation. In recent years, breakthroughs in artificial intelligence technology have provided new avenues for collaborative multi-satellite intelligent autonomous decision-making technology. This paper addresses the problem of multi-satellite cooperative geometric positioning for hypersonic glide vehicles (HGVs) by the LEO-constellation-tracking system. To exploit the inherent advantages of hierarchical reinforcement learning in intelligent decision making while satisfying the constraints of cooperative observations, an autonomous intelligent decision-making algorithm for satellites that incorporates a hierarchical proximal policy optimization with random hill climbing (MAPPO-RHC) is designed. On the one hand, hierarchical decision making is used to reduce the solution space; on the other hand, it is used to maximize the global reward and to uniformly distribute satellite resources. The single-satellite local search method improves the capability of the decision-making algorithm to search the solution space based on the decision-making results of the hierarchical proximal policy-optimization algorithm, combining both random hill climbing and heuristic methods. Finally, the MAPPO-RHC algorithm’s coverage and positioning accuracy performance is simulated and analyzed in two different scenarios and compared with four intelligent satellite decision-making algorithms that have been studied in recent years. From the simulation results, the decision-making results of the MAPPO-RHC algorithm can obtain more balanced resource allocations and higher geometric positioning accuracy. Thus, it is concluded that the MAPPO-RHC algorithm provides a feasible solution for the real-time decision-making problem of the LEO constellation early warning system.

Schlagwörter

Stichwörter der Autor:innen

LEO constellation early warning systemhierarchical policyhypersonic vehiclesintelligent decision-making algorithmmulti-agent proximal policy optimization

Autor:innen und Institutionen

  • School of Aeronautics, Harbin Institute of Technology, Harbin 150006, China.

Förderung

  • The Open Fund of National Defense Key Discipline Laboratory of Micro-Spacecraft Technology

Zitieren

APA

Cheng, Y., Wei, C., Sun, S., You, B., & Zhao, Y. (2023). An LEO Constellation Early Warning System Decision-Making Method Based on Hierarchical Reinforcement Learning. Sensors, 23(4), 2225. https://doi.org/10.3390/s23042225

Vancouver

Cheng Y, Wei C, Sun S, You B, Zhao Y. An LEO Constellation Early Warning System Decision-Making Method Based on Hierarchical Reinforcement Learning. Sensors. 2023;23(4):2225. doi:10.3390/s23042225

BibTeX
@article{Cheng2023,
  author = {Cheng, Yu and Wei, Cheng and Sun, Shengxin and You, Bindi and Zhao, Yang},
  title = {An LEO Constellation Early Warning System Decision-Making Method Based on Hierarchical Reinforcement Learning},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {4},
  pages = {2225},
  doi = {10.3390/s23042225}
}
Kostenlos starten →