EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation

Peiyan Li, Peixing Cui, Huiquan Wang

Sensors · 10.03.2025 · 25 (6) · 1707

DOI: 10.3390/s25061707 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 10.03.2025. Verfasst von Peiyan Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Aeronautics and Astronautics, Zhejiang University, Hangzhou 310027, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shanghai Aerospace Science and Technology Innovation Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid increase in the number of Earth Observation Satellites (EOSs), research on autonomous mission scheduling has become increasingly critical for optimizing satellite sensor operations. While most existing studies focus on static environments or initial planning states, few address the challenge of dynamic request replanning for real-time sensor management. In this paper, we tackle the problem of multi-satellite rapid mission replanning under dynamic batch-arrival observation requests. The objective is to maximize overall observation revenue while minimizing disruptions to the original scheme. We propose a framework that integrates stochastic master-satellite mission allocation with single-satellite replanning, supported by reactive scheduling policies trained via deep reinforcement learning. Our approach leverages mission sequence modeling with attention mechanisms and time-attitude-aware rotary positional encoding to guide replanning. Additionally, scalable embeddings are employed to handle varying volumes of dynamic requests. The mission allocation phase efficiently generates assignment solutions using a pointer network, while the replanning phase introduces a hybrid action space for direct task insertion. Both phases are formulated as Markov Decision Processes (MDPs) and optimized using the PPO algorithm. Extensive simulations demonstrate that our method significantly outperforms state-of-the-art approaches, achieving a 15.27% higher request insertion revenue rate and a 3.05% improvement in overall mission revenue rate, while maintaining a 1.17% lower modification rate and achieving faster computational speeds. This demonstrates the effectiveness of our approach in real-world satellite sensor applications.

Schlagwörter

Stichwörter der Autor:innen

Agile Earth Observation Satellites (AEOSs)attention mechanismdeep reinforcement learningmission replanningmission sequence model

Autor:innen und Institutionen

  • School of Aeronautics and Astronautics, Zhejiang University, Hangzhou 310027, China.

Förderung

  • Shanghai Aerospace Science and Technology Innovation Fund

Zitieren

APA

Li, P., Cui, P., & Wang, H. (2025). Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation. Sensors, 25(6), 1707. https://doi.org/10.3390/s25061707

Vancouver

Li P, Cui P, Wang H. Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation. Sensors. 2025;25(6):1707. doi:10.3390/s25061707

BibTeX
@article{Li2025,
  author = {Li, Peiyan and Cui, Peixing and Wang, Huiquan},
  title = {Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {6},
  pages = {1707},
  doi = {10.3390/s25061707}
}
Kostenlos starten →