Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation
Sensors · 10.03.2025 · 25 (6) · 1707
DOI: 10.3390/s25061707 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 10.03.2025. Verfasst von Peiyan Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Aeronautics and Astronautics, Zhejiang University, Hangzhou 310027, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shanghai Aerospace Science and Technology Innovation Fund.
Abstract (Originalsprache)
With the rapid increase in the number of Earth Observation Satellites (EOSs), research on autonomous mission scheduling has become increasingly critical for optimizing satellite sensor operations. While most existing studies focus on static environments or initial planning states, few address the challenge of dynamic request replanning for real-time sensor management. In this paper, we tackle the problem of multi-satellite rapid mission replanning under dynamic batch-arrival observation requests. The objective is to maximize overall observation revenue while minimizing disruptions to the original scheme. We propose a framework that integrates stochastic master-satellite mission allocation with single-satellite replanning, supported by reactive scheduling policies trained via deep reinforcement learning. Our approach leverages mission sequence modeling with attention mechanisms and time-attitude-aware rotary positional encoding to guide replanning. Additionally, scalable embeddings are employed to handle varying volumes of dynamic requests. The mission allocation phase efficiently generates assignment solutions using a pointer network, while the replanning phase introduces a hybrid action space for direct task insertion. Both phases are formulated as Markov Decision Processes (MDPs) and optimized using the PPO algorithm. Extensive simulations demonstrate that our method significantly outperforms state-of-the-art approaches, achieving a 15.27% higher request insertion revenue rate and a 3.05% improvement in overall mission revenue rate, while maintaining a 1.17% lower modification rate and achieving faster computational speeds. This demonstrates the effectiveness of our approach in real-world satellite sensor applications.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Aeronautics and Astronautics, Zhejiang University, Hangzhou 310027, China.
Förderung
- Shanghai Aerospace Science and Technology Innovation Fund
Zitieren
APA
Li, P., Cui, P., & Wang, H. (2025). Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation. Sensors, 25(6), 1707. https://doi.org/10.3390/s25061707
Vancouver
Li P, Cui P, Wang H. Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation. Sensors. 2025;25(6):1707. doi:10.3390/s25061707
BibTeX
@article{Li2025,
author = {Li, Peiyan and Cui, Peixing and Wang, Huiquan},
title = {Mission Sequence Model and Deep Reinforcement Learning-Based Replanning Method for Multi-Satellite Observation},
journal = {Sensors},
year = {2025},
volume = {25},
number = {6},
pages = {1707},
doi = {10.3390/s25061707}
}
EUVIMED