Deep Reinforcement Learning-Based Two-Phase Hybrid Optimization for Scheduling Agile Earth Observation Satellites
Remote Sensing · 06.06.2025 · 17 (12) · 1972
DOI: 10.3390/rs17121972 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 06.06.2025. Verfasst von Guanghui Zhou und 2 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Youth Innovation Promotion Association of Chinese Academy of Sciences.
Abstract (Originalsprache)
The multi-agile Earth observation satellite scheduling problem is challenging because of its large solution space and substantial task volume. This study generates observation schemes for static tasks over an execution period. To balance solution quality and computational efficiency, a deep reinforcement learning (DRL)-based algorithmic framework is proposed. A Markov decision process (MDP) is formulated as the foundational model for the DRL architecture. To mitigate problem complexity, the action space is decomposed into two interdependent decision layers: task sequencing and resource allocation. Given the resource occupation constraints during action execution, a novel reward function is designed by integrating resource occupation utility into the immediate reward mechanism. Corresponding to these dual decision layers, a Two-Phase Hybrid Optimization (TPHO) framework is developed. The task sequencing subproblem is addressed through an encoder–decoder architecture based on sequence-to-sequence learning. To preserve resource diversity throughout the scheduling horizon, a maximum residual capacity (MRC) heuristic is introduced. A comprehensive experimental suite is constructed, incorporating multi-satellite scheduling scenarios with capacity and temporal constraints. The experimental results demonstrate that the TPHO framework with MRC rules achieves superior performance, yielding a total reward improvement exceeding 16% compared with the A-ALNS algorithm in the most complex scenario involving 1200 tasks, yet requiring less than 3% of the computational duration of A-ALNS.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Youth Innovation Promotion Association of Chinese Academy of Sciences
Zitieren
APA
Zhou, G., Jin, Z., & Liu, D. (2025). Deep Reinforcement Learning-Based Two-Phase Hybrid Optimization for Scheduling Agile Earth Observation Satellites. Remote Sensing, 17(12), 1972. https://doi.org/10.3390/rs17121972
Vancouver
Zhou G, Jin Z, Liu D. Deep Reinforcement Learning-Based Two-Phase Hybrid Optimization for Scheduling Agile Earth Observation Satellites. Remote Sensing. 2025;17(12):1972. doi:10.3390/rs17121972
BibTeX
@article{Zhou2025,
author = {Zhou, Guanghui and Jin, Zhicheng and Liu, Dongning},
title = {Deep Reinforcement Learning-Based Two-Phase Hybrid Optimization for Scheduling Agile Earth Observation Satellites},
journal = {Remote Sensing},
year = {2025},
volume = {17},
number = {12},
pages = {1972},
doi = {10.3390/rs17121972}
}
EUVIMED