Improving Robustness of Autonomous Earth-Observing Spacecraft Using Training Environment Enhancements
Journal of Aerospace Information Systems · 2026-03 · 23 (3) · 293-304
DOI: 10.2514/1.i011697 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Aerospace Information Systems, 2026-03. Verfasst von Lorenzzo Quevedo Mantovani und 1 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: Air Force Research Laboratory.
Abstract (Originalsprache)
Recent research is developing autonomous policies for agile Earth-observing satellite (AEOS) tasking using deep reinforcement learning (DRL). Prior work uses a fixed training environment with enhanced safety challenges to allow DRL to train a policy over a short number of orbits. This paper investigates how training environment enhancements can improve these policies’ robustness by varying the training environment and extending simulated mission times. DRL enables real-time, onboard decision-making while accounting for complex dynamics and constraints. However, policies often struggle to generalize to longer missions or conditions different from training, partly due to the short simulated mission times. Multi-spacecraft systems amplify these challenges, where battery capacity and solar panel efficiency diverge over time due to external factors. Although satellites might run copies of a single policy, its robustness is essential to accommodate agent variability and ensure mission success. This paper investigates training with two curricula, constantly degraded environments, and a domain randomization approach to improve AEOS policy robustness and performance. Policies are tested on episodes 125-times longer than training episodes under nominal and degraded conditions. The proposed training environment enhancements’ applicability is demonstrated in a heterogeneous spacecraft system, achieving a 63% reduction in failures and a 2.8% increase in median cumulative reward.
Förderung
- Air Force Research Laboratory
Zitieren
APA
Mantovani, L. Q., & Schaub, H. (2026). Improving Robustness of Autonomous Earth-Observing Spacecraft Using Training Environment Enhancements. Journal of Aerospace Information Systems, 23(3), 293-304. https://doi.org/10.2514/1.i011697
Vancouver
Mantovani LQ, Schaub H. Improving Robustness of Autonomous Earth-Observing Spacecraft Using Training Environment Enhancements. Journal of Aerospace Information Systems. 2026;23(3):293-304. doi:10.2514/1.i011697
BibTeX
@article{Mantovani2026,
author = {Mantovani, Lorenzzo Quevedo and Schaub, Hanspeter},
title = {Improving Robustness of Autonomous Earth-Observing Spacecraft Using Training Environment Enhancements},
journal = {Journal of Aerospace Information Systems},
year = {2026},
volume = {23},
number = {3},
pages = {293--304},
doi = {10.2514/1.i011697}
}
EUVIMED