Data-Driven Surrogate Pretraining and Policy Transfer for Rotary Inverted Pendulum Control: A Gazebo-Based Study
Machines · 12.11.2026 · 14 (11) · 1340
DOI: 10.3390/machines14111340 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machines, online erschienen am 12.11.2026. Verfasst von Gyeongdong Lee und 3 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea, Korea Institute of Energy Technology Evaluation and Planning.
Abstract (Originalsprache)
Learning control policies for underactuated systems can require extensive interaction with a physics simulator. This paper presents a unified surrogate-to-simulator policy-initialization framework for rotary inverted pendulum control. A mixed dataset of policy-driven and structured excitation signals, comprising more than 2.5 million transitions from 3000 Gazebo episodes, was used to train an action-conditioned long short-term memory (LSTM) dynamics surrogate. The learned four-state predictor achieved R2 values of 0.98, 0.96, 0.95, and 0.97 for motor angle, motor angular velocity, pendulum angle, and pendulum angular velocity, respectively, under the reported evaluation protocol. The surrogate was embedded as an interactive Soft Actor–Critic (SAC) environment for actor and value-estimation pretraining, followed by network transfer and fine-tuning in Gazebo. A quadratic regulation reward with a 10-point step reference yields a theoretical episodic upper bound of 10,000 over 1000 steps. The recorded Gazebo learning histories show earlier high-return episodes after surrogate pretraining than during training from scratch. The central contribution is an integrated controller-development method that links sequence-based system identification, learned-environment policy optimization, and target-simulator adaptation.
Förderung
- National Research Foundation of Korea
- Korea Institute of Energy Technology Evaluation and Planning
Zitieren
APA
Lee, G., Kim, J., Cho, M., & Shim, J. (2026). Data-Driven Surrogate Pretraining and Policy Transfer for Rotary Inverted Pendulum Control: A Gazebo-Based Study. Machines, 14(11), 1340. https://doi.org/10.3390/machines14111340
Vancouver
Lee G, Kim J, Cho M, Shim J. Data-Driven Surrogate Pretraining and Policy Transfer for Rotary Inverted Pendulum Control: A Gazebo-Based Study. Machines. 2026;14(11):1340. doi:10.3390/machines14111340
BibTeX
@article{Lee2026,
author = {Lee, Gyeongdong and Kim, Junhyung and Cho, Migyung and Shim, Jaesool},
title = {Data-Driven Surrogate Pretraining and Policy Transfer for Rotary Inverted Pendulum Control: A Gazebo-Based Study},
journal = {Machines},
year = {2026},
volume = {14},
number = {11},
pages = {1340},
doi = {10.3390/machines14111340}
}
EUVIMED