Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum
Actuators · 18.11.2026 · 15 (11) · 612
DOI: 10.3390/act15110612 ↗Kurz gefasst
Fachartikel in der Zeitschrift Actuators, online erschienen am 18.11.2026. Verfasst von Penghui Li und 2 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Science and Technology Project of Hebei Education Department, Youth Talent Program Supported by China Railway Society.
Abstract (Originalsprache)
Proportional valve-controlled cylinders are the most widely used and most representative electro-hydraulic drives. This paper considers such a drive moving an inverted pendulum on a cart: one controller must swing the pendulum up, stabilize it, and track a cart reference, while the valve flow is nonlinear and the three tasks compete for the same valve. A single reinforcement learning (RL) policy based on deep deterministic policy gradient (DDPG) performs all three tasks. During training, a gated, state-dependent reward weighting shifts the emphasis from pendulum stabilization to cart tracking once the pendulum has been captured. In simulation, the controller is compared with a staged energy-based swing-up and linear quadratic regulator (LQR) baseline and with an RL controller trained with fixed reward weights. The proposed controller swings the pendulum up in 2.0 s instead of 4.7 s and completes a 0.5 m/s reference at which both comparison controllers reach the end stop. It also tracks more accurately than the fixed-weight controller, and without the gate the training does not balance the pendulum at all. The costs are a constant tracking offset of 10 mm, more valve motion, and a larger pendulum excursion than the baseline under an external force.
Förderung
- National Natural Science Foundation of China
- Science and Technology Project of Hebei Education Department
- Youth Talent Program Supported by China Railway Society
Zitieren
APA
Li, P., Helian, B., & Lyu, L. (2026). Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum. Actuators, 15(11), 612. https://doi.org/10.3390/act15110612
Vancouver
Li P, Helian B, Lyu L. Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum. Actuators. 2026;15(11):612. doi:10.3390/act15110612
BibTeX
@article{Li2026,
author = {Li, Penghui and Helian, Bobo and Lyu, Litong},
title = {Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum},
journal = {Actuators},
year = {2026},
volume = {15},
number = {11},
pages = {612},
doi = {10.3390/act15110612}
}
EUVIMED