EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum

Penghui Li, Bobo Helian, Litong Lyu

Actuators · 18.11.2026 · 15 (11) · 612

DOI: 10.3390/act15110612 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Actuators, online erschienen am 18.11.2026. Verfasst von Penghui Li und 2 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Science and Technology Project of Hebei Education Department, Youth Talent Program Supported by China Railway Society.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Proportional valve-controlled cylinders are the most widely used and most representative electro-hydraulic drives. This paper considers such a drive moving an inverted pendulum on a cart: one controller must swing the pendulum up, stabilize it, and track a cart reference, while the valve flow is nonlinear and the three tasks compete for the same valve. A single reinforcement learning (RL) policy based on deep deterministic policy gradient (DDPG) performs all three tasks. During training, a gated, state-dependent reward weighting shifts the emphasis from pendulum stabilization to cart tracking once the pendulum has been captured. In simulation, the controller is compared with a staged energy-based swing-up and linear quadratic regulator (LQR) baseline and with an RL controller trained with fixed reward weights. The proposed controller swings the pendulum up in 2.0 s instead of 4.7 s and completes a 0.5 m/s reference at which both comparison controllers reach the end stop. It also tracks more accurately than the fixed-weight controller, and without the gate the training does not balance the pendulum at all. The costs are a constant tracking offset of 10 mm, more valve motion, and a larger pendulum excursion than the baseline under an external force.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Project of Hebei Education Department
  • Youth Talent Program Supported by China Railway Society

Zitieren

APA

Li, P., Helian, B., & Lyu, L. (2026). Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum. Actuators, 15(11), 612. https://doi.org/10.3390/act15110612

Vancouver

Li P, Helian B, Lyu L. Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum. Actuators. 2026;15(11):612. doi:10.3390/act15110612

BibTeX
@article{Li2026,
  author = {Li, Penghui and Helian, Bobo and Lyu, Litong},
  title = {Gated Reward Weighting for Single-Policy Reinforcement Learning Control of a Valve-Controlled Hydraulic Inverted Pendulum},
  journal = {Actuators},
  year = {2026},
  volume = {15},
  number = {11},
  pages = {612},
  doi = {10.3390/act15110612}
}
Kostenlos starten →