Disturbance Compensation-Based Deep Reinforcement Learning Control Strategy for Underactuated Overhead Crane Systems: Design and Experiments
IEEE Transactions on Intelligent Transportation Systems · 2025-04 · 26 (4) · 4380-4390
DOI: 10.1109/tits.2025.3547322 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-04. Verfasst von Panlong Tan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Technologies Research and Development Program of Tianjin.
Abstract (Originalsprache)
Transportation systems often exhibit uncertainty, dynamics, and nonlinearity, making them highly susceptible to perturbations. Overhead crane systems, being a crucial mode of transportation, find wide application in engineering practice. This paper proposes a compound control strategy for underactuated overhead crane systems, combining a deep reinforcement learning controller with a novel observer-based disturbance compensation algorithm. The aim is to suppress model uncertainties and external disturbances. Initially, an equivalent state variable is constructed to stabilize the overhead crane system, simplifying controller design. Subsequently, the model uncertainties and external disturbances are treated as generalized disturbances and incorporated as a new state. This state is estimated and compensated through a super-twisting extended state observer (STESO) with finite-time convergence. Lyapunov-based analysis demonstrates that the established state observer can reduce the residual estimate error to zero. Moreover, the Deep Deterministic Policy Gradient (DDPG) algorithm, a form of deep reinforcement learning, is employed to effectively eliminate tracking errors. The proposed scheme enables the underactuated system to achieve satisfactory performance, with adaptive control effort suited to different control states and disturbances. Simulation and hardware experiments are conducted, comparing the proposed control strategy with traditional methods, to illustrate its effectiveness and robustness.
Förderung
- National Natural Science Foundation of China
- Key Technologies Research and Development Program of Tianjin
Zitieren
APA
Tan, P., Liu, J., Sun, M., & Chen, Z. (2025). Disturbance Compensation-Based Deep Reinforcement Learning Control Strategy for Underactuated Overhead Crane Systems: Design and Experiments. IEEE Transactions on Intelligent Transportation Systems. https://doi.org/10.1109/tits.2025.3547322
Vancouver
Tan P, Liu J, Sun M, Chen Z. Disturbance Compensation-Based Deep Reinforcement Learning Control Strategy for Underactuated Overhead Crane Systems: Design and Experiments. IEEE Transactions on Intelligent Transportation Systems. 2025. doi:10.1109/tits.2025.3547322
BibTeX
@article{Tan2025,
author = {Tan, Panlong and Liu, Junjie and Sun, Mingwei and Chen, Zengqiang},
title = {Disturbance Compensation-Based Deep Reinforcement Learning Control Strategy for Underactuated Overhead Crane Systems: Design and Experiments},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
doi = {10.1109/tits.2025.3547322}
}
EUVIMED