Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method
IEEE Transactions on Industrial Informatics · 2026-07 · 22 (7) · 5864-5875
DOI: 10.1109/tii.2026.3672669 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Industrial Informatics, 2026-07. Verfasst von Dongfang Li und 7 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Xiangjiang Program, Fujian Provincial Natural Science Foundation.
Abstract (Originalsprache)
Series Snake robots possess strong adaptability for unstructured environments, but their trajectory tracking control is hindered by nonlinear dynamics and model uncertainties. This article proposes an optimal tracking control strategy based on an actor–critic reinforcement learning framework. The method integrates line-of-sight guidance with serpentine gait generation, while a neural network identification system approximates the solution of the Hamilton–Jacobi–Bellman equation for unknown dynamics. Actor and critic networks are employed to update control policies and cost functions online, reducing dependence on precise models. Rigorous theoretical analysis proves that position and velocity errors achieve semi-global uniform ultimate boundedness. Both simulations and prototype experiments were conducted based on a servo-driven yaw-pitch linkage alternating series snake robot. The results verify that the proposed method can achieve accurate trajectory tracking, rapid convergence, and stable joint control, demonstrating its effectiveness and superiority compared to existing methods.
Förderung
- National Natural Science Foundation of China
- Xiangjiang Program
- Fujian Provincial Natural Science Foundation
Zitieren
APA
Li, D., Hu, R., Zhang, Y., Law, R., Xu, Z., To, S., Wu, E. Q., & Zhu, L. (2026). Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method. IEEE Transactions on Industrial Informatics, 22(7), 5864-5875. https://doi.org/10.1109/tii.2026.3672669
Vancouver
Li D, Hu R, Zhang Y, Law R, Xu Z, To S, et al. Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method. IEEE Transactions on Industrial Informatics. 2026;22(7):5864-5875. doi:10.1109/tii.2026.3672669
BibTeX
@article{Li2026,
author = {Li, Dongfang and Hu, Rong and Zhang, Yilong and Law, Rob and Xu, Zhezhuang and To, Suet and Wu, Edmond Q. and Zhu, Limin},
title = {Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method},
journal = {IEEE Transactions on Industrial Informatics},
year = {2026},
volume = {22},
number = {7},
pages = {5864--5875},
doi = {10.1109/tii.2026.3672669}
}
EUVIMED