EUVIMEDEUVIMED entdecken
Crossref

Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method

Dongfang Li, Rong Hu, Yilong Zhang, Rob Law, Zhezhuang Xu, Suet To, Edmond Q. Wu, Limin Zhu

IEEE Transactions on Industrial Informatics · 2026-07 · 22 (7) · 5864-5875

DOI: 10.1109/tii.2026.3672669 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Industrial Informatics, 2026-07. Verfasst von Dongfang Li und 7 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Xiangjiang Program, Fujian Provincial Natural Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Series Snake robots possess strong adaptability for unstructured environments, but their trajectory tracking control is hindered by nonlinear dynamics and model uncertainties. This article proposes an optimal tracking control strategy based on an actor–critic reinforcement learning framework. The method integrates line-of-sight guidance with serpentine gait generation, while a neural network identification system approximates the solution of the Hamilton–Jacobi–Bellman equation for unknown dynamics. Actor and critic networks are employed to update control policies and cost functions online, reducing dependence on precise models. Rigorous theoretical analysis proves that position and velocity errors achieve semi-global uniform ultimate boundedness. Both simulations and prototype experiments were conducted based on a servo-driven yaw-pitch linkage alternating series snake robot. The results verify that the proposed method can achieve accurate trajectory tracking, rapid convergence, and stable joint control, demonstrating its effectiveness and superiority compared to existing methods.

Förderung

  • National Natural Science Foundation of China
  • Xiangjiang Program
  • Fujian Provincial Natural Science Foundation

Zitieren

APA

Li, D., Hu, R., Zhang, Y., Law, R., Xu, Z., To, S., Wu, E. Q., & Zhu, L. (2026). Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method. IEEE Transactions on Industrial Informatics, 22(7), 5864-5875. https://doi.org/10.1109/tii.2026.3672669

Vancouver

Li D, Hu R, Zhang Y, Law R, Xu Z, To S, et al. Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method. IEEE Transactions on Industrial Informatics. 2026;22(7):5864-5875. doi:10.1109/tii.2026.3672669

BibTeX
@article{Li2026,
  author = {Li, Dongfang and Hu, Rong and Zhang, Yilong and Law, Rob and Xu, Zhezhuang and To, Suet and Wu, Edmond Q. and Zhu, Limin},
  title = {Actor-Critic Framework-Based on Optimal Tracking Strategy for Snake Robots with Reinforcement Learning Method},
  journal = {IEEE Transactions on Industrial Informatics},
  year = {2026},
  volume = {22},
  number = {7},
  pages = {5864--5875},
  doi = {10.1109/tii.2026.3672669}
}
Kostenlos starten →