Reinforcement learning-based trajectory tracking optimal control of unmanned surface vehicles in narrow water areas
ISA Transactions · 2025-04 · 159 · 152-164
DOI: 10.1016/j.isatra.2025.01.045 ↗Kurz gefasst
Fachartikel in der Zeitschrift ISA Transactions, 2025-04. Verfasst von Ziping Wei und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Marine Electrical Engineering, Dalian Maritime University, Dalian 116026, China. Electronic address: zpw@dlmu.edu.cn. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 59 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, National Natural Science Foundation of China.
Abstract (Originalsprache)
For unmanned surface vehicles (USVs) navigating in narrow water areas in the presence of unknown dynamics and ocean environmental disturbances, this paper develops a reinforcement learning (RL)-based optimal control scheme for the trajectory tracking of USVs under motion state constraints. A nonlinear map is introduced to transform constrained motion state errors into bounded transformed errors, and then the motion state-constrained trajectory tracking problem of USVs is equivalently transformed into a boundedness problem of the transformed errors. Furthermore, an actor-critic framework is developed by utilizing adaptive neural networks (NNs). Within the actor-critic framework, a novel weight update law is designed for the critic NN by combining the gradient descent approach and the concurrent learning technology, thereby relaxing the persistent excitation condition required for adaptive critic NN weight updates. Subsequently, a disturbance compensator is designed and combined with the actor-critic framework to learn the trajectory tracking optimal control law for USVs in the presence of unknown dynamics and disturbances. Finally, theoretical analyses prove that the developed control scheme guarantees the boundedness of all signals in the USV closed-loop trajectory tracking control system, and simulation results show that the developed control scheme can make USVs track the desired trajectory in narrow water areas while reducing the energy consumption by approximately 14.6 % compared with an existing controller.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Marine Electrical Engineering, Dalian Maritime University, Dalian 116026, China. Electronic address: zpw@dlmu.edu.cn.
- School of Marine Electrical Engineering, Dalian Maritime University, Dalian 116026, China. Electronic address: dujl@dlmu.edu.cn.
Förderung
- Fundamental Research Funds for the Central Universities
- National Natural Science Foundation of China
Zitieren
APA
Wei, Z., & Du, J. (2025). Reinforcement learning-based trajectory tracking optimal control of unmanned surface vehicles in narrow water areas. ISA Transactions, 159, 152-164. https://doi.org/10.1016/j.isatra.2025.01.045
Vancouver
Wei Z, Du J. Reinforcement learning-based trajectory tracking optimal control of unmanned surface vehicles in narrow water areas. ISA Transactions. 2025;159:152-164. doi:10.1016/j.isatra.2025.01.045
BibTeX
@article{Wei2025,
author = {Wei, Ziping and Du, Jialu},
title = {Reinforcement learning-based trajectory tracking optimal control of unmanned surface vehicles in narrow water areas},
journal = {ISA Transactions},
year = {2025},
volume = {159},
pages = {152--164},
doi = {10.1016/j.isatra.2025.01.045}
}
EUVIMED