Path Planning for USVs in Complex Marine Environments Based on an Improved Hybrid TD3 Algorithm
Sensors · 13.03.2026 · 26 (6) · 1823
DOI: 10.3390/s26061823 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 13.03.2026. Verfasst von Zhenxing Zhang und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Technology, Zhejiang University of Science and Technology, Hangzhou 310023, China. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Real-time path planning for Unmanned Surface Vehicles (USVs) in complex marine environments remains challenging due to unstructured environments, ocean current disturbances, and dynamic obstacles. This paper proposes an improved Hybrid Safety and Reward-Sensitive Twin Delayed Deep Deterministic Policy Gradient (H_RS_TD3) algorithm and constructs a high-fidelity simulation environment based on GEBCO bathymetric data and CMEMS ocean current data. The path planning problem is formulated as a Markov Decision Process (MDP), where the state space incorporates multi-beam radar perception, ocean current disturbances, and relative goal information, while the action space outputs continuous thrust and rudder commands subject to vehicle dynamics constraints. The proposed framework integrates a risk-aware hybrid safety decision architecture, a Trajectory Predictor Network (TPN), a Curvature-driven Advantage-based Prioritized Experience Replay (CDA-PER) mechanism, and an uncertainty-aware conservative Q-learning strategy to enhance navigation safety, sample efficiency, and policy stability. Comprehensive simulations demonstrate that, compared with baseline deep reinforcement learning methods, the proposed approach achieves faster convergence, improved stability, and competitive path efficiency while consistently maintaining sufficient obstacle clearance and millisecond-level inference latency, validating its effectiveness and practical feasibility for safe USV navigation in realistic dynamic marine environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer Science and Technology, Zhejiang University of Science and Technology, Hangzhou 310023, China.
- School of Artificial Intelligence and Information Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China.
Zitieren
APA
Zhang, Z., Wang, X., Wang, Q., Zhu, M., & Feng, M. (2026). Path Planning for USVs in Complex Marine Environments Based on an Improved Hybrid TD3 Algorithm. Sensors, 26(6), 1823. https://doi.org/10.3390/s26061823
Vancouver
Zhang Z, Wang X, Wang Q, Zhu M, Feng M. Path Planning for USVs in Complex Marine Environments Based on an Improved Hybrid TD3 Algorithm. Sensors. 2026;26(6):1823. doi:10.3390/s26061823
BibTeX
@article{Zhang2026,
author = {Zhang, Zhenxing and Wang, Xiaohui and Wang, Qiujie and Zhu, Mingwei and Feng, Mingkun},
title = {Path Planning for USVs in Complex Marine Environments Based on an Improved Hybrid TD3 Algorithm},
journal = {Sensors},
year = {2026},
volume = {26},
number = {6},
pages = {1823},
doi = {10.3390/s26061823}
}
EUVIMED