EUVIMEDEUVIMED entdecken
Crossref

Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit

Hao Lu, Zhuo Wang, Guiqiang Bai, Hongde Qin, Wucan Yang

IEEE Internet of Things Journal · 15.06.2026 · 13 (12) · 26709-26729

DOI: 10.1109/jiot.2026.3677059 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 15.06.2026. Verfasst von Hao Lu und 4 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of China Youth Fund Project, Shenzhen Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In Internet of Underwater Things (IoUT) environments, cooperative pursuit of highly maneuverable unidentified underwater vehicles (U-UUVs) by multiple autonomous underwater vehicles (AUVs) remains a fundamental challenge due to uncertainty and adversarial behaviors. To address this problem, we propose a cooperative pursuit framework with centralized training and decentralized execution for IoUT systems. Within this framework, a brain-inspired hierarchical memory distributional soft actor–critic (BAC) algorithm is developed. Multiple AUVs are modeled as intelligent IoUT nodes that are trained via reinforcement learning (RL) to learn policies from local observations and achieve policy coordination. To cope with environmental nonstationarity, a hierarchical memory mechanism and safety-constrained policy optimization are incorporated to improve learning stability, sample efficiency, and operational safety under complex seabed terrain and time-varying ocean currents. Theoretical analysis establishes conditional results on policy improvement and optimality for the corresponding constrained formulation under the stated assumptions. Hardware-in-the-loop simulations with realistic bathymetry and ocean currents demonstrate that the proposed method significantly outperforms baseline approaches, reducing pursuit time.

Förderung

  • National Natural Science Foundation of China
  • National Natural Science Foundation of China Youth Fund Project
  • Shenzhen Science and Technology Program
  • Stable Supporting Fund of the National Key Laboratory of Autonomous Marine Vehicle Technology
  • National Key Research and Development Program of China

Zitieren

APA

Lu, H., Wang, Z., Bai, G., Qin, H., & Yang, W. (2026). Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit. IEEE Internet of Things Journal, 13(12), 26709-26729. https://doi.org/10.1109/jiot.2026.3677059

Vancouver

Lu H, Wang Z, Bai G, Qin H, Yang W. Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit. IEEE Internet of Things Journal. 2026;13(12):26709-26729. doi:10.1109/jiot.2026.3677059

BibTeX
@article{Lu2026,
  author = {Lu, Hao and Wang, Zhuo and Bai, Guiqiang and Qin, Hongde and Yang, Wucan},
  title = {Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit},
  journal = {IEEE Internet of Things Journal},
  year = {2026},
  volume = {13},
  number = {12},
  pages = {26709--26729},
  doi = {10.1109/jiot.2026.3677059}
}
Kostenlos starten →