Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit
IEEE Internet of Things Journal · 15.06.2026 · 13 (12) · 26709-26729
DOI: 10.1109/jiot.2026.3677059 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 15.06.2026. Verfasst von Hao Lu und 4 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of China Youth Fund Project, Shenzhen Science and Technology Program.
Abstract (Originalsprache)
In Internet of Underwater Things (IoUT) environments, cooperative pursuit of highly maneuverable unidentified underwater vehicles (U-UUVs) by multiple autonomous underwater vehicles (AUVs) remains a fundamental challenge due to uncertainty and adversarial behaviors. To address this problem, we propose a cooperative pursuit framework with centralized training and decentralized execution for IoUT systems. Within this framework, a brain-inspired hierarchical memory distributional soft actor–critic (BAC) algorithm is developed. Multiple AUVs are modeled as intelligent IoUT nodes that are trained via reinforcement learning (RL) to learn policies from local observations and achieve policy coordination. To cope with environmental nonstationarity, a hierarchical memory mechanism and safety-constrained policy optimization are incorporated to improve learning stability, sample efficiency, and operational safety under complex seabed terrain and time-varying ocean currents. Theoretical analysis establishes conditional results on policy improvement and optimality for the corresponding constrained formulation under the stated assumptions. Hardware-in-the-loop simulations with realistic bathymetry and ocean currents demonstrate that the proposed method significantly outperforms baseline approaches, reducing pursuit time.
Förderung
- National Natural Science Foundation of China
- National Natural Science Foundation of China Youth Fund Project
- Shenzhen Science and Technology Program
- Stable Supporting Fund of the National Key Laboratory of Autonomous Marine Vehicle Technology
- National Key Research and Development Program of China
Zitieren
APA
Lu, H., Wang, Z., Bai, G., Qin, H., & Yang, W. (2026). Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit. IEEE Internet of Things Journal, 13(12), 26709-26729. https://doi.org/10.1109/jiot.2026.3677059
Vancouver
Lu H, Wang Z, Bai G, Qin H, Yang W. Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit. IEEE Internet of Things Journal. 2026;13(12):26709-26729. doi:10.1109/jiot.2026.3677059
BibTeX
@article{Lu2026,
author = {Lu, Hao and Wang, Zhuo and Bai, Guiqiang and Qin, Hongde and Yang, Wucan},
title = {Brain-Inspired Hierarchical Memory Distributional Soft Actor–Critic for Cooperative Multi-Autonomous Vehicle Pursuit},
journal = {IEEE Internet of Things Journal},
year = {2026},
volume = {13},
number = {12},
pages = {26709--26729},
doi = {10.1109/jiot.2026.3677059}
}
EUVIMED