Smart Underwater Pollution Detection Based on Graph-Based Multi-Agent Reinforcement Learning Towards AUV-Based Network ITS
IEEE Transactions on Intelligent Transportation Systems · 2023-07 · 24 (7) · 7494-7505
DOI: 10.1109/tits.2022.3162850 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-07. Verfasst von Chuan Lin und 4 weiteren Autor:innen. Die Arbeit wurde bisher 75-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Joint Funds of the National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
The exploitation/utilization of marine resources and the rapid development of urbanization along coastal cities result in serious marine pollution, especially underwater diffusion pollution. It is a non-trivial task to detect the source of diffusion pollution, such that the disadvantageous effect of the pollution can be reduced. With the vision of 6G framework, we employ Autonomous Underwater Vehicle (AUV) flock and introduce the concept of AUV-based network. In particular, we utilize the Software-Defined Networking (SDN) technique to update the controllability of the AUV-based network, leading to the paradigm of SDN-enabled multi-AUVs network Intelligent Transportation Systems (SDNA-ITS). For SDNA-ITS, we utilize artificial potential field theories to model the control model. To optimize the system output, we introduce the graph-based Soft Actor-Critic (SAC) algorithm, i.e., a category of Multi-Agent Reinforcement Learning (MARL) mechanism where each AUV can be regarded as a node in a graph. In particular, we improve the optimization model based on Centralized Training Decentralized Execution (CTDE) architecture with the assistance of the SDN controller, by which each AUV can efficiently adjust its speed towards the diffusion source. Further, to achieve exact path planning for detecting the diffusion source, a dynamic detection scheme is proposed to output the united control policy to schedule the SDNA-ITS dynamically. Simulation results demonstrate that our approaches are available to detect the underwater diffusion source when the actual scenario is taken into account and perform better than some recent research products.
Förderung
- National Natural Science Foundation of China
- Joint Funds of the National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- China Postdoctoral Science Foundation
- Taishan Scholar Project Funding
- Open Fund of the State Key Laboratory of Acoustics
Zitieren
APA
Lin, C., Han, G., Zhang, T., Shah, S. B. H., & Peng, Y. (2023). Smart Underwater Pollution Detection Based on Graph-Based Multi-Agent Reinforcement Learning Towards AUV-Based Network ITS. IEEE Transactions on Intelligent Transportation Systems, 24(7), 7494-7505. https://doi.org/10.1109/tits.2022.3162850
Vancouver
Lin C, Han G, Zhang T, Shah SBH, Peng Y. Smart Underwater Pollution Detection Based on Graph-Based Multi-Agent Reinforcement Learning Towards AUV-Based Network ITS. IEEE Transactions on Intelligent Transportation Systems. 2023;24(7):7494-7505. doi:10.1109/tits.2022.3162850
BibTeX
@article{Lin2023,
author = {Lin, Chuan and Han, Guangjie and Zhang, Tongwei and Shah, Syed Bilal Hussain and Peng, Yan},
title = {Smart Underwater Pollution Detection Based on Graph-Based Multi-Agent Reinforcement Learning Towards AUV-Based Network ITS},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2023},
volume = {24},
number = {7},
pages = {7494--7505},
doi = {10.1109/tits.2022.3162850}
}
EUVIMED