Deep Reinforcement Multiagent Learning Framework for Information Gathering with Local Gaussian Processes for Water Monitoring
Advanced Intelligent Systems · 2024-08 · 6 (8)
DOI: 10.1002/aisy.202300850 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 26.04.2024. Verfasst von Samuel Yanes Luis und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agencia Estatal de Investigación.
Abstract (Originalsprache)
The conservation of hydrological resources involves continuously monitoring their contamination. A multiagent system composed of autonomous surface vehicles is proposed herein to efficiently monitor the water quality. To achieve a safe control of the fleet, the fleet policy should be able to act based on measurements and fleet state. It is proposed to use local Gaussian processes and deep reinforcement learning to jointly obtain effective monitoring policies. Local Gaussian processes, unlike classical global Gaussian processes, can accurately model the information in a dissimilar spatial correlation which captures more accurately the water quality information. A deep convolutional policy is proposed, that bases the decisions on the observation on the mean and variance of this model, by means of an information gain reward. Using a double deep Q‐learning algorithm, agents are trained to minimize the estimation error in a safe manner thanks to a Consensus‐based heuristic. Simulation results indicate an improvement of up to 24% in terms of the mean absolute error with the proposed models. Also, training results with 1–3 agents indicate that our proposed approach returns 20% and 24% smaller average estimation errors for, respectively, monitoring water quality variables and monitoring algae blooms, as compared to state‐of‐the‐art approaches.
Förderung
- Agencia Estatal de Investigación
Zitieren
APA
Luis, S. Y., Shutin, D., Gómez, J. M., Reina, D. G., & Marín, S. T. (2024). Deep Reinforcement Multiagent Learning Framework for Information Gathering with Local Gaussian Processes for Water Monitoring. Advanced Intelligent Systems, 6(8). https://doi.org/10.1002/aisy.202300850
Vancouver
Luis SY, Shutin D, Gómez JM, Reina DG, Marín ST. Deep Reinforcement Multiagent Learning Framework for Information Gathering with Local Gaussian Processes for Water Monitoring. Advanced Intelligent Systems. 2024;6(8). doi:10.1002/aisy.202300850
BibTeX
@article{Luis2024,
author = {Luis, Samuel Yanes and Shutin, Dmitriy and Gómez, Juan Marchal and Reina, Daniel Gutiérrez and Marín, Sergio Toral},
title = {Deep Reinforcement Multiagent Learning Framework for Information Gathering with Local Gaussian Processes for Water Monitoring},
journal = {Advanced Intelligent Systems},
year = {2024},
volume = {6},
number = {8},
doi = {10.1002/aisy.202300850}
}
EUVIMED