Multi-agent cooperative control of a three-tank liquid system using reinforcement learning algorithms
International Journal of Applied Resilience and Sustainability · 06.04.2026 · 2 (2) · 1130-1145
DOI: 10.70593/deepsci.0202046 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Applied Resilience and Sustainability, online erschienen am 06.04.2026. Verfasst von Lincoln Nobert Munhenzwa und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This research paper aims to present a multi-agent cooperative reinforcement learning approach for controlling the highly nonlinear dynamics of a three-tank liquid system. Meaning to say the system’s complexity arises from the interdependence of the tanks, where precise control is required to maintain stable fluid levels. Initially, we deploy two twin-delayed deep deterministic policy Gradient agents to manage the inflow valves, then followed by two proximal policy optimization agents tasked with controlling the valves. The main goal is to compare the performance of these two models of agents against traditional proportional-integral-derivative controllers. In addition to promote effective collaboration between agents, a cooperative reward structure is implemented, encouraging agents to work together to maintain balanced fluid levels within all three tanks. The reward function penalizes deviations from target levels, accounting for both local performance and system-wide stability. The proposed method also addresses key challenges in multi-agent systems, such as non-stationarity and coordination in decentralized control, by integrating a centralized critic during training with decentralized execution. Experimental results reveal that the twin-delayed deep deterministic policy agents outperform the proportional integral derivative control system in terms of settling time, rise time, and robustness, showcasing their ability to handle the nonlinear nature of the system with minimal tuning.
Zitieren
APA
Munhenzwa, L. N., Kerboua, A., & Gotora, G. M. (2026). Multi-agent cooperative control of a three-tank liquid system using reinforcement learning algorithms. International Journal of Applied Resilience and Sustainability, 2(2), 1130-1145. https://doi.org/10.70593/deepsci.0202046
Vancouver
Munhenzwa LN, Kerboua A, Gotora GM. Multi-agent cooperative control of a three-tank liquid system using reinforcement learning algorithms. International Journal of Applied Resilience and Sustainability. 2026;2(2):1130-1145. doi:10.70593/deepsci.0202046
BibTeX
@article{Munhenzwa2026,
author = {Munhenzwa, Lincoln Nobert and Kerboua, Adlen and Gotora, Godfrey Murairidzi},
title = {Multi-agent cooperative control of a three-tank liquid system using reinforcement learning algorithms},
journal = {International Journal of Applied Resilience and Sustainability},
year = {2026},
volume = {2},
number = {2},
pages = {1130--1145},
doi = {10.70593/deepsci.0202046}
}
EUVIMED