Hierarchical Reinforcement Learning Control of a Quadruple Tank Plant Under Partial Observability
IEEE Access · 2026 · 14 · 119748-119763
DOI: 10.1109/access.2026.3720885 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Alessandro Bozzi und 3 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: European Union - NextGenerationEU, Ministry of University and Research, National Recovery and Resilience Plan (NRRP), Mission 4, Component 2, Investment 1.5.
Abstract (Originalsprache)
Reinforcement learning (RL) has emerged as a promising paradigm for controlling nonlinear and highly coupled dynamical systems, particularly in scenarios where accurate models are difficult to obtain. This paper investigates architectural strategies for deploying deep reinforcement learning controllers in strongly coupled Systems of Systems under partial observability, using the Quadruple Tank Plant (QTP) as a benchmark case study. A centralized Deep Deterministic Policy Gradient controller is first trained with full state information and evaluated in simulation and on a real laboratory-scale QTP. The control problem is then decomposed into decentralized agents with limited local observations, which independently generate control proposals. To coordinate these decentralized decisions, a supervisory reinforcement learning agent is introduced, learning to fuse and minimally correct the agents’ proposals based on partial system measurements. The proposed hierarchical architecture enables effective control even in scenarios where subsystem objectives are locally feasible but globally conflicting. Experimental results in simulation and on real hardware demonstrate that the decentralized–supervised architecture can achieve comparable or improved aggregate tracking performance relative to a centralized policy, while preserving decentralized proposal generation and enabling execution-time supervisory coordination under partial observability. The results also show stable sim-to-real behavior in the presence of sensor noise, actuator delays, and modeling inaccuracies.
Förderung
- European Union - NextGenerationEU
- Ministry of University and Research
- National Recovery and Resilience Plan (NRRP), Mission 4, Component 2, Investment 1.5
Zitieren
APA
Bozzi, A., Aicardi, M., Zero, E., & Sacile, R. (2026). Hierarchical Reinforcement Learning Control of a Quadruple Tank Plant Under Partial Observability. IEEE Access, 14, 119748-119763. https://doi.org/10.1109/access.2026.3720885
Vancouver
Bozzi A, Aicardi M, Zero E, Sacile R. Hierarchical Reinforcement Learning Control of a Quadruple Tank Plant Under Partial Observability. IEEE Access. 2026;14:119748-119763. doi:10.1109/access.2026.3720885
BibTeX
@article{Bozzi2026,
author = {Bozzi, Alessandro and Aicardi, Matteo and Zero, Enrico and Sacile, Roberto},
title = {Hierarchical Reinforcement Learning Control of a Quadruple Tank Plant Under Partial Observability},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {119748--119763},
doi = {10.1109/access.2026.3720885}
}
EUVIMED