Model-Free Deep Reinforcement Learning for Adaptive Supply Temperature Control in Collective Space Heating Systems
ACM Transactions on Intelligent Systems and Technology · 30.04.2025 · 16 (2) · 1-31
DOI: 10.1145/3709010 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 18.02.2025. Verfasst von Sara Ghane und 6 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: PhD fellowship of the Research Foundation Flanders.
Abstract (Originalsprache)
The conventional approach for controlling the supply temperature in collective space heating networks relies on a predefined heating curve determined by outdoor temperature and heat emitter type. This prioritises thermal comfort but lacks energetic and financial optimisation. This research proposes an adaptive supply temperature control in well-insulated dwellings, responsive to diverse environmental parameters. The approach considers variable electricity prices and accommodates different indoor temperature set points in dwellings. The study evaluates the effectiveness of two Deep Reinforcement Learning (DRL) algorithms, i.e., Proximal Policy Optimisation (PPO) and Deep Q-Network (DQN), across various scenarios. Results reveal that DQN excels in collective space heating systems with underfloor heating in each dwelling, while PPO proves superior for radiator-based systems. Both outperform the traditional heating curve, achieving up to 13.77% (DQN) and 16.15% (PPO) cost reduction while guaranteeing thermal comfort. Additionally, the research highlights the capability of DRL-based methods to dynamically set the supply temperature based on a cloud of set points, showcasing adaptability to diverse environmental factors and addressing the growing significance of indoor heat gains in well-insulated dwellings. This innovative approach holds promise for more efficient and environmentally conscious heating strategies within collective space heating networks.
Förderung
- PhD fellowship of the Research Foundation Flanders
Zitieren
APA
Ghane, S., Jacobs, S., Huybrechts, T., Hellinckx, P., Mercelis, S., Verhaert, I., & Mannens, E. (2025). Model-Free Deep Reinforcement Learning for Adaptive Supply Temperature Control in Collective Space Heating Systems. ACM Transactions on Intelligent Systems and Technology, 16(2), 1-31. https://doi.org/10.1145/3709010
Vancouver
Ghane S, Jacobs S, Huybrechts T, Hellinckx P, Mercelis S, Verhaert I, et al. Model-Free Deep Reinforcement Learning for Adaptive Supply Temperature Control in Collective Space Heating Systems. ACM Transactions on Intelligent Systems and Technology. 2025;16(2):1-31. doi:10.1145/3709010
BibTeX
@article{Ghane2025,
author = {Ghane, Sara and Jacobs, Stef and Huybrechts, Thomas and Hellinckx, Peter and Mercelis, Siegfried and Verhaert, Ivan and Mannens, Erik},
title = {Model-Free Deep Reinforcement Learning for Adaptive Supply Temperature Control in Collective Space Heating Systems},
journal = {ACM Transactions on Intelligent Systems and Technology},
year = {2025},
volume = {16},
number = {2},
pages = {1--31},
doi = {10.1145/3709010}
}
EUVIMED