EUVIMEDEUVIMED entdecken
Crossref

A Safe and Data-Efficient Model-Based Reinforcement Learning System for HVAC Control

Xianzhong Ding, Zhiyu An, Arya Rathee, Wan Du

IEEE Internet of Things Journal · 01.04.2025 · 12 (7) · 8014-8032

DOI: 10.1109/jiot.2025.3540402 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.04.2025. Verfasst von Xianzhong Ding und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 64 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Model-based reinforcement learning (MBRL) is widely studied for heating, ventilation, and air conditioning (HVAC) control in buildings. One of the critical challenges is the large amount of data required to effectively train neural networks for modeling building dynamics. This article presents CLUE, an MBRL system for HVAC control in buildings. CLUE optimizes HVAC operations by integrating a Gaussian process (GP) model to model building dynamics with uncertainty awareness. CLUE utilizes GP to predict state transitions as Gaussian distributions, effectively capturing prediction uncertainty and enhancing decision-making under sparse data conditions. Our approach employs a meta-kernel learning technique to efficiently set GP kernel hyperparameters using domain knowledge from diverse buildings. This drastically reduces the data requirements typically associated with GP models in HVAC applications. Additionally, CLUE incorporates these uncertainty estimates into a model predictive path integral (MPPI) algorithm, enabling the selection of safe, energy-efficient control actions. This uncertainty-aware control strategy evaluates and selects action trajectories based on their predicted impact on energy consumption and human comfort, optimizing operations even under uncertain conditions. Extensive simulations in a five-zone office building demonstrate that CLUE reduces the required training data from hundreds of days to just seven while maintaining robust control performance. It reduces comfort violations by an average of 12.07% compared to existing MBRL methods, without compromising on energy efficiency. Our code and dataset are available at https://github.com/ryeii/CLUE.

Zitieren

APA

Ding, X., An, Z., Rathee, A., & Du, W. (2025). A Safe and Data-Efficient Model-Based Reinforcement Learning System for HVAC Control. IEEE Internet of Things Journal, 12(7), 8014-8032. https://doi.org/10.1109/jiot.2025.3540402

Vancouver

Ding X, An Z, Rathee A, Du W. A Safe and Data-Efficient Model-Based Reinforcement Learning System for HVAC Control. IEEE Internet of Things Journal. 2025;12(7):8014-8032. doi:10.1109/jiot.2025.3540402

BibTeX
@article{Ding2025,
  author = {Ding, Xianzhong and An, Zhiyu and Rathee, Arya and Du, Wan},
  title = {A Safe and Data-Efficient Model-Based Reinforcement Learning System for HVAC Control},
  journal = {IEEE Internet of Things Journal},
  year = {2025},
  volume = {12},
  number = {7},
  pages = {8014--8032},
  doi = {10.1109/jiot.2025.3540402}
}
Kostenlos starten →