EUVIMEDEUVIMED entdecken
Crossref

Data Center HVAC Control Harnessing Flexibility Potential via Real-Time Pricing Cost Optimization Using Reinforcement Learning

Marco Biemann, Philipp Andreas Gunkel, Fabian Scheller, Lizhen Huang, Xiufeng Liu

IEEE Internet of Things Journal · 01.08.2023 · 10 (15) · 13876-13894

DOI: 10.1109/jiot.2023.3263261 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.08.2023. Verfasst von Marco Biemann und 4 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 87 Literaturangaben. Gefördert von: Nordic5Tech Ph.D. Fellowship, Reinforcing the Health Data Infrastructure in Mobility and Assurance through Data Democratization Project funded by the Norwegian Research Council, Flexible Energy Denmark Project funded by Innovation Fund Denmark.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With increasing electricity prices, cost savings through load shifting are becoming increasingly important for energy end users. While dynamic pricing encourages customers to shift demand to low price periods, the nonstationary and highly volatile nature of electricity prices poses a significant challenge to energy management systems. In this article, we investigate the flexibility potential of data centers by optimizing heating, ventilation, and air conditioning systems with a general model-free reinforcement learning (RL) approach. Since the soft actor-critic algorithm with feedforward networks did not work satisfactorily in this scenario, we propose instead a parameterization with a recurrent neural network architecture to successfully handle spot-market price data. The past is encoded into a hidden state, which provides a way to learn the temporal dependencies in the observations and highly volatile rewards. The proposed method is then evaluated in experiments on a simulated data center. Considering real temperature and price signals over multiple years, the results show a cost reduction compared to a proportional, integral and derivative controller while maintaining the temperature of the data center within the desired operating ranges. In this context, this work demonstrates an innovative and applicable RL approach that incorporates complex economic objectives into agent decision-making. The proposed control method can be integrated into various Internet of Things-based smart building solutions for energy management.

Förderung

  • Nordic5Tech Ph.D. Fellowship
  • Reinforcing the Health Data Infrastructure in Mobility and Assurance through Data Democratization Project funded by the Norwegian Research Council
  • Flexible Energy Denmark Project funded by Innovation Fund Denmark

Zitieren

APA

Biemann, M., Gunkel, P. A., Scheller, F., Huang, L., & Liu, X. (2023). Data Center HVAC Control Harnessing Flexibility Potential via Real-Time Pricing Cost Optimization Using Reinforcement Learning. IEEE Internet of Things Journal, 10(15), 13876-13894. https://doi.org/10.1109/jiot.2023.3263261

Vancouver

Biemann M, Gunkel PA, Scheller F, Huang L, Liu X. Data Center HVAC Control Harnessing Flexibility Potential via Real-Time Pricing Cost Optimization Using Reinforcement Learning. IEEE Internet of Things Journal. 2023;10(15):13876-13894. doi:10.1109/jiot.2023.3263261

BibTeX
@article{Biemann2023,
  author = {Biemann, Marco and Gunkel, Philipp Andreas and Scheller, Fabian and Huang, Lizhen and Liu, Xiufeng},
  title = {Data Center HVAC Control Harnessing Flexibility Potential via Real-Time Pricing Cost Optimization Using Reinforcement Learning},
  journal = {IEEE Internet of Things Journal},
  year = {2023},
  volume = {10},
  number = {15},
  pages = {13876--13894},
  doi = {10.1109/jiot.2023.3263261}
}
Kostenlos starten →