Reinforcement Learning-Based Control Sequence Optimization for Advanced Reactors
Journal of Nuclear Engineering · 01.07.2024 · 5 (3) · 209-225
DOI: 10.3390/jne5030015 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Nuclear Engineering, online erschienen am 01.07.2024. Verfasst von Khang H. N. Nguyen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation 416 (NSF).
Abstract (Originalsprache)
The last decade has seen the development and application of data-driven methods taking off in nuclear engineering research, aiming to improve the safety and reliability of nuclear power. This work focuses on developing a reinforcement learning-based control sequence optimization framework for advanced nuclear systems, which not only aims to enhance flexible operations, promoting the economics of advanced nuclear technology, but also prioritizing safety during normal operation. At its core, the framework allows the sequence of operational actions to be learned and optimized by an agent to facilitate smooth transitions between the modes of operations (i.e., load-following), while ensuring that all safety significant system parameters remain within their respective limits. To generate dynamic system responses, facilitate control strategy development, and demonstrate the effectiveness of the framework, a simulation environment of a pebble-bed high-temperature gas-cooled reactor was utilized. The soft actor-critic algorithm was adopted to train a reinforcement learning agent, which can generate control sequences to maneuver plant power output in the range between 100% and 50% of the nameplate power through sufficient training. It was shown in the performance validation that the agent successfully generated control actions that maintained electrical output within a tight tolerance of 0.5% from the demand while satisfying all safety constraints. During the mode transition, the agent can maintain the reactor outlet temperature within ±1.5 °C and steam pressure within 0.1 MPa of their setpoints, respectively, by dynamically adjusting control rod positions, control valve openings, and pump speeds. The results demonstrate the effectiveness of the optimization framework and the feasibility of reinforcement learning in designing control strategies for advanced reactor systems.
Förderung
- National Science Foundation 416 (NSF)
Zitieren
APA
Nguyen, K. H. N., Rivas, A., Delipei, G. K., & Hou, J. (2024). Reinforcement Learning-Based Control Sequence Optimization for Advanced Reactors. Journal of Nuclear Engineering, 5(3), 209-225. https://doi.org/10.3390/jne5030015
Vancouver
Nguyen KHN, Rivas A, Delipei GK, Hou J. Reinforcement Learning-Based Control Sequence Optimization for Advanced Reactors. Journal of Nuclear Engineering. 2024;5(3):209-225. doi:10.3390/jne5030015
BibTeX
@article{Nguyen2024,
author = {Nguyen, Khang H. N. and Rivas, Andy and Delipei, Gregory Kyriakos and Hou, Jason},
title = {Reinforcement Learning-Based Control Sequence Optimization for Advanced Reactors},
journal = {Journal of Nuclear Engineering},
year = {2024},
volume = {5},
number = {3},
pages = {209--225},
doi = {10.3390/jne5030015}
}
EUVIMED