A practically implementable reinforcement learning‐based process controller design
AIChE Journal · 2024-01 · 70 (1)
DOI: 10.1002/aic.18245 ↗Kurz gefasst
Fachartikel in der Zeitschrift AIChE Journal, online erschienen am 07.10.2023. Verfasst von Hesam Hassanpour und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
The present article enables reinforcement learning (RL)‐based controllers for process control applications. Existing instances of RL‐based solutions have significant challenges for online implementation since the training process of an RL agent (controller) presently requires practically impossible number of online interactions between the agent and the environment (process). To address this challenge, we propose an implementable model‐free RL method developed by leveraging industrially implemented model predictive control (MPC) calculations (often designed using a simple linear model identified via step tests). In the first step, MPC calculations are used to pretrain an RL agent that can mimic the MPC performance. Specifically, the MPC calculations are used to pretrain the actor, and the objective function is used to pretrain the critic(s). The pretrained RL agent is then employed within a model‐free RL framework to control the process in a way that initially imitates MPC behavior (thus not compromising process performance and safety), but also continuously learns and improve its performance over the nominal linear MPC. The effectiveness of the proposed approach is illustrated through simulations on a chemical reactor example.
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Hassanpour, H., Wang, X., Corbett, B., & Mhaskar, P. (2024). A practically implementable reinforcement learning‐based process controller design. AIChE Journal, 70(1). https://doi.org/10.1002/aic.18245
Vancouver
Hassanpour H, Wang X, Corbett B, Mhaskar P. A practically implementable reinforcement learning‐based process controller design. AIChE Journal. 2024;70(1). doi:10.1002/aic.18245
BibTeX
@article{Hassanpour2024,
author = {Hassanpour, Hesam and Wang, Xiaonian and Corbett, Brandon and Mhaskar, Prashant},
title = {A practically implementable reinforcement learning‐based process controller design},
journal = {AIChE Journal},
year = {2024},
volume = {70},
number = {1},
doi = {10.1002/aic.18245}
}
EUVIMED