EUVIMEDObjevte EUVIMED
Crossref

Reinforcement learning based temperature control of a fermentation bioreactor for ethanol production

Nagabhushanamgari Rajasekhar iD, Thota Karunakaran Radhakrishnan iD, Samsudeen Naina Mohamed iD

Biotechnology and Bioengineering · 2024-10 · 121 (10) · 3114-3127

DOI: 10.1002/bit.28784 ↗

At a glance

Journal article in Biotechnology and Bioengineering, published online on 2024-06-27. Written by Nagabhushanamgari Rajasekhar and 2 co-authors. Institution: Department of Chemical Engineering, National Institute of Technology, Tiruchirappalli, Tamilnadu, India. Major MEDLINE topics: Bioreactors, Ethanol, Temperature, Fermentation. Cited 40 times so far (Crossref); 34 references.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Ethanol production is a significant industrial bioprocess for energy. The primary objective of this study is to control the process reactor temperature to get the desired product, that is, ethanol. Advanced model‐based control systems face challenges due to model‐process mismatch, but Reinforcement Learning (RL) is a class of machine learning which can help by allowing agents to learn policies directly from the environment. Hence a RL algorithm called twin delayed deep deterministic policy gradient (TD3) is employed. The control of reactor temperature is categorized into two categories namely unconstrained and constrained control approaches. The TD3 with various reward functions are tested on a nonlinear bioreactor model. The results are compared with existing popular RL algorithm, namely, deep deterministic policy gradient (DDPG) algorithm with a performance measure such as mean squared error (MSE). In the unconstrained control of the bioreactor, the TD3 based controller designed with the integral absolute error (IAE) reward yields a lower MSE of 0.22, whereas the DDPG produces an MSE of 0.29. Similarly, in the case of constrained controller, TD3 based controller designed with the IAE reward yields a lower MSE of 0.38, whereas DDPG produces an MSE of 0.48. In addition, the TD3 trained agent successfully rejects the disturbances, namely, input flow rate and inlet temperature in addition to a setpoint change with better performance metrics.

Subjects

MeSH terms (MEDLINE)

BioreactorsEthanolTemperatureFermentationMachine LearningModels, BiologicalAlgorithms

Author keywords

DDPGTD3bioreactordeep learningprocess controlreinforcement learning

Substances

Ethanol

Authors and institutions

  • Department of Chemical Engineering, National Institute of Technology, Tiruchirappalli, Tamilnadu, India.

ORCID profiles: Nagabhushanamgari Rajasekhar, Thota Karunakaran Radhakrishnan, Samsudeen Naina Mohamed

Cite

APA

Rajasekhar, N., Radhakrishnan, T. K., & Mohamed, S. N. (2024). Reinforcement learning based temperature control of a fermentation bioreactor for ethanol production. Biotechnology and Bioengineering, 121(10), 3114-3127. https://doi.org/10.1002/bit.28784

Vancouver

Rajasekhar N, Radhakrishnan TK, Mohamed SN. Reinforcement learning based temperature control of a fermentation bioreactor for ethanol production. Biotechnology and Bioengineering. 2024;121(10):3114-3127. doi:10.1002/bit.28784

BibTeX
@article{Rajasekhar2024,
  author = {Rajasekhar, Nagabhushanamgari and Radhakrishnan, Thota Karunakaran and Mohamed, Samsudeen Naina},
  title = {Reinforcement learning based temperature control of a fermentation bioreactor for ethanol production},
  journal = {Biotechnology and Bioengineering},
  year = {2024},
  volume = {121},
  number = {10},
  pages = {3114--3127},
  doi = {10.1002/bit.28784}
}
Start for free →