Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations
Biotechnology and Bioengineering · 2024-05 · 121 (5) · 1554-1568
DOI: 10.1002/bit.28668 ↗At a glance
Journal article in Biotechnology and Bioengineering, published online on 2024-02-11. Written by João R C Ramos and 5 co-authors. Institution: LAQV-REQUIMTE, Department of Chemistry, NOVA School of Science and Technology, NOVA University Lisbon, Caparica, Portugal. Major MEDLINE topics: Neural Networks, Computer. Cited 35 times so far (Crossref); 46 references. The full text is freely available (open access, CC BY 4.0). Funded by: SFRD, Fundação para a Ciência e Tecnologia (FCT).
Abstract (original language)
The combination of physical equations with deep learning is becoming a promising methodology for bioprocess digitalization. In this paper, we investigate for the first time the combination of long short‐term memory (LSTM) networks with first principles equations in a hybrid workflow to describe human embryonic kidney 293 (HEK293) culture dynamics. Experimental data of 27 extracellular state variables in 20 fed‐batch HEK293 cultures were collected in a parallel high throughput 250 mL cultivation system in an industrial process development setting. The adaptive moment estimation method with stochastic regularization and cross‐validation were employed for deep learning. A total of 784 hybrid models with varying deep neural network architectures, depths, layers sizes and node activation functions were compared. In most scenarios, hybrid LSTM models outperformed classical hybrid Feedforward Neural Network (FFNN) models in terms of training and testing error. Hybrid LSTM models revealed to be less sensitive to data resampling than FFNN hybrid models. As disadvantages, Hybrid LSTM models are in general more complex (higher number of parameters) and have a higher computation cost than FFNN hybrid models. The hybrid model with the highest prediction accuracy consisted in a LSTM network with seven internal states connected in series with dynamic material balance equations. This hybrid model correctly predicted the dynamics of the 27 state variables (R 2 = 0.93 in the test data set), including biomass, key substrates, amino acids and metabolic by‐products for around 10 cultivation days.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- LAQV-REQUIMTE, Department of Chemistry, NOVA School of Science and Technology, NOVA University Lisbon, Caparica, Portugal.
- GSK, Rixensart, Belgium.
ORCID profiles: Rui Oliveira
Funding
- SFRD
- Fundação para a Ciência e Tecnologia (FCT)
Cite
APA
Ramos, J. R. C., Pinto, J., Poiares-Oliveira, G., Peeters, L., Dumas, P., & Oliveira, R. (2024). Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations. Biotechnology and Bioengineering, 121(5), 1554-1568. https://doi.org/10.1002/bit.28668
Vancouver
Ramos JRC, Pinto J, Poiares-Oliveira G, Peeters L, Dumas P, Oliveira R. Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations. Biotechnology and Bioengineering. 2024;121(5):1554-1568. doi:10.1002/bit.28668
BibTeX
@article{Ramos2024,
author = {Ramos, João R C and Pinto, José and Poiares-Oliveira, Gil and Peeters, Ludovic and Dumas, Patrick and Oliveira, Rui},
title = {Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations},
journal = {Biotechnology and Bioengineering},
year = {2024},
volume = {121},
number = {5},
pages = {1554--1568},
doi = {10.1002/bit.28668}
}
EUVIMED