EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations

João R C Ramos, José Pinto, Gil Poiares-Oliveira, Ludovic Peeters, Patrick Dumas, Rui Oliveira iD

Biotechnology and Bioengineering · 2024-05 · 121 (5) · 1554-1568

DOI: 10.1002/bit.28668 ↗

At a glance

Journal article in Biotechnology and Bioengineering, published online on 2024-02-11. Written by João R C Ramos and 5 co-authors. Institution: LAQV-REQUIMTE, Department of Chemistry, NOVA School of Science and Technology, NOVA University Lisbon, Caparica, Portugal. Major MEDLINE topics: Neural Networks, Computer. Cited 35 times so far (Crossref); 46 references. The full text is freely available (open access, CC BY 4.0). Funded by: SFRD, Fundação para a Ciência e Tecnologia (FCT).

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

The combination of physical equations with deep learning is becoming a promising methodology for bioprocess digitalization. In this paper, we investigate for the first time the combination of long short‐term memory (LSTM) networks with first principles equations in a hybrid workflow to describe human embryonic kidney 293 (HEK293) culture dynamics. Experimental data of 27 extracellular state variables in 20 fed‐batch HEK293 cultures were collected in a parallel high throughput 250 mL cultivation system in an industrial process development setting. The adaptive moment estimation method with stochastic regularization and cross‐validation were employed for deep learning. A total of 784 hybrid models with varying deep neural network architectures, depths, layers sizes and node activation functions were compared. In most scenarios, hybrid LSTM models outperformed classical hybrid Feedforward Neural Network (FFNN) models in terms of training and testing error. Hybrid LSTM models revealed to be less sensitive to data resampling than FFNN hybrid models. As disadvantages, Hybrid LSTM models are in general more complex (higher number of parameters) and have a higher computation cost than FFNN hybrid models. The hybrid model with the highest prediction accuracy consisted in a LSTM network with seven internal states connected in series with dynamic material balance equations. This hybrid model correctly predicted the dynamics of the 27 state variables (R 2 = 0.93 in the test data set), including biomass, key substrates, amino acids and metabolic by‐products for around 10 cultivation days.

Subjects

MeSH terms (MEDLINE)

Neural Networks, ComputerHumansHEK293 CellsKidney

Author keywords

HEK293 cellsdeep hybrid modelingdeep learningfeedforward neural networkslong short‐term memory networkmachine learning

Authors and institutions

  • LAQV-REQUIMTE, Department of Chemistry, NOVA School of Science and Technology, NOVA University Lisbon, Caparica, Portugal.
  • GSK, Rixensart, Belgium.

ORCID profiles: Rui Oliveira

Funding

  • SFRD
  • Fundação para a Ciência e Tecnologia (FCT)

Cite

APA

Ramos, J. R. C., Pinto, J., Poiares-Oliveira, G., Peeters, L., Dumas, P., & Oliveira, R. (2024). Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations. Biotechnology and Bioengineering, 121(5), 1554-1568. https://doi.org/10.1002/bit.28668

Vancouver

Ramos JRC, Pinto J, Poiares-Oliveira G, Peeters L, Dumas P, Oliveira R. Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations. Biotechnology and Bioengineering. 2024;121(5):1554-1568. doi:10.1002/bit.28668

BibTeX
@article{Ramos2024,
  author = {Ramos, João R C and Pinto, José and Poiares-Oliveira, Gil and Peeters, Ludovic and Dumas, Patrick and Oliveira, Rui},
  title = {Deep hybrid modeling of a HEK293 process: Combining long short‐term memory networks with first principles equations},
  journal = {Biotechnology and Bioengineering},
  year = {2024},
  volume = {121},
  number = {5},
  pages = {1554--1568},
  doi = {10.1002/bit.28668}
}
Start for free →