K-cql: an arterial blood gas analysis-based deep offline reinforcement learning algorithm for mechanical ventilation treatment
Health Information Science and Systems · 06.08.2025 · 13 (1)
DOI: 10.1007/s13755-025-00364-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Health Information Science and Systems, online erschienen am 06.08.2025. Verfasst von Jiaying Xi und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Automation, University of Science and Technology of China, Shushan District, Hefei, 230031 Anhui China. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Research Funds of Centre for Leading Medicine and Advanced Technologies of IHM.
Themen: Beatmung und Weaning
Abstract (Originalsprache)
Mechanical ventilation is employed as a supportive therapy for patients with respiratory failure, but the optimal ventilator settings for patient are often unknown and rely on manual adjustment by physicians. Improper parameter settings may lead to severe complications such as lung injury. To personalize mechanical ventilation and predict the optimal ventilator parameters for patients, we propose a ventilator parameter tuning algorithm. This algorithm integrates clinical expertise in ventilator tuning via Arterial Blood Gas (ABG) analysis with data-driven methods. We perform K-means clustering algorithm on patient dataset based on ABG values for the first time, and the classified data was used to train a deep offline reinforcement learning model based on conservative Q-learning (CQL), therefore we named it the K-CQL algorithm. The introduction of human expert knowledge improves the effectiveness of the entire model. Our evaluation based on Fitted Q Evaluation (FQE) on the MIMIC-III dataset shows that the expected return of the output strategy of K-CQL is 1.76 times that of the physicians, and more importantly, the introduction of intermediate rewards related to ABG analysis further improves it. We also demonstrated that the algorithm is capable of recommending mechanical ventilation parameters within a safe range according to clinical nursing standards.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Automation, University of Science and Technology of China, Shushan District, Hefei, 230031 Anhui China.
- Institute of Advanced Technology, University of Science and Technology of China, Shushan District, Hefei, 230031 Anhui China.
- Centre for Leading Medicine and Advanced Technologies of IHM, The First Affiliated Hospital of University of Science and Technology of China, Shushan District, Hefei, 230031 Anhui China.
ORCID-Profile: Yunbo Zhao
Förderung
- Research Funds of Centre for Leading Medicine and Advanced Technologies of IHM
Zitieren
APA
Xi, J., Dong, S., Zhou, H., & Zhao, Y. (2025). K-cql: an arterial blood gas analysis-based deep offline reinforcement learning algorithm for mechanical ventilation treatment. Health Information Science and Systems, 13(1). https://doi.org/10.1007/s13755-025-00364-4
Vancouver
Xi J, Dong S, Zhou H, Zhao Y. K-cql: an arterial blood gas analysis-based deep offline reinforcement learning algorithm for mechanical ventilation treatment. Health Information Science and Systems. 2025;13(1). doi:10.1007/s13755-025-00364-4
BibTeX
@article{Xi2025,
author = {Xi, Jiaying and Dong, Shaojie and Zhou, Haoquan and Zhao, Yunbo},
title = {K-cql: an arterial blood gas analysis-based deep offline reinforcement learning algorithm for mechanical ventilation treatment},
journal = {Health Information Science and Systems},
year = {2025},
volume = {13},
number = {1},
doi = {10.1007/s13755-025-00364-4}
}
EUVIMED