Finding the best trade-off between performance and interpretability in predicting hospital length of stay using structured and unstructured data
PLOS ONE · 30.11.2023 · 18 (11) · e0289795
DOI: 10.1371/journal.pone.0289795 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 30.11.2023. Verfasst von Franck Jaotombo und 3 weiteren Autor:innen. Beteiligte Einrichtung: EMLYON Business School, Ecully, France. Hauptthemen laut MEDLINE: Neural Networks, Computer, Machine Learning. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
This study aims to develop high-performing Machine Learning and Deep Learning models in predicting hospital length of stay (LOS) while enhancing interpretability. We compare performance and interpretability of models trained only on structured tabular data with models trained only on unstructured clinical text data, and on mixed data.
Methods
The structured data was used to train fourteen classical Machine Learning models including advanced ensemble trees, neural networks and k -nearest neighbors. The unstructured data was used to fine-tune a pre-trained Bio Clinical BERT Transformer Deep Learning model. The structured and unstructured data were then merged into a tabular dataset after vectorization of the clinical text and a dimensional reduction through Latent Dirichlet Allocation. The study used the free and publicly available Medical Information Mart for Intensive Care (MIMIC) III database, on the open AutoML Library AutoGluon. Performance is evaluated with respect to two types of random classifiers, used as baselines.
Results
The best model from structured data demonstrates high performance (ROC AUC = 0.944, PRC AUC = 0.655) with limited interpretability, where the most important predictors of prolonged LOS are the level of blood urea nitrogen and of platelets. The Transformer model displays a good but lower performance (ROC AUC = 0.842, PRC AUC = 0.375) with a richer array of interpretability by providing more specific in-hospital factors including procedures, conditions, and medical history. The best model trained on mixed data satisfies both a high level of performance (ROC AUC = 0.963, PRC AUC = 0.746) and a much larger scope in interpretability including pathologies of the intestine, the colon, and the blood; infectious diseases, respiratory problems, procedures involving sedation and intubation, and vascular surgery.
Conclusions
Our results outperform most of the state-of-the-art models in LOS prediction both in terms of performance and of interpretability. Data fusion between structured and unstructured text data may significantly improve performance and interpretability.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- EMLYON Business School, Ecully, France.
- Research Centre on Health Services and Quality of Life, Aix Marseille University, Marseille, France.
- Becker Friedman Institute, Chicago, IL, United States of America.
- Aix Marseille University, CNRS, AMSE, Marseille, France.
- Department of Public Health, Assistance Publique-Hopitaux de Marseille, Marseille, France.
ORCID-Profile: Franck Jaotombo, Badih Ghattas
Zitieren
APA
Jaotombo, F., Adorni, L., Ghattas, B., & Boyer, L. (2023). Finding the best trade-off between performance and interpretability in predicting hospital length of stay using structured and unstructured data. PLOS ONE, 18(11), e0289795. https://doi.org/10.1371/journal.pone.0289795
Vancouver
Jaotombo F, Adorni L, Ghattas B, Boyer L. Finding the best trade-off between performance and interpretability in predicting hospital length of stay using structured and unstructured data. PLOS ONE. 2023;18(11):e0289795. doi:10.1371/journal.pone.0289795
BibTeX
@article{Jaotombo2023,
author = {Jaotombo, Franck and Adorni, Luca and Ghattas, Badih and Boyer, Laurent},
title = {Finding the best trade-off between performance and interpretability in predicting hospital length of stay using structured and unstructured data},
journal = {PLOS ONE},
year = {2023},
volume = {18},
number = {11},
pages = {e0289795},
doi = {10.1371/journal.pone.0289795}
}
EUVIMED