Explainable Machine Learning Framework for Dynamic Monitoring of Disease Prognostic Risk: Retrospective Cohort Study
JMIR Formative Research · 2025
DOI: 10.2196/65585 ↗At a glance
Kohortenstudie in JMIR Formative Research, 2025. Written by Tetsuo Ishikawa and 8 co-authors. Institution: Predictive Medicine Special Project, RIKEN Center for Integrative Medical Sciences, RIKEN, 1-7-22 Suehiro-cho, Tsurumi-ku, Yokohama, 230-0045, Japan,…. Major MEDLINE topics: COVID-19, Machine Learning. Cited 3 times so far (Crossref); 32 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Patients’ clinical status often evolves rapidly after an initial diagnosis, with each patient exhibiting a distinct disease trajectory. As a result, static risk scores fall short in supporting timely interventions—an issue highlighted by COVID-19, where deaths have stemmed from heterogeneous pathways such as pneumonia, multiorgan failure, or exacerbation of preexisting conditions.
Objective
This study aims to propose a dynamic prognostic risk assessment framework based on longitudinal data collected during hospitalization, using COVID-19 as an example. Our aim was to develop and validate an interpretable framework that (1) screens prognosis at admission and (2) dynamically updates mortality risk throughout hospitalization, thereby providing clinicians with early, explainable warnings while minimizing additional cognitive load.
Methods
In this retrospective study, we extracted electronic medical records of 382 COVID-19 cases treated at Tokyo Shinagawa Hospital between January 27 and September 30, 2020. At admission, gradient boosting decision trees (Light Gradient Boosting Machine) were used to predict the maximum clinical deterioration, including death, based on data available at initial diagnosis. Model performance was evaluated using the area under the receiver operating characteristic curve (AUC). For in-hospital monitoring, random survival forests (RSF) were trained on a longitudinal dataset that combined static demographic characteristics with serially measured vital signs and laboratory results. The model dynamically assessed daily mortality risk by calculating a 7-day cumulative hazard function, with risk scores recalculated each day during hospitalization. RSF accuracy was evaluated in an independent one-third test set using the concordance index (C-index), an integrated Brier score (1-50 days), and mean time-dependent AUC. SurvSHAP(t), an extension of Shapley Additive Explanations, was applied to provide time-dependent explanations of each variable’s contribution to the prediction.
Results
The prediction at initial diagnosis showed good agreement with the actual severity outcomes (AUC of 0.717 for predicting hospitalization/severity ≥2; 0.878 for severity ≥3; 0.951 for severity ≥4; 0.952 for severity ≥5; and 0.970 for death/severity=6), although some cases exhibited discrepancies between the predicted and actual prognoses. The dynamic mortality risk assessment during hospitalization using the RSF achieved a test-set C-index of 0.941, an integrated Brier score of 0.315, and a mean time-dependent AUC of 0.936. This dynamic assessment was able to distinguish between dead and surviving patients as early as 1‐2 weeks before the outcome. Early in hospitalization, C-reactive protein was an important risk factor for mortality; during the middle period, peripheral oxygen saturation (SpO 2 ) gained importance; and immediately before death, platelets and β-D-glucan were the primary risk factors.
Conclusions
Integrating static admission triage with daily, explainable RSF predictions enables early identification of patients with COVID-19 at high risk of deterioration. By surfacing phase-specific, actionable predictors, the framework supports timely interventions and more efficient resource allocation. Prospective, multicenter studies are warranted to validate its generalizability and clinical impact.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Predictive Medicine Special Project, RIKEN Center for Integrative Medical Sciences, RIKEN, 1-7-22 Suehiro-cho, Tsurumi-ku, Yokohama, 230-0045, Japan, 81 45-503-7000.
- Department of Extended Intelligence for Medicine, The Ishii-Ishibashi Laboratory, Keio University School of Medicine, Tokyo, Japan.
- Department of Artificial Intelligence Medicine, Graduate School of Medicine, Chiba University, Chiba, Japan.
- Department of Respiratory Medicine, Tokyo Shinagawa Hospital, Tokyo, Japan.
- Collective Intelligence Research Laboratory, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan.
- Division of Applied Mathematical Science, RIKEN Center for Interdisciplinary Theoretical and Mathematical Sciences, RIKEN, Yokohama, Japan.
ORCID profiles: Tetsuo Ishikawa, Masahiro Shinoda, Megumi Oya, Koichi Ashizaki, Shinichiro Ota, Kenichi Kamachi, Kazuhiro Sakurada, Eiryo Kawakami, Masaharu Shinkai
Cite
APA
Ishikawa, T., Shinoda, M., Oya, M., Ashizaki, K., Ota, S., Kamachi, K., Sakurada, K., Kawakami, E., & Shinkai, M. (2025). Explainable Machine Learning Framework for Dynamic Monitoring of Disease Prognostic Risk: Retrospective Cohort Study. JMIR Formative Research. https://doi.org/10.2196/65585
Vancouver
Ishikawa T, Shinoda M, Oya M, Ashizaki K, Ota S, Kamachi K, et al. Explainable Machine Learning Framework for Dynamic Monitoring of Disease Prognostic Risk: Retrospective Cohort Study. JMIR Formative Research. 2025. doi:10.2196/65585
BibTeX
@article{Ishikawa2025,
author = {Ishikawa, Tetsuo and Shinoda, Masahiro and Oya, Megumi and Ashizaki, Koichi and Ota, Shinichiro and Kamachi, Kenichi and Sakurada, Kazuhiro and Kawakami, Eiryo and Shinkai, Masaharu},
title = {Explainable Machine Learning Framework for Dynamic Monitoring of Disease Prognostic Risk: Retrospective Cohort Study},
journal = {JMIR Formative Research},
year = {2025},
doi = {10.2196/65585}
}
EUVIMED