Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates
Biometrics · 07.01.2025 · 81 (1)
DOI: 10.1093/biomtc/ujae161 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biometrics, online erschienen am 07.01.2025. Verfasst von Jian Sun und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Data Science, Fudan University, Shanghai 200433, China. Hauptthemen laut MEDLINE: Electronic Health Records, Algorithms. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Dynamic treatment regimes (DTRs) formalize medical decision-making as a sequence of rules for different stages, mapping patient-level information to recommended treatments. In practice, estimating an optimal DTR using observational data from electronic medical record (EMR) databases can be complicated by nonignorable missing covariates resulting from informative monitoring of patients. Since complete case analysis can provide consistent estimation of outcome model parameters under the assumption of outcome-independent missingness, Q-learning is a natural approach to accommodating nonignorable missing covariates. However, the backward induction algorithm used in Q-learning can introduce challenges, as nonignorable missing covariates at later stages can result in nonignorable missing pseudo-outcomes at earlier stages, leading to suboptimal DTRs, even if the longitudinal outcome variables are fully observed. To address this unique missing data problem in DTR settings, we propose 2 weighted Q-learning approaches where inverse probability weights for missingness of the pseudo-outcomes are obtained through estimating equations with valid nonresponse instrumental variables or sensitivity analysis. The asymptotic properties of the weighted Q-learning estimators are derived, and the finite-sample performance of the proposed methods is evaluated and compared with alternative methods through extensive simulation studies. Using EMR data from the Medical Information Mart for Intensive Care database, we apply the proposed methods to investigate the optimal fluid strategy for sepsis patients in intensive care units.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Data Science, Fudan University, Shanghai 200433, China.
- MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge, CB2 0SR, United Kingdom.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Sun, J., Fu, B., & Su, L. (2025). Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates. Biometrics, 81(1). https://doi.org/10.1093/biomtc/ujae161
Vancouver
Sun J, Fu B, Su L. Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates. Biometrics. 2025;81(1). doi:10.1093/biomtc/ujae161
BibTeX
@article{Sun2025,
author = {Sun, Jian and Fu, Bo and Su, Li},
title = {Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates},
journal = {Biometrics},
year = {2025},
volume = {81},
number = {1},
doi = {10.1093/biomtc/ujae161}
}
EUVIMED