EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates

Jian Sun iD, Bo Fu iD, Li Su iD

Biometrics · 07.01.2025 · 81 (1)

DOI: 10.1093/biomtc/ujae161 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biometrics, online erschienen am 07.01.2025. Verfasst von Jian Sun und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Data Science, Fudan University, Shanghai 200433, China. Hauptthemen laut MEDLINE: Electronic Health Records, Algorithms. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Dynamic treatment regimes (DTRs) formalize medical decision-making as a sequence of rules for different stages, mapping patient-level information to recommended treatments. In practice, estimating an optimal DTR using observational data from electronic medical record (EMR) databases can be complicated by nonignorable missing covariates resulting from informative monitoring of patients. Since complete case analysis can provide consistent estimation of outcome model parameters under the assumption of outcome-independent missingness, Q-learning is a natural approach to accommodating nonignorable missing covariates. However, the backward induction algorithm used in Q-learning can introduce challenges, as nonignorable missing covariates at later stages can result in nonignorable missing pseudo-outcomes at earlier stages, leading to suboptimal DTRs, even if the longitudinal outcome variables are fully observed. To address this unique missing data problem in DTR settings, we propose 2 weighted Q-learning approaches where inverse probability weights for missingness of the pseudo-outcomes are obtained through estimating equations with valid nonresponse instrumental variables or sensitivity analysis. The asymptotic properties of the weighted Q-learning estimators are derived, and the finite-sample performance of the proposed methods is evaluated and compared with alternative methods through extensive simulation studies. Using EMR data from the Medical Information Mart for Intensive Care database, we apply the proposed methods to investigate the optimal fluid strategy for sepsis patients in intensive care units.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Electronic Health RecordsAlgorithmsHumansModels, StatisticalComputer SimulationClinical Decision-MakingMachine LearningData Interpretation, StatisticalSepsis

Stichwörter der Autor:innen

Q-learningbackward-induction-induced missing pseudo-outcomefuture-independent missingnessnonignorable missing datanonresponse instrumental variablesensitivity analysis

Autor:innen und Institutionen

  • School of Data Science, Fudan University, Shanghai 200433, China.
  • MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge, CB2 0SR, United Kingdom.

ORCID-Profile: Jian Sun, Bo Fu, Li Su

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Sun, J., Fu, B., & Su, L. (2025). Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates. Biometrics, 81(1). https://doi.org/10.1093/biomtc/ujae161

Vancouver

Sun J, Fu B, Su L. Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates. Biometrics. 2025;81(1). doi:10.1093/biomtc/ujae161

BibTeX
@article{Sun2025,
  author = {Sun, Jian and Fu, Bo and Su, Li},
  title = {Weighted Q-learning for optimal dynamic treatment regimes with nonignorable missing covariates},
  journal = {Biometrics},
  year = {2025},
  volume = {81},
  number = {1},
  doi = {10.1093/biomtc/ujae161}
}
Kostenlos starten →