EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study

Yuchen Guo iD, Victoria Y Strauss, Sara Khalid, Daniel Prieto-Alhambra iD

Pharmacoepidemiology and Drug Safety · 2025

DOI: 10.1002/pds.70165 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Pharmacoepidemiology and Drug Safety, 2025. Verfasst von Yuchen Guo und 3 weiteren Autor:innen. Beteiligte Einrichtung: Centre for Statistics in Medicine, University of Oxford, Oxford, UK. Hauptthemen laut MEDLINE: Propensity Score, Machine Learning, COVID-19, COVID-19 Drug Treatment. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The surge of treatments for COVID‐19 in the second quarter of 2020 had a low prevalence of treatment and high outcome risk. Motivated by that, we conducted a simulation study comparing disease risk scores (DRS) and propensity scores (PS) using a range of scenarios with different treatment prevalences and outcome risks.

Method

Four methods were used to estimate PS and DRS: logistic regression (reference method), least absolute shrinkage and selection operator (LASSO), multilayer perceptron (MLP), and XgBoost. Monte Carlo simulations generated data across 25 scenarios varying in treatment prevalence, outcome risk, data complexity, and sample size. Average treatment effects were calculated after matching. Relative bias and average absolute standardized mean difference (ASMD) were reported.

Result

Estimation bias increased as treatment prevalence decreased. DRS showed lower bias than PS when treatment prevalence was below 0.1, especially in nonlinear data. However, DRS did not outperform PS in linear or small sample data. PS had comparable or lower bias than DRS when treatment prevalence was 0.1–0.5. Three machine learning (ML) methods performed similarly, with LASSO and XgBoost outperforming the reference method in some nonlinear scenarios. ASMD results indicated that DRS was less impacted by decreasing treatment prevalence compared to PS.

Conclusion

Under nonlinear data, DRS reduced bias compared to PS in scenarios with low treatment prevalence, while PS was preferable for data with treatment prevalence greater than 0.1, regardless of the outcome risk. ML methods can outperform the logistic regression method for PS and DRS estimation. Both decreasing sample size and adding nonlinearity and nonadditivity in data increased bias for all methods tested.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Propensity ScoreMachine LearningCOVID-19COVID-19 Drug TreatmentHumansComputer SimulationBiasMonte Carlo MethodLogistic ModelsPrevalenceRisk AssessmentSARS-CoV-2Confounding Factors, Epidemiologic

Stichwörter der Autor:innen

causal inferencedisease risk scoresmachine learningpropensity scorestreatment effect

Autor:innen und Institutionen

  • Centre for Statistics in Medicine, University of Oxford, Oxford, UK.
  • Boehringer-Ingelheim Pharma GmbH & co., KG, Germany.
  • Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, the Netherlands.

ORCID-Profile: Yuchen Guo, Daniel Prieto-Alhambra

Zitieren

APA

Guo, Y., Strauss, V. Y., Khalid, S., & Prieto-Alhambra, D. (2025). Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study. Pharmacoepidemiology and Drug Safety. https://doi.org/10.1002/pds.70165

Vancouver

Guo Y, Strauss VY, Khalid S, Prieto-Alhambra D. Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study. Pharmacoepidemiology and Drug Safety. 2025. doi:10.1002/pds.70165

BibTeX
@article{Guo2025,
  author = {Guo, Yuchen and Strauss, Victoria Y and Khalid, Sara and Prieto-Alhambra, Daniel},
  title = {Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study},
  journal = {Pharmacoepidemiology and Drug Safety},
  year = {2025},
  doi = {10.1002/pds.70165}
}
Kostenlos starten →