Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study
Pharmacoepidemiology and Drug Safety · 2025
DOI: 10.1002/pds.70165 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Pharmacoepidemiology and Drug Safety, 2025. Verfasst von Yuchen Guo und 3 weiteren Autor:innen. Beteiligte Einrichtung: Centre for Statistics in Medicine, University of Oxford, Oxford, UK. Hauptthemen laut MEDLINE: Propensity Score, Machine Learning, COVID-19, COVID-19 Drug Treatment. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Künstliche Intelligenz in der Pflege, Simulation in der Pflegeausbildung
Abstract (Originalsprache)
Purpose
The surge of treatments for COVID‐19 in the second quarter of 2020 had a low prevalence of treatment and high outcome risk. Motivated by that, we conducted a simulation study comparing disease risk scores (DRS) and propensity scores (PS) using a range of scenarios with different treatment prevalences and outcome risks.
Method
Four methods were used to estimate PS and DRS: logistic regression (reference method), least absolute shrinkage and selection operator (LASSO), multilayer perceptron (MLP), and XgBoost. Monte Carlo simulations generated data across 25 scenarios varying in treatment prevalence, outcome risk, data complexity, and sample size. Average treatment effects were calculated after matching. Relative bias and average absolute standardized mean difference (ASMD) were reported.
Result
Estimation bias increased as treatment prevalence decreased. DRS showed lower bias than PS when treatment prevalence was below 0.1, especially in nonlinear data. However, DRS did not outperform PS in linear or small sample data. PS had comparable or lower bias than DRS when treatment prevalence was 0.1–0.5. Three machine learning (ML) methods performed similarly, with LASSO and XgBoost outperforming the reference method in some nonlinear scenarios. ASMD results indicated that DRS was less impacted by decreasing treatment prevalence compared to PS.
Conclusion
Under nonlinear data, DRS reduced bias compared to PS in scenarios with low treatment prevalence, while PS was preferable for data with treatment prevalence greater than 0.1, regardless of the outcome risk. ML methods can outperform the logistic regression method for PS and DRS estimation. Both decreasing sample size and adding nonlinearity and nonadditivity in data increased bias for all methods tested.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK.
- Boehringer-Ingelheim Pharma GmbH & co., KG, Germany.
- Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, the Netherlands.
ORCID-Profile: Yuchen Guo, Daniel Prieto-Alhambra
Zitieren
APA
Guo, Y., Strauss, V. Y., Khalid, S., & Prieto-Alhambra, D. (2025). Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study. Pharmacoepidemiology and Drug Safety. https://doi.org/10.1002/pds.70165
Vancouver
Guo Y, Strauss VY, Khalid S, Prieto-Alhambra D. Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study. Pharmacoepidemiology and Drug Safety. 2025. doi:10.1002/pds.70165
BibTeX
@article{Guo2025,
author = {Guo, Yuchen and Strauss, Victoria Y and Khalid, Sara and Prieto-Alhambra, Daniel},
title = {Use of Machine Learning to Compare Disease Risk Scores and Propensity Scores Across Complex Confounding Scenarios: A Simulation Study},
journal = {Pharmacoepidemiology and Drug Safety},
year = {2025},
doi = {10.1002/pds.70165}
}
EUVIMED