Is there a competitive advantage to using multivariate statistical or machine learning methods over the Bross formula in the hdPS framework for bias and variance estimation?
PLOS One · 28.05.2025 · 20 (5) · e0324639
DOI: 10.1371/journal.pone.0324639 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 28.05.2025. Verfasst von Mohammad Ehsanul Karim und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada. Hauptthemen laut MEDLINE: Machine Learning, Propensity Score, Models, Statistical. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
Purpose
We aim to evaluate various proxy selection methods within the context of high-dimensional propensity score (hdPS) analysis. This study aimed to systematically evaluate and compare the performance of traditional statistical methods and machine learning approaches within the hdPS framework, focusing on key metrics such as bias, standard error (SE), and coverage, under various exposure and outcome prevalence scenarios.
Methods
We conducted a plasmode simulation study using data from the National Health and Nutrition Examination Survey (NHANES) cycles from 2013 to 2018. We compared methods including the kitchen sink model, Bross-based hdPS, Hybrid hdPS, LASSO, Elastic Net, Random Forest, XGBoost, and Genetic Algorithm (GA). The performance of each inverse probability weighted method was assessed based on bias, MSE, coverage probability, and SE estimation across three epidemiological scenarios: frequent exposure and outcome, rare exposure and frequent outcome, and frequent exposure and rare outcome.
Results
XGBoost consistently demonstrated strong performance in terms of MSE and coverage, making it effective for scenarios prioritizing precision. However, it exhibited higher bias, particularly in rare exposure scenarios, suggesting it is less suited when minimizing bias is critical. In contrast, GA showed significant limitations, with consistently high bias and MSE, making it the least reliable method. Bross-based hdPS, and Hybrid hdPS methods provided a balanced approach, with low bias and moderate MSE, though coverage varied depending on the scenario. Rare outcome scenarios generally resulted in lower MSE and better precision, while rare exposure scenarios were associated with higher bias and MSE. Notably, traditional statistical approaches such as forward selection and backward elimination performed comparably to more sophisticated machine learning methods in terms of bias and coverage, suggesting that these simpler approaches may be viable alternatives due to their computational efficiency.
Conclusion
The results highlight the importance of selecting hdPS methods based on the specific characteristics of the data, such as exposure and outcome prevalence. While advanced machine learning methods such as XGBoost can enhance precision, simpler methods such as forward selection or backward elimination may offer similar performance in terms of bias and coverage with fewer computational demands. Tailoring the choice of method to the epidemiological scenario is essential for optimizing the balance between bias reduction and precision.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada.
- Centre for Advancing Health Outcomes, St. Paul's Hospital, Vancouver, British Columbia, Canada.
- Department of Statistics, University of British Columbia, Vancouver, British Columbia, Canada.
ORCID-Profile: Mohammad Ehsanul Karim
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Ehsanul Karim, M., & Lei, Y. (2025). Is there a competitive advantage to using multivariate statistical or machine learning methods over the Bross formula in the hdPS framework for bias and variance estimation?. PLOS One, 20(5), e0324639. https://doi.org/10.1371/journal.pone.0324639
Vancouver
Ehsanul Karim M, Lei Y. Is there a competitive advantage to using multivariate statistical or machine learning methods over the Bross formula in the hdPS framework for bias and variance estimation?. PLOS One. 2025;20(5):e0324639. doi:10.1371/journal.pone.0324639
BibTeX
@article{EhsanulKarim2025,
author = {Ehsanul Karim, Mohammad and Lei, Yang},
title = {Is there a competitive advantage to using multivariate statistical or machine learning methods over the Bross formula in the hdPS framework for bias and variance estimation?},
journal = {PLOS One},
year = {2025},
volume = {20},
number = {5},
pages = {e0324639},
doi = {10.1371/journal.pone.0324639}
}
EUVIMED