When Better Prediction Reduces Overlap: The Predictability Paradox in Propensity Score Matching with Machine Learning
Econometrics · 01.04.2026 · 14 (2) · 19
DOI: 10.3390/econometrics14020019 ↗Kurz gefasst
Fachartikel in der Zeitschrift Econometrics, online erschienen am 01.04.2026. Verfasst von Foong Soon Cheong. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Willamette University, Nanyang Technological University.
Abstract (Originalsprache)
Evidence from observational studies plays a central role in shaping public policy in health, education, and financial regulation, where randomized experiments are rarely feasible. Propensity score matching (PSM) is a widely used method to approximate fair comparisons between treatment and control groups. Incorporating machine learning into the estimation of propensity scores can strengthen prediction and enhance the credibility of findings. However, stronger predictive models create a “predictability paradox”. As predictive accuracy improves, estimated propensity scores for treated and control units become more distinct when treatment assignment is strongly predictable from observed covariates, revealing limited overlap between groups. In the limit, near-perfect prediction produces near-complete separation between groups, rendering traditional matching infeasible and confining inference to a narrow subset of units near the boundary of the propensity score distribution, a setting analogous to a regression discontinuity design (RDD). Researchers thus face perverse incentives to use weaker models for statistically significant but spurious results. These dynamics jeopardize the reliability of evidence for policy. To safeguard decision-making, we propose a simple reform: require that studies using PSM disclose model error rates, including false positive and false negative rates, along with information on overlap and effective sample size.
Förderung
- Willamette University
- Nanyang Technological University
Zitieren
APA
Cheong, F. S. (2026). When Better Prediction Reduces Overlap: The Predictability Paradox in Propensity Score Matching with Machine Learning. Econometrics, 14(2), 19. https://doi.org/10.3390/econometrics14020019
Vancouver
Cheong FS. When Better Prediction Reduces Overlap: The Predictability Paradox in Propensity Score Matching with Machine Learning. Econometrics. 2026;14(2):19. doi:10.3390/econometrics14020019
BibTeX
@article{Cheong2026,
author = {Cheong, Foong Soon},
title = {When Better Prediction Reduces Overlap: The Predictability Paradox in Propensity Score Matching with Machine Learning},
journal = {Econometrics},
year = {2026},
volume = {14},
number = {2},
pages = {19},
doi = {10.3390/econometrics14020019}
}
EUVIMED