Demystifying Prediction-Powered Inference
Harvard Data Science Review · 13.11.2026 · 8 (4)
DOI: 10.1162/99608f92.f95a1dd2 ↗Kurz gefasst
Fachartikel in der Zeitschrift Harvard Data Science Review, online erschienen am 13.11.2026. Verfasst von Yilin Song und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics, Columbia Mailman School of Public Health. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS.
Abstract (Originalsprache)
Machine learning predictions are increasingly used to supplement incomplete or costly-to-measure outcomes in fields such as biomedical research, environmental science, and social science. However, treating predictions as ground truth introduces bias, while ignoring them wastes valuable information. Prediction-Powered Inference (PPI) offers a principled framework that leverages predictions from large unlabeled datasets to improve statistical efficiency while maintaining valid inference through explicit bias correction using a smaller labeled subset. Despite its potential, the growing number of PPI variants and their subtle distinctions make it challenging for practitioners to determine when and how to apply these methods responsibly. This paper demystifies PPI by synthesizing its theoretical foundations, methodological extensions, connections to existing statistics literature, and diagnostic tools into a unified practical workflow. Using the MOSAIKS housing price data, we show that PPI variants produce tighter confidence intervals than complete-case analysis, but that double-dipping, i.e. reusing training data for inference, leads to anti-conservative confidence intervals and below-nominal coverage. Under missing-not-at-random mechanisms, all methods, including classical inference using only labeled data, yield biased estimates. We provide a decision flowchart linking assumption violations to appropriate PPI variants, a summary table of representative methods, and practical diagnostic strategies for evaluating core assumptions. By framing PPI as a general recipe rather than a single estimator, this work bridges methodological innovation and applied practice, helping researchers responsibly integrate predictions into valid inference.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biostatistics, Columbia Mailman School of Public Health.
- Institute for Data, Systems, and Society, Massachusetts Institute of Technology.
- Department of Biostatistics, Yale School of Public Health.
Förderung
- NCI NIH HHS
Zitieren
APA
Song, Y., Kluger, D. M., Parikh, H., & Gu, T. (2026). Demystifying Prediction-Powered Inference. Harvard Data Science Review, 8(4). https://doi.org/10.1162/99608f92.f95a1dd2
Vancouver
Song Y, Kluger DM, Parikh H, Gu T. Demystifying Prediction-Powered Inference. Harvard Data Science Review. 2026;8(4). doi:10.1162/99608f92.f95a1dd2
BibTeX
@article{Song2026,
author = {Song, Yilin and Kluger, Dan M and Parikh, Harsh and Gu, Tian},
title = {Demystifying Prediction-Powered Inference},
journal = {Harvard Data Science Review},
year = {2026},
volume = {8},
number = {4},
doi = {10.1162/99608f92.f95a1dd2}
}
EUVIMED