A Meta-Research Review of Statistical Practices for Image-Reliant AI Tools Predicting Lung Cancer Outcomes
NEJM AI · 16.11.2026
DOI: 10.1056/aira2600064 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift NEJM AI, online erschienen am 16.11.2026. Verfasst von Yiren Hou und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA. Die Arbeit nennt 73 Literaturangaben.
Abstract (Originalsprache)
AbstractAI models using medical images are increasingly proposed to support clinical decision-making in lung cancer, motivating assessment of their methodological rigor and transparency. To assess how these models are developed, evaluated, and reported, and to identify gaps in best statistical practices, we conducted a cross-sectional meta-research review of OpenAlex-indexed studies (January 1, 2023, to June 30, 2025) that developed image-based AI tools for lung cancer risk prediction, detection, or prognosis. Thirty-six studies met our inclusion criteria. Convolutional neural networks were used in most studies (27 studies, 75%), and area under the curve (AUC) was the most frequently reported evaluation metric (29 studies, 81%). Although 23 studies (64%) reported some form of uncertainty quantification, most were limited to presenting confidence intervals for global performance metrics (e.g., AUC, sensitivity, and accuracy) rather than individual prediction- or risk-level uncertainty. Common limitations included limited external test set use (14 studies, 39%), insufficient subgroup analyses (10 studies, 28%), and limited adherence to established prediction-model reporting guidelines. Overall, future research should prioritize standardized reporting, use of external test sets, and model performance assessment across clinically relevant subpopulations. The coexistence of increasingly powerful AI-based prediction models with inconsistent study design, evaluation, and reporting practices emphasizes the urgent need to implement more rigorous and transparent methodological standards in this field. (Funded by Yale School of Public Health.).
Autor:innen und Institutionen
- Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA.
- Department of Statistics and Data Science, Yale University, New Haven, CT, USA.
- Yale School of Medicine, New Haven, CT, USA.
- Division of Thoracic Surgery, Department of Surgery, Yale School of Medicine, New Haven, CT, USA.
- Department of Chronic Disease Epidemiology, Yale School of Public Health, New Haven, CT, USA.
ORCID-Profile: Yiren Hou, Timothy Ward, Cheng-Han Yang, Sean McGrath, Ebony Jernigan, Giorgio Caturegli, Daniel Boffa, Bhramar Mukherjee
Zitieren
APA
Hou, Y., Ward, T., Yang, C. H., McGrath, S., Jernigan, E., Caturegli, G., Boffa, D., & Mukherjee, B. (2026). A Meta-Research Review of Statistical Practices for Image-Reliant AI Tools Predicting Lung Cancer Outcomes. NEJM AI. https://doi.org/10.1056/aira2600064
Vancouver
Hou Y, Ward T, Yang CH, McGrath S, Jernigan E, Caturegli G, et al. A Meta-Research Review of Statistical Practices for Image-Reliant AI Tools Predicting Lung Cancer Outcomes. NEJM AI. 2026. doi:10.1056/aira2600064
BibTeX
@article{Hou2026,
author = {Hou, Yiren and Ward, Timothy and Yang, Cheng-Han and McGrath, Sean and Jernigan, Ebony and Caturegli, Giorgio and Boffa, Daniel and Mukherjee, Bhramar},
title = {A Meta-Research Review of Statistical Practices for Image-Reliant AI Tools Predicting Lung Cancer Outcomes},
journal = {NEJM AI},
year = {2026},
doi = {10.1056/aira2600064}
}
EUVIMED