EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Ensemble Variability as a Signal of Confounding in Medical Imaging Models

Uma M. Lal-Trehan Estrada, Sunil A. Sheth, Arnau Oliver, Xavier Lladó, Luca Giancardo

Machine Learning and Knowledge Extraction · 2026-05-27 · 8 (6) · 146

DOI: 10.3390/make8060146 ↗

At a glance

Journal article in Machine Learning and Knowledge Extraction, published online on 2026-05-27. Written by Uma M. Lal-Trehan Estrada and 4 co-authors. 22 references. The full text is freely available (open access, CC BY 4.0). Funded by: NIH, Ministerio de Ciencia e Innovación, ICREA.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Machine learning models for medical image analysis are vulnerable to hidden confounders, which can compromise generalization and clinical reliability. Existing detection strategies typically require explicit knowledge or labels of the confounder, which are often unavailable. In this work, we propose an ensemble-based framework to detect potential confounder-driven learning without explicitly defining the confounders, but only which samples might be affected. Our approach leverages the variability of model performance across ensembles to identify signatures of shortcut learning. Shortcut learning occurs when a model uses non-robust features or correlations rather than learning the true underlying task, and it is often observed when confounders are present. We generate controlled dataset variants with increasing confounding levels and analyze distributions of AUC (area under the ROC curve) scores across training, validation, and test splits, revealing converging performance and reduced variance as confounding intensifies. We validate our method on two clinically relevant tasks, diabetic retinopathy detection from retinal fundus images and tumor detection from brain MRI slices. Then, we further demonstrate its practical utility on another dataset and image modality with a stroke reperfusion prediction task with suspected hidden confounders. This work provides a practical, data-driven diagnostic tool to flag potential confounding and support the reliability assessment of machine learning models in medical imaging.

Funding

  • NIH
  • Ministerio de Ciencia e Innovación
  • ICREA
  • Universitat de Girona
  • Penumbra, Inc.

Cite

APA

Estrada, U. M. L., Sheth, S. A., Oliver, A., Lladó, X., & Giancardo, L. (2026). Ensemble Variability as a Signal of Confounding in Medical Imaging Models. Machine Learning and Knowledge Extraction, 8(6), 146. https://doi.org/10.3390/make8060146

Vancouver

Estrada UML, Sheth SA, Oliver A, Lladó X, Giancardo L. Ensemble Variability as a Signal of Confounding in Medical Imaging Models. Machine Learning and Knowledge Extraction. 2026;8(6):146. doi:10.3390/make8060146

BibTeX
@article{Estrada2026,
  author = {Estrada, Uma M. Lal-Trehan and Sheth, Sunil A. and Oliver, Arnau and Lladó, Xavier and Giancardo, Luca},
  title = {Ensemble Variability as a Signal of Confounding in Medical Imaging Models},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2026},
  volume = {8},
  number = {6},
  pages = {146},
  doi = {10.3390/make8060146}
}
Start for free →