EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Breast Ultrasound AI Under Dataset Shift: A Patient-Leakage-Aware Benchmark

Lulu Wang iD

Diagnostics · 19.05.2026 · 16 (10) · 1537

DOI: 10.3390/diagnostics16101537 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Diagnostics, online erschienen am 19.05.2026. Verfasst von Lulu Wang. Beteiligte Einrichtung: Department of Engineering, Reykjavik University, 102 Reykjavik, Iceland. Die Arbeit nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) has shown promise in breast ultrasound image analysis, but most evidence still comes from single-dataset studies. Clinical translation requires evaluation under heterogeneous acquisition and curation conditions. This study presents a patient-leakage-aware, reproducible benchmark for breast ultrasound AI under dataset shift, with emphasis on external generalization, calibration, and confidence-related behavior.

Methods

A reproducible benchmark framework was developed using patient-level splitting, internal testing, pairwise cross-dataset evaluation, whole-image and region-of-interest (ROI) input strategies, calibration analysis, targeted ROI-margin sensitivity analysis, representative explainable AI visualization, and an auxiliary lesion-versus-normal confidence-based analysis. Four public breast ultrasound datasets (BUSI, BUS-UCLM, BUS-BRA, and BrEaST) were harmonized for a primary benign-versus-malignant lesion classification task. Normal images were excluded from the primary endpoint and used only in auxiliary analyses when sufficient numbers were available.

Results

Cross-dataset testing was weaker on average than internal testing, with mean raw AUROC decreasing from 0.801 to 0.719 and mean balanced accuracy from 0.723 to 0.635. ROI input improved external performance, especially for the vision transformer, increasing mean external AUROC from 0.666 to 0.805 and mean external balanced accuracy from 0.594 to 0.713 relative to whole-image input. Temperature scaling improved calibration-related metrics, reducing mean external expected calibration error from 0.180 to 0.150 and mean external negative log-likelihood from 0.848 to 0.682.

Conclusions

This study establishes a reproducible benchmark for evaluating breast ultrasound AI under dataset shift, with explicit attention to patient-level leakage control, external validity, and reliability of predicted probabilities.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencebreast ultrasoundcalibrationdataset shiftdiagnostic imaging

Autor:innen und Institutionen

  • Department of Engineering, Reykjavik University, 102 Reykjavik, Iceland.

ORCID-Profile: Lulu Wang

Zitieren

APA

Wang, L. (2026). Breast Ultrasound AI Under Dataset Shift: A Patient-Leakage-Aware Benchmark. Diagnostics, 16(10), 1537. https://doi.org/10.3390/diagnostics16101537

Vancouver

Wang L. Breast Ultrasound AI Under Dataset Shift: A Patient-Leakage-Aware Benchmark. Diagnostics. 2026;16(10):1537. doi:10.3390/diagnostics16101537

BibTeX
@article{Wang2026,
  author = {Wang, Lulu},
  title = {Breast Ultrasound AI Under Dataset Shift: A Patient-Leakage-Aware Benchmark},
  journal = {Diagnostics},
  year = {2026},
  volume = {16},
  number = {10},
  pages = {1537},
  doi = {10.3390/diagnostics16101537}
}
Kostenlos starten →