EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review

Tomas Tanczos, Jarmila Pavlovicova, Veronika Kurilova, Wanda Benesova

Journal of Imaging · 03.11.2026 · 12 (11) · 549

DOI: 10.3390/jimaging12110549 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 03.11.2026. Verfasst von Tomas Tanczos und 3 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Slovak Research and Development Agency, Internal FEI STU.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Concept Bottleneck Models (CBMs) route predictions through a layer of human-understandable concepts, but classical CBMs need a concept label for every training image, a cost that is high in medicine. Vision–language models (VLMs) remove that requirement because, in a shared image–text embedding space, a large language model can propose candidate concepts and contrastive similarity can score them, with no concept labels. This review surveys annotation-free VLM-based CBMs and their move into clinical imaging. We cover vision–language foundations (CLIP, ALIGN, LLaVA) and trace concept models from early supervised methods (CBM, CEM, TCAV) to versions that work without manual labels (LaBo, Label-Free CBM, PCBM, OpenCBM, VLG-CBM). We then map these foundations to specific medical fields such as radiology, pathology, cardiology, dermatology, and ophthalmology, highlighting the medical VLM-CBMs closest to actual deployment (CBVLM, AdaCBM, ConcepPath, CBM-RAG). We focus on information leakage, in which task information reaches the prediction through the concept layer without being carried by the named concepts. Two of the seven surveyed medical VLM-CBMs test whether their predictions depend on individual concepts, but none measures leakage, and no shared protocol exists. We identify this gap as a central challenge for interpretable medical AI.

Förderung

  • Slovak Research and Development Agency
  • Internal FEI STU

Zitieren

APA

Tanczos, T., Pavlovicova, J., Kurilova, V., & Benesova, W. (2026). Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review. Journal of Imaging, 12(11), 549. https://doi.org/10.3390/jimaging12110549

Vancouver

Tanczos T, Pavlovicova J, Kurilova V, Benesova W. Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review. Journal of Imaging. 2026;12(11):549. doi:10.3390/jimaging12110549

BibTeX
@article{Tanczos2026,
  author = {Tanczos, Tomas and Pavlovicova, Jarmila and Kurilova, Veronika and Benesova, Wanda},
  title = {Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review},
  journal = {Journal of Imaging},
  year = {2026},
  volume = {12},
  number = {11},
  pages = {549},
  doi = {10.3390/jimaging12110549}
}
Kostenlos starten →