Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review
Journal of Imaging · 03.11.2026 · 12 (11) · 549
DOI: 10.3390/jimaging12110549 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 03.11.2026. Verfasst von Tomas Tanczos und 3 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Slovak Research and Development Agency, Internal FEI STU.
Abstract (Originalsprache)
Concept Bottleneck Models (CBMs) route predictions through a layer of human-understandable concepts, but classical CBMs need a concept label for every training image, a cost that is high in medicine. Vision–language models (VLMs) remove that requirement because, in a shared image–text embedding space, a large language model can propose candidate concepts and contrastive similarity can score them, with no concept labels. This review surveys annotation-free VLM-based CBMs and their move into clinical imaging. We cover vision–language foundations (CLIP, ALIGN, LLaVA) and trace concept models from early supervised methods (CBM, CEM, TCAV) to versions that work without manual labels (LaBo, Label-Free CBM, PCBM, OpenCBM, VLG-CBM). We then map these foundations to specific medical fields such as radiology, pathology, cardiology, dermatology, and ophthalmology, highlighting the medical VLM-CBMs closest to actual deployment (CBVLM, AdaCBM, ConcepPath, CBM-RAG). We focus on information leakage, in which task information reaches the prediction through the concept layer without being carried by the named concepts. Two of the seven surveyed medical VLM-CBMs test whether their predictions depend on individual concepts, but none measures leakage, and no shared protocol exists. We identify this gap as a central challenge for interpretable medical AI.
Förderung
- Slovak Research and Development Agency
- Internal FEI STU
Zitieren
APA
Tanczos, T., Pavlovicova, J., Kurilova, V., & Benesova, W. (2026). Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review. Journal of Imaging, 12(11), 549. https://doi.org/10.3390/jimaging12110549
Vancouver
Tanczos T, Pavlovicova J, Kurilova V, Benesova W. Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review. Journal of Imaging. 2026;12(11):549. doi:10.3390/jimaging12110549
BibTeX
@article{Tanczos2026,
author = {Tanczos, Tomas and Pavlovicova, Jarmila and Kurilova, Veronika and Benesova, Wanda},
title = {Annotation-Free Vision–Language Concept Bottleneck Models for Interpretable Medical Image Classification: A Review},
journal = {Journal of Imaging},
year = {2026},
volume = {12},
number = {11},
pages = {549},
doi = {10.3390/jimaging12110549}
}
EUVIMED