EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Assessing CNNs and LoRA-Fine-Tuned Vision–Language Models for Breast Cancer Histopathology Image Classification

Tomiris M Zhaksylyk iD, Beibit B Abdikenov iD, Nurbek M Saidnassim iD, Birzhan T Ayanbayev iD, Aruzhan S Imasheva iD, Temirlan S Karibekov iD

Journal of Imaging · 14.04.2026 · 12 (4) · 168

DOI: 10.3390/jimaging12040168 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 14.04.2026. Verfasst von Tomiris M Zhaksylyk und 5 weiteren Autor:innen. Beteiligte Einrichtung: Science and Innovation Center "Artificial Intelligence", Astana IT University, Astana 010000, Kazakhstan. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Breast cancer histopathology classification remains a fundamental challenge in computational pathology due to variations in tissue morphology across magnification levels. Convolutional neural networks (CNNs) have long been the standard for image-based diagnosis, yet recent advances in vision-language models (VLMs) suggest they may provide strong and transferable representations for complex medical images. In this study, we present a systematic comparison between CNN baselines and large VLMs—Qwen2 and SmolVLM—fine-tuned with Low-Rank Adaptation (LoRA; r=16, α=32, dropout = 0.05) on the BreakHis dataset. Models were evaluated at 40×, 100×, 200×, and 400× magnifications using accuracy, precision, recall, F1-score, and area under the ROC curve (AUC). While Qwen2 achieved moderate performance across magnifications (e.g., 0.8736 accuracy and 0.9552 AUC at 200×), SmolVLM consistently outperformed Qwen2 and substantially reduced the gap with CNN baselines, reaching up to 0.9453 accuracy and 0.9572 F1-score at 200×—approaching the performance of AlexNet (0.9543 accuracy) at the same magnification. CNN baselines, particularly ResNet34, remained the strongest models overall, achieving the highest performance across all magnifications (e.g., 0.9879 accuracy and 0.9984 AUC at 40×). These findings demonstrate that LoRA fine-tuned VLMs, despite requiring gradient accumulation and memory-efficient optimizers and operating with a significantly smaller number of trainable parameters, can achieve competitive performance relative to traditional CNNs. However, CNN-based architectures still provide the highest accuracy and robustness for histopathology classification. Our results highlight the potential of VLMs as parameter-efficient alternatives for digital pathology tasks, particularly in resource-constrained settings.

Schlagwörter

Stichwörter der Autor:innen

breast cancerdeep learningdigital pathologyhistopathologyvision-language models

Autor:innen und Institutionen

  • Science and Innovation Center "Artificial Intelligence", Astana IT University, Astana 010000, Kazakhstan.

ORCID-Profile: Tomiris M Zhaksylyk, Beibit B Abdikenov, Nurbek M Saidnassim, Birzhan T Ayanbayev, Aruzhan S Imasheva, Temirlan S Karibekov

Förderung

  • Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan

Zitieren

APA

Zhaksylyk, T. M., Abdikenov, B. B., Saidnassim, N. M., Ayanbayev, B. T., Imasheva, A. S., & Karibekov, T. S. (2026). Assessing CNNs and LoRA-Fine-Tuned Vision–Language Models for Breast Cancer Histopathology Image Classification. Journal of Imaging, 12(4), 168. https://doi.org/10.3390/jimaging12040168

Vancouver

Zhaksylyk TM, Abdikenov BB, Saidnassim NM, Ayanbayev BT, Imasheva AS, Karibekov TS. Assessing CNNs and LoRA-Fine-Tuned Vision–Language Models for Breast Cancer Histopathology Image Classification. Journal of Imaging. 2026;12(4):168. doi:10.3390/jimaging12040168

BibTeX
@article{Zhaksylyk2026,
  author = {Zhaksylyk, Tomiris M and Abdikenov, Beibit B and Saidnassim, Nurbek M and Ayanbayev, Birzhan T and Imasheva, Aruzhan S and Karibekov, Temirlan S},
  title = {Assessing CNNs and LoRA-Fine-Tuned Vision–Language Models for Breast Cancer Histopathology Image Classification},
  journal = {Journal of Imaging},
  year = {2026},
  volume = {12},
  number = {4},
  pages = {168},
  doi = {10.3390/jimaging12040168}
}
Kostenlos starten →