EUVIMEDEUVIMED entdecken
Crossref

Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification

Xiaoliu Luo, Minxue Xiao, Ting Xie, Mengzhu Wang, Huiqing Qi, Joey Tianyi Zhou, Taiping Zhang, Xu Wang

IEEE Transactions on Image Processing · 2026 · 1-1

DOI: 10.1109/tip.2026.3753085 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Xiaoliu Luo und 7 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate biomedical image classification under limited supervision remains challenging due to scarce annotations, subtle inter-class differences, and complex disease semantics. Pretrained vision-language models offer a promising foundation for alleviating data scarcity through knowledge transfer, yet effectively adapting them to low-resource biomedical tasks remains nontrivial. To this end, we propose Multi-View Synergistic Learning (MVSL), a unified framework that jointly considers three complementary perspectives: adaptation paradigms, representation granularity, and disease semantic relationships. Specifically, MVSL adopts tailored adaptation strategies for visual and textual encoders, accommodating their distinct representational characteristics while preserving pretrained knowledge. To capture both holistic image semantics and localized pathological evidence, we introduce multi-granularity contrastive learning that aligns global image representations and local visual features with disease-specific textual embeddings. Furthermore, we develop a Disease Semantic Graph (DSG) that leverages disease descriptions generated by large language models to model class-level semantic relationships and regularize adapted textual representations, thereby complementing discriminative learning and helping mitigate excessive specialization toward observed categories. Through the synergy of these complementary perspectives, MVSL enhances fine-grained discrimination while supporting semantic consistency and generalization to unseen categories. Extensive experiments on 11 public biomedical datasets spanning 9 imaging modalities and 10 anatomical regions demonstrate the effectiveness of MVSL in few-shot classification and base-to-novel generalization. The implementation and detailed experimental results are publicly available at https://github.com/luoxiaoliu/MVSL.

Zitieren

APA

Luo, X., Xiao, M., Xie, T., Wang, M., Qi, H., Zhou, J. T., Zhang, T., & Wang, X. (2026). Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification. IEEE Transactions on Image Processing, 1-1. https://doi.org/10.1109/tip.2026.3753085

Vancouver

Luo X, Xiao M, Xie T, Wang M, Qi H, Zhou JT, et al. Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification. IEEE Transactions on Image Processing. 2026:1-1. doi:10.1109/tip.2026.3753085

BibTeX
@article{Luo2026,
  author = {Luo, Xiaoliu and Xiao, Minxue and Xie, Ting and Wang, Mengzhu and Qi, Huiqing and Zhou, Joey Tianyi and Zhang, Taiping and Wang, Xu},
  title = {Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification},
  journal = {IEEE Transactions on Image Processing},
  year = {2026},
  pages = {1--1},
  doi = {10.1109/tip.2026.3753085}
}
Kostenlos starten →