Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP
Intelligent & Human Futures · 2026
DOI: 10.63808/ihf.v2i3.429 ↗Kurz gefasst
Fachartikel in der Zeitschrift Intelligent & Human Futures, 2026. Verfasst von Mengyuan Cao und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
To address the challenges of blurry lesion boundaries, unstable training with small samples, and insufficient cross-domain generalization in brain tumor MRI image segmentation, this paper proposes BiomedCLIP-Seg, a novel segmentation method based on the biomedical vision-language pre-training model BiomedCLIP. Taking T2-FLAIR axial slices as input, the method introduces medical text semantic priors into the pixel-level lesion localization process through structured medical prompts and zero-initialized soft prompt mechanisms. Meanwhile, a cross-layer visual feature fusion module is designed to integrate shallow boundary textures, mid-level regional contexts, and high-level lesion semantics. Furthermore, a QKV cross-modal segmentation decoder is constructed to achieve explicit interaction between visual patch representations and category text semantics. To alleviate the issues of peripheral missed segmentation and region adhesion caused by weak tumor boundaries, a cross-modal consistency loss and an L2 norm-based boundary constraint loss are further introduced. Experimental results on the BraTS 2021 dataset demonstrate that BiomedCLIP-Seg achieves Dice, IoU, and HD95 scores of 0.903±0.004, 0.823±0.005, and 5.42±0.27 mm, respectively, outperforming representative methods including U-Net, TransUNet, CLIPSeg, nnU-Net, Swin UNETR, MedSAM, and SAMed. Ablation studies and hyperparameter sensitivity analyses further validate the effectiveness of structured medical prompts, soft prompt adaptation, cross-layer feature fusion, cross-modal consistency constraints, and boundary losses in improving model performance. This study provides a new technical pathway for utilizing biomedical vision-language models to tackle weak boundary segmentation problems in medical imaging.
Zitieren
APA
Cao, M., Zhao, J., & Song, X. (2026). Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP. Intelligent & Human Futures. https://doi.org/10.63808/ihf.v2i3.429
Vancouver
Cao M, Zhao J, Song X. Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP. Intelligent & Human Futures. 2026. doi:10.63808/ihf.v2i3.429
BibTeX
@article{Cao2026,
author = {Cao, Mengyuan and Zhao, Jialu and Song, Xinxin},
title = {Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP},
journal = {Intelligent & Human Futures},
year = {2026},
doi = {10.63808/ihf.v2i3.429}
}
EUVIMED