EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP

Mengyuan Cao, Jialu Zhao, Xinxin Song

Intelligent & Human Futures · 2026

DOI: 10.63808/ihf.v2i3.429 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Intelligent & Human Futures, 2026. Verfasst von Mengyuan Cao und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To address the challenges of blurry lesion boundaries, unstable training with small samples, and insufficient cross-domain generalization in brain tumor MRI image segmentation, this paper proposes BiomedCLIP-Seg, a novel segmentation method based on the biomedical vision-language pre-training model BiomedCLIP. Taking T2-FLAIR axial slices as input, the method introduces medical text semantic priors into the pixel-level lesion localization process through structured medical prompts and zero-initialized soft prompt mechanisms. Meanwhile, a cross-layer visual feature fusion module is designed to integrate shallow boundary textures, mid-level regional contexts, and high-level lesion semantics. Furthermore, a QKV cross-modal segmentation decoder is constructed to achieve explicit interaction between visual patch representations and category text semantics. To alleviate the issues of peripheral missed segmentation and region adhesion caused by weak tumor boundaries, a cross-modal consistency loss and an L2 norm-based boundary constraint loss are further introduced. Experimental results on the BraTS 2021 dataset demonstrate that BiomedCLIP-Seg achieves Dice, IoU, and HD95 scores of 0.903±0.004, 0.823±0.005, and 5.42±0.27 mm, respectively, outperforming representative methods including U-Net, TransUNet, CLIPSeg, nnU-Net, Swin UNETR, MedSAM, and SAMed. Ablation studies and hyperparameter sensitivity analyses further validate the effectiveness of structured medical prompts, soft prompt adaptation, cross-layer feature fusion, cross-modal consistency constraints, and boundary losses in improving model performance. This study provides a new technical pathway for utilizing biomedical vision-language models to tackle weak boundary segmentation problems in medical imaging.

Zitieren

APA

Cao, M., Zhao, J., & Song, X. (2026). Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP. Intelligent & Human Futures. https://doi.org/10.63808/ihf.v2i3.429

Vancouver

Cao M, Zhao J, Song X. Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP. Intelligent & Human Futures. 2026. doi:10.63808/ihf.v2i3.429

BibTeX
@article{Cao2026,
  author = {Cao, Mengyuan and Zhao, Jialu and Song, Xinxin},
  title = {Research on Brain Tumor MRI Image Segmentation Method Based on BiomedCLIP},
  journal = {Intelligent & Human Futures},
  year = {2026},
  doi = {10.63808/ihf.v2i3.429}
}
Kostenlos starten →