GlandSAM: Injecting Morphology Knowledge Into Segment Anything Model for Label-Free Gland Segmentation
IEEE Transactions on Medical Imaging · 2025-02 · 44 (2) · 1070-1082
DOI: 10.1109/tmi.2024.3476176 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025-02. Verfasst von Qixiang Zhang und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Innovation and Technology Commission, Project of Hetao Shenzhen-Hong Kong Science and Technology Innovation Cooperation Zone.
Abstract (Originalsprache)
This paper presents a label-free gland segmentation, GlandSAM, which achieves comparable performance with supervised methods while no label is required during its training or inference phase. We observe that the Segment Anything model produces sub-optimal results on gland dataset: It either over-segments a gland into many fractions or under-segments the gland regions by confusing many of them with the background, due to the complex morphology of glands and lack of sufficient labels. To address this challenge, our GlandSAM innovatively injects two clues about gland morphology into SAM to guide the segmentation process: (1) Heterogeneity within glands and (2) Similarity with the background. Initially, we leverage the clues to decompose the intricate glands by selectively extracting a proposal for each gland sub-region of heterogeneous appearances. Then, we inject the morphology clues into SAM in a fine-tuning manner with a novel morphology-aware semantic grouping module that explicitly groups the high-level semantics of gland sub-regions. In this way, our GlandSAM could capture comprehensive knowledge about gland morphology, and produce well-delineated and complete segmentation results. Extensive experiments conducted on the GlaS dataset and the CRAG dataset reveal that GlandSAM outperforms state-of-the-art label-free methods by a significant margin. Notably, our GlandSAM even surpasses several fully-supervised methods that require pixel-wise labels for training, which highlights the remarkable performance and potential of GlandSAM in the realm of gland segmentation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Innovation and Technology Commission
- Project of Hetao Shenzhen-Hong Kong Science and Technology Innovation Cooperation Zone
Zitieren
APA
Zhang, Q., Li, Y., Xue, C., Wang, H., & Li, X. (2025). GlandSAM: Injecting Morphology Knowledge Into Segment Anything Model for Label-Free Gland Segmentation. IEEE Transactions on Medical Imaging, 44(2), 1070-1082. https://doi.org/10.1109/tmi.2024.3476176
Vancouver
Zhang Q, Li Y, Xue C, Wang H, Li X. GlandSAM: Injecting Morphology Knowledge Into Segment Anything Model for Label-Free Gland Segmentation. IEEE Transactions on Medical Imaging. 2025;44(2):1070-1082. doi:10.1109/tmi.2024.3476176
BibTeX
@article{Zhang2025,
author = {Zhang, Qixiang and Li, Yi and Xue, Cheng and Wang, Haonan and Li, Xiaomeng},
title = {GlandSAM: Injecting Morphology Knowledge Into Segment Anything Model for Label-Free Gland Segmentation},
journal = {IEEE Transactions on Medical Imaging},
year = {2025},
volume = {44},
number = {2},
pages = {1070--1082},
doi = {10.1109/tmi.2024.3476176}
}
EUVIMED