WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM With Sub-Class Exploration and Prompt Affinity Mining
IEEE Transactions on Medical Imaging · 2025-07 · 44 (7) · 2795-2807
DOI: 10.1109/tmi.2025.3549433 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025-07. Verfasst von Haoran Wang und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted, Supervised Machine Learning. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 68 Literaturangaben. Gefördert von: NSFC Project, China Postdoctoral Science Foundation, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
We have witnessed remarkable progress in foundation models in vision tasks. Currently, several recent works have utilized the segmenting anything model (SAM) to boost the segmentation performance in medical images, where most of them focus on training an adaptor for fine-tuning a large amount of pixel-wise annotated medical images following a fully supervised manner. In this paper, to reduce the labeling cost, we investigate a novel weakly-supervised SAM-based segmentation model, namely WeakMedSAM. Specifically, our proposed WeakMedSAM contains two modules: 1) to mitigate severe co-occurrence in medical images, a sub-class exploration module is introduced to learn accurate feature representations. 2) to improve the quality of the class activation maps, our prompt affinity mining module utilizes the prompt capability of SAM to obtain an affinity map for random-walk refinement. Our method can be applied to any SAM-like backbone, and we conduct experiments with SAMUS and EfficientSAM. The experimental results on three popularly-used benchmark datasets, i.e., BraTS 2019, AbdomenCT-1K, and MSD Cardiac dataset, show the promising results of our proposed WeakMedSAM. Our code is available at https://github.com/wanghr64/WeakMedSAM.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- NSFC Project
- China Postdoctoral Science Foundation
- Fundamental Research Funds for the Central Universities
- State Key Laboratory Fund
- Postdoctoral Fellowship Program of CPSF
- Jiangsu Funding Program for Excellent Postdoctoral Talent
- Young Elite Scientists Sponsorship Program by China Association for Science and Technology
- Jiangsu Science and Technology Major Project
Zitieren
APA
Wang, H., Huai, L., Li, W., Qi, L., Jiang, X., & Shi, Y. (2025). WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM With Sub-Class Exploration and Prompt Affinity Mining. IEEE Transactions on Medical Imaging, 44(7), 2795-2807. https://doi.org/10.1109/tmi.2025.3549433
Vancouver
Wang H, Huai L, Li W, Qi L, Jiang X, Shi Y. WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM With Sub-Class Exploration and Prompt Affinity Mining. IEEE Transactions on Medical Imaging. 2025;44(7):2795-2807. doi:10.1109/tmi.2025.3549433
BibTeX
@article{Wang2025,
author = {Wang, Haoran and Huai, Lian and Li, Wenbin and Qi, Lei and Jiang, Xingqun and Shi, Yinghuan},
title = {WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM With Sub-Class Exploration and Prompt Affinity Mining},
journal = {IEEE Transactions on Medical Imaging},
year = {2025},
volume = {44},
number = {7},
pages = {2795--2807},
doi = {10.1109/tmi.2025.3549433}
}
EUVIMED