On-the-Fly Improving Segment Anything for Medical Image Segmentation Using Auxiliary Online Learning
IEEE Transactions on Medical Imaging · 2025
DOI: 10.1109/tmi.2025.3548985 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025. Verfasst von Tianyu Huang und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Machine Learning, Image Processing, Computer-Assisted, Diagnostic Imaging. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 30 Literaturangaben. Gefördert von: Natural Science Foundation of Jiangsu Province, National Natural Science Foundation of China, Major Research Plan of the National Natural Science Foundation of China.
Abstract (Originalsprache)
The current variants of the Segment Anything Model (SAM), which include the original SAM and Medical SAM, still lack the capability to produce sufficiently accurate segmentation for medical images. In medical imaging contexts, it is not uncommon for human experts to rectify segmentations of specific test samples after SAM generates its segmentation predictions. These rectifications typically entail manual or semi-manual corrections employing state-of-the-art annotation tools. Motivated by this process, we introduce a novel approach that leverages the advantages of online machine learning to enhance Segment Anything (SA) during test time. We employ rectified annotations to perform online learning, with the aim of improving the segmentation quality of SA on medical images. To ensure the effectiveness and efficiency of online learning when integrated with large-scale vision models like SAM, we propose a new method called Auxiliary Online Learning (AuxOL), which entails adaptive online-batch and adaptive segmentation fusion. Experiments conducted on eight datasets covering four medical imaging modalities validate the effectiveness of the proposed method. Our work proposes and validates a new, practical, and effective approach for enhancing SA on downstream segmentation tasks (e.g., medical image segmentation). The code is publicly available at https://sam-auxol.github.io/AuxOL/.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- Natural Science Foundation of Jiangsu Province
- National Natural Science Foundation of China
- Major Research Plan of the National Natural Science Foundation of China
- Shanghai Sailing Program
- CCF-Baidu Open Fund
- International Science and Technology Cooperation Program through the 2023 Shanghai Action Plan for Science
Zitieren
APA
Huang, T., Zhou, T., Xie, W., Wang, S., Dou, Q., & Zhang, Y. (2025). On-the-Fly Improving Segment Anything for Medical Image Segmentation Using Auxiliary Online Learning. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2025.3548985
Vancouver
Huang T, Zhou T, Xie W, Wang S, Dou Q, Zhang Y. On-the-Fly Improving Segment Anything for Medical Image Segmentation Using Auxiliary Online Learning. IEEE Transactions on Medical Imaging. 2025. doi:10.1109/tmi.2025.3548985
BibTeX
@article{Huang2025,
author = {Huang, Tianyu and Zhou, Tao and Xie, Weidi and Wang, Shuo and Dou, Qi and Zhang, Yizhe},
title = {On-the-Fly Improving Segment Anything for Medical Image Segmentation Using Auxiliary Online Learning},
journal = {IEEE Transactions on Medical Imaging},
year = {2025},
doi = {10.1109/tmi.2025.3548985}
}
EUVIMED