Boosting Your Context by Dual Similarity Checkup for In-Context Learning Medical Image Segmentation
IEEE Transactions on Medical Imaging · 2025
DOI: 10.1109/tmi.2024.3440311 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025. Verfasst von Jun Gao und 6 weiteren Autor:innen. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted, Machine Learning. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 41 Literaturangaben. Gefördert von: National Science and Technology Major Project, National Natural Science Foundation of China, Sichuan Science and Technology Program Key Project.
Abstract (Originalsprache)
The recent advent of in-context learning (ICL) capabilities in large pre-trained models has yielded significant advancements in the generalization of segmentation models. By supplying domain-specific image-mask pairs, the ICL model can be effectively guided to produce optimal segmentation outcomes, eliminating the necessity for model fine-tuning or interactive prompting. However, current existing ICL-based segmentation models exhibit significant limitations when applied to medical segmentation datasets with substantial diversity. To address this issue, we propose a dual similarity checkup approach to guarantee the effectiveness of selected in-context samples so that their guidance can be maximally leveraged during inference. We first employ large pre-trained vision models for extracting strong semantic representations from input images and constructing a feature embedding memory bank for semantic similarity checkup during inference. Assuring the similarity in the input semantic space, we then minimize the discrepancy in the mask appearance distribution between the support set and the estimated mask appearance prior through similarity-weighted sampling and augmentation. We validate our proposed dual similarity checkup approach on eight publicly available medical segmentation datasets, and extensive experimental results demonstrate that our proposed method significantly improves the performance metrics of existing ICL-based segmentation models, particularly when applied to medical image datasets characterized by substantial diversity.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Science and Technology Major Project
- National Natural Science Foundation of China
- Sichuan Science and Technology Program Key Project
Zitieren
APA
Gao, J., Lao, Q., Kang, Q., Liu, P., Du, C., Li, K., & Zhang, L. (2025). Boosting Your Context by Dual Similarity Checkup for In-Context Learning Medical Image Segmentation. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2024.3440311
Vancouver
Gao J, Lao Q, Kang Q, Liu P, Du C, Li K, et al. Boosting Your Context by Dual Similarity Checkup for In-Context Learning Medical Image Segmentation. IEEE Transactions on Medical Imaging. 2025. doi:10.1109/tmi.2024.3440311
BibTeX
@article{Gao2025,
author = {Gao, Jun and Lao, Qicheng and Kang, Qingbo and Liu, Paul and Du, Chenlin and Li, Kang and Zhang, Le},
title = {Boosting Your Context by Dual Similarity Checkup for In-Context Learning Medical Image Segmentation},
journal = {IEEE Transactions on Medical Imaging},
year = {2025},
doi = {10.1109/tmi.2024.3440311}
}
EUVIMED