EUVIMEDEUVIMED entdecken
Crossref

RefSAM3D: Adapting the Segment Anything Model with cross-modal references for three-dimensional medical image segmentation

Xiang Gao, Kai Lu

Artificial Intelligence in Health · 14.08.2025 · 2 (4) · 114

DOI: 10.36922/aih025080010 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Artificial Intelligence in Health, online erschienen am 14.08.2025. Verfasst von Xiang Gao und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Segment Anything Model (SAM), originally built on a two-dimensional vision transformer, excels at capturing global patterns in two-dimensional natural images but faces challenges when applied to three-dimensional (3D) medical imaging modalities such as computed tomography and magnetic resonance imaging. These modalities require capturing spatial information in volumetric space for tasks such as organ segmentation and tumor quantification. To address this challenge, we introduce RefSAM3D, an adaptation of SAM for 3D medical imaging by incorporating a 3D image adapter and cross-modal reference prompt generation. Our approach modifies the visual encoder to handle 3D inputs and enhances the mask decoder for direct 3D mask generation. We also integrate textual prompts to improve segmentation accuracy and consistency in complex anatomical scenarios. By employing a hierarchical attention mechanism, our model effectively captures and integrates information across different scales. Extensive evaluations on multiple medical imaging datasets demonstrate that RefSAM3D outperforms state-of-the-art methods. Our work thus advances the application of SAM in accurately segmenting complex anatomical structures in medical imaging.

Zitieren

APA

Gao, X., & Lu, K. (2025). RefSAM3D: Adapting the Segment Anything Model with cross-modal references for three-dimensional medical image segmentation. Artificial Intelligence in Health, 2(4), 114. https://doi.org/10.36922/aih025080010

Vancouver

Gao X, Lu K. RefSAM3D: Adapting the Segment Anything Model with cross-modal references for three-dimensional medical image segmentation. Artificial Intelligence in Health. 2025;2(4):114. doi:10.36922/aih025080010

BibTeX
@article{Gao2025,
  author = {Gao, Xiang and Lu, Kai},
  title = {RefSAM3D: Adapting the Segment Anything Model with cross-modal references for three-dimensional medical image segmentation},
  journal = {Artificial Intelligence in Health},
  year = {2025},
  volume = {2},
  number = {4},
  pages = {114},
  doi = {10.36922/aih025080010}
}
Kostenlos starten →