Zero-shot segmentation and tumor diameter measurement of soft tissue sarcomas on MRI using a multimodal large language model
Skeletal Radiology · 2026-12 · 55 (12) · 3157-3165
DOI: 10.1007/s00256-026-05335-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift Skeletal Radiology, online erschienen am 10.08.2026. Verfasst von Haruto Sugawara und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Imaging, The Ottawa Hospital, University of Ottawa, 501 Smyth Road, Ottawa, Ontario, K1H 8L6, Canada. capy.sugawara@gmail.com. Hauptthemen laut MEDLINE: Sarcoma, Magnetic Resonance Imaging, Image Interpretation, Computer-Assisted, Deep Learning. Die Arbeit nennt 25 Literaturangaben.
Abstract (Originalsprache)
OBJECTIVES: To evaluate the zero-shot capabilities of a multimodal deep learning model (Gemini 3.0) in segmenting Soft Tissue Sarcomas (STS) on MRI and to compare the accuracy of tumor diameter measurements derived from automated segmentation versus direct model estimation. METHODS: This retrospective study utilized a public dataset (The Cancer Imaging Archive) consisting of 51 patients (mean age, 54.8 ± 17.0 years; 24 men, 27 women) with histologically confirmed STS. Gemini 3.0 performed zero-shot lesion segmentation and direct diameter estimation on a fat-suppressed T2-weighted or STIR image. Segmentation accuracy was evaluated using the Dice similarity coefficient (DSC) against manual segmentation by a board-certified radiologist. Tumor diameters derived from Gemini segmentation masks and direct estimates were compared with manual measurements using intraclass correlation coefficients (ICC) and Bland-Altman analysis. Bootstrap analysis was performed to compare the performance of the two automated measurement methods. RESULTS: Gemini generated segmentation masks with a mean DSC of 0.935 ± 0.082, comparable to inter-radiologist agreement (0.949 ± 0.037) and showing high reproducibility (DSC, 0.981 ± 0.038). For tumor size assessment, the segmentation-derived measurement yielded an ICC of 0.976, significantly higher than the direct estimation ICC of 0.922 (p = 0.027). Bland-Altman analysis revealed a smaller mean bias for the segmentation-based approach (-0.5 mm) compared with direct estimation (-5.0 mm). CONCLUSIONS: Gemini 3.0 achieved high accuracy in zero-shot segmentation of STS on MRI. Deriving quantitative measurements from automated segmentation proved significantly more reliable than direct size estimation by the large language model.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Medical Imaging, The Ottawa Hospital, University of Ottawa, 501 Smyth Road, Ottawa, Ontario, K1H 8L6, Canada. capy.sugawara@gmail.com.
- Department of Radiology, Institute of Medical Science, The University of Tokyo, Tokyo, Japan.
- Department of Diagnostic Radiology, McGill University, Montreal, QC, Canada.
- Augmented Intelligence and Precision Health Laboratory (AIPHL), Research Institute of the McGill University Health Centre, Montreal, Canada.
- Diagnostic Radiology and Radiation Oncology, Chiba University Graduate School of Medicine, Chiba, Japan.
Zitieren
APA
Sugawara, H., Kato, S., & Takada, A. (2026). Zero-shot segmentation and tumor diameter measurement of soft tissue sarcomas on MRI using a multimodal large language model. Skeletal Radiology, 55(12), 3157-3165. https://doi.org/10.1007/s00256-026-05335-8
Vancouver
Sugawara H, Kato S, Takada A. Zero-shot segmentation and tumor diameter measurement of soft tissue sarcomas on MRI using a multimodal large language model. Skeletal Radiology. 2026;55(12):3157-3165. doi:10.1007/s00256-026-05335-8
BibTeX
@article{Sugawara2026,
author = {Sugawara, Haruto and Kato, Shimpei and Takada, Akiyo},
title = {Zero-shot segmentation and tumor diameter measurement of soft tissue sarcomas on MRI using a multimodal large language model},
journal = {Skeletal Radiology},
year = {2026},
volume = {55},
number = {12},
pages = {3157--3165},
doi = {10.1007/s00256-026-05335-8}
}
EUVIMED