EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Preoperative MRI-Based Diagnosis and Subtyping of WHO Grade I Meningiomas Using Multimodal Large Language Models: A Comparative Reader Study

Ahmet Kürşat Karaman, Naz Günay Demircan, Berkay Yılmaz, Tufan Agah Kartum, Ahu Senem Demiröz, Ayşe Mine Önenerk, Bora Korkmazer, Osman Kızılkılıç

Cerrahpaşa Medical Journal · 30.06.2026 · 50 · 1-9

DOI: 10.5152/cjm.2026.26003 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cerrahpaşa Medical Journal, online erschienen am 30.06.2026. Verfasst von Ahmet Kürşat Karaman und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To evaluate the diagnostic performance of 2 multimodal large language models (LLMs), ChatGPT-4V and Claude Sonnet 3.7, in preoperative magnetic resonance imaging (MRI)-based diagnosis and histopathological subtyping of WHO Grade I meningiomas and to compare their performance with a radiology resident.

Methods

This retrospective study included 113 patients with WHO Grade I meningiomas who underwent preoperative MRI between January 2020 and December 2024. Multisequence MRI (T1WI, T2WI, FLAIR, T1WI+C, DWI, ADC maps) and radiologist-extracted imaging features were provided to both LLMs in a structured "images + human extracted features" format. Each evaluator performed tumor type and subtype prediction using the 2021 WHO CNS classification. Diagnostic accuracies with 95% confidence intervals were calculated, and comparisons between LLMs and the resident were performed using McNemar's test.

Results

For type classification, ChatGPT-4V achieved 76.99% accuracy and Claude Sonnet 3.7 achieved 73.45%, while the radiology resident showed significantly higher accuracy at 92.04% (P < .001 for both). Subtype classification was challenging. ChatGPT-4V achieved 20.35% accuracy, Claude Sonnet 3.7 30.09%, and the resident 30.97%, with no statistically significant differences among them. No significant performance differences were observed between the 2 LLMs.

Conclusion

Multimodal LLMs demonstrated moderate ability to identify WHO Grade I meningiomas but did not match the diagnostic performance of the radiology resident. Subtype prediction remained limited, reflecting the constraints of conventional MRI for distinguishing subtle histopathological subtypes. Large language models may assist preoperative assessment, but expert interpretation remains essential. Further development using larger datasets and domain-specific model refinement may improve clinical usefulness. Cite this article as: Karaman AK, Demircan NG, Yılmaz B, et al. Preoperative MRI-based diagnosis and subtyping of WHO grade I meningiomas using multimodal large language models: A comparative reader study. Cerrahpaşa Med J. 2026, 50, 0003, doi: 10.5152/cjm.2026.26003.

Zitieren

APA

Karaman, A. K., Demircan, N. G., Yılmaz, B., Kartum, T. A., Demiröz, A. S., Önenerk, A. M., Korkmazer, B., & Kızılkılıç, O. (2026). Preoperative MRI-Based Diagnosis and Subtyping of WHO Grade I Meningiomas Using Multimodal Large Language Models: A Comparative Reader Study. Cerrahpaşa Medical Journal, 50, 1-9. https://doi.org/10.5152/cjm.2026.26003

Vancouver

Karaman AK, Demircan NG, Yılmaz B, Kartum TA, Demiröz AS, Önenerk AM, et al. Preoperative MRI-Based Diagnosis and Subtyping of WHO Grade I Meningiomas Using Multimodal Large Language Models: A Comparative Reader Study. Cerrahpaşa Medical Journal. 2026;50:1-9. doi:10.5152/cjm.2026.26003

BibTeX
@article{Karaman2026,
  author = {Karaman, Ahmet Kürşat and Demircan, Naz Günay and Yılmaz, Berkay and Kartum, Tufan Agah and Demiröz, Ahu Senem and Önenerk, Ayşe Mine and Korkmazer, Bora and Kızılkılıç, Osman},
  title = {Preoperative MRI-Based Diagnosis and Subtyping of WHO Grade I Meningiomas Using Multimodal Large Language Models: A Comparative Reader Study},
  journal = {Cerrahpaşa Medical Journal},
  year = {2026},
  volume = {50},
  pages = {1--9},
  doi = {10.5152/cjm.2026.26003}
}
Kostenlos starten →