Multi-modal large language models in radiology: principles, applications, and potential
Abdominal Radiology · 02.12.2024 · 50 (6) · 2745-2757
DOI: 10.1007/s00261-024-04708-8 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Abdominal Radiology, online erschienen am 02.12.2024. Verfasst von Yiqiu Shen und 6 weiteren Autor:innen. Beteiligte Einrichtung: New York University Langone Medical Center, New York, USA. Yiqiu.Shen@nyulangone.org. Hauptthemen laut MEDLINE: Artificial Intelligence, Radiology. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 124 Literaturangaben.
Abstract (Originalsprache)
Large language models (LLMs) and multi-modal large language models (MLLMs) represent the cutting-edge in artificial intelligence. This review provides a comprehensive overview of their capabilities and potential impact on radiology. Unlike most existing literature reviews focusing solely on LLMs, this work examines both LLMs and MLLMs, highlighting their potential to support radiology workflows such as report generation, image interpretation, EHR summarization, differential diagnosis generation, and patient education. By streamlining these tasks, LLMs and MLLMs could reduce radiologist workload, improve diagnostic accuracy, support interdisciplinary collaboration, and ultimately enhance patient care. We also discuss key limitations, such as the limited capacity of current MLLMs to interpret 3D medical images and to integrate information from both image and text data, as well as the lack of effective evaluation methods. Ongoing efforts to address these challenges are introduced.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- New York University Langone Medical Center, New York, USA. Yiqiu.Shen@nyulangone.org.
- New York University, New York, USA.
- New York University Shanghai, Shanghai, China.
- New York University Langone Medical Center, New York, USA.
Zitieren
APA
Shen, Y., Xu, Y., Ma, J., Rui, W., Zhao, C., Heacock, L., & Huang, C. (2024). Multi-modal large language models in radiology: principles, applications, and potential. Abdominal Radiology, 50(6), 2745-2757. https://doi.org/10.1007/s00261-024-04708-8
Vancouver
Shen Y, Xu Y, Ma J, Rui W, Zhao C, Heacock L, et al. Multi-modal large language models in radiology: principles, applications, and potential. Abdominal Radiology. 2024;50(6):2745-2757. doi:10.1007/s00261-024-04708-8
BibTeX
@article{Shen2024,
author = {Shen, Yiqiu and Xu, Yanqi and Ma, Jiajian and Rui, Wushuang and Zhao, Chen and Heacock, Laura and Huang, Chenchan},
title = {Multi-modal large language models in radiology: principles, applications, and potential},
journal = {Abdominal Radiology},
year = {2024},
volume = {50},
number = {6},
pages = {2745--2757},
doi = {10.1007/s00261-024-04708-8}
}
EUVIMED