EUVIMEDEUVIMED entdecken
Übersichtsarbeit

Multi-modal large language models in radiology: principles, applications, and potential

Yiqiu Shen, Yanqi Xu, Jiajian Ma, Wushuang Rui, Chen Zhao, Laura Heacock, Chenchan Huang

Abdominal Radiology · 02.12.2024 · 50 (6) · 2745-2757

DOI: 10.1007/s00261-024-04708-8 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Abdominal Radiology, online erschienen am 02.12.2024. Verfasst von Yiqiu Shen und 6 weiteren Autor:innen. Beteiligte Einrichtung: New York University Langone Medical Center, New York, USA. Yiqiu.Shen@nyulangone.org. Hauptthemen laut MEDLINE: Artificial Intelligence, Radiology. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 124 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) and multi-modal large language models (MLLMs) represent the cutting-edge in artificial intelligence. This review provides a comprehensive overview of their capabilities and potential impact on radiology. Unlike most existing literature reviews focusing solely on LLMs, this work examines both LLMs and MLLMs, highlighting their potential to support radiology workflows such as report generation, image interpretation, EHR summarization, differential diagnosis generation, and patient education. By streamlining these tasks, LLMs and MLLMs could reduce radiologist workload, improve diagnostic accuracy, support interdisciplinary collaboration, and ultimately enhance patient care. We also discuss key limitations, such as the limited capacity of current MLLMs to interpret 3D medical images and to integrate information from both image and text data, as well as the lack of effective evaluation methods. Ongoing efforts to address these challenges are introduced.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceRadiologyHumansWorkflowLarge Language Models

Stichwörter der Autor:innen

Deep learningGenerative artificial intelligenceLarge language modelMulti-modal large language model

Autor:innen und Institutionen

  • New York University Langone Medical Center, New York, USA. Yiqiu.Shen@nyulangone.org.
  • New York University, New York, USA.
  • New York University Shanghai, Shanghai, China.
  • New York University Langone Medical Center, New York, USA.

Zitieren

APA

Shen, Y., Xu, Y., Ma, J., Rui, W., Zhao, C., Heacock, L., & Huang, C. (2024). Multi-modal large language models in radiology: principles, applications, and potential. Abdominal Radiology, 50(6), 2745-2757. https://doi.org/10.1007/s00261-024-04708-8

Vancouver

Shen Y, Xu Y, Ma J, Rui W, Zhao C, Heacock L, et al. Multi-modal large language models in radiology: principles, applications, and potential. Abdominal Radiology. 2024;50(6):2745-2757. doi:10.1007/s00261-024-04708-8

BibTeX
@article{Shen2024,
  author = {Shen, Yiqiu and Xu, Yanqi and Ma, Jiajian and Rui, Wushuang and Zhao, Chen and Heacock, Laura and Huang, Chenchan},
  title = {Multi-modal large language models in radiology: principles, applications, and potential},
  journal = {Abdominal Radiology},
  year = {2024},
  volume = {50},
  number = {6},
  pages = {2745--2757},
  doi = {10.1007/s00261-024-04708-8}
}
Kostenlos starten →