EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Multimodal artificial intelligence models for radiology

Amara Tariq, Imon Banerjee iD, Hari Trivedi, Judy Gichoya iD

BJR|Artificial Intelligence · 2025

DOI: 10.1093/bjrai/ubae017 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift BJR|Artificial Intelligence, 2025. Verfasst von Amara Tariq und 3 weiteren Autor:innen. Beteiligte Einrichtung: Mayo Clinic, Phoenix, AZ, 85054, United States. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Radiology Society of North America Health Disparities.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligence (AI) models in medicine often fall short in real-world deployment due to inability to incorporate multiple data modalities in their decision-making process as clinicians do. Clinicians integrate evidence and signals from multiple data sources like radiology images, patient clinical status as recorded in electronic health records, consultations from fellow providers, and even subtle clues using the appearance of a patient, when making decisions about diagnosis or treatment. To bridge this gap, significant research effort has focused on building fusion models capable of harnessing multi-modal data for advanced decision making. We present a broad overview of the landscape of research in multimodal AI for radiology covering a wide variety of approaches from traditional fusion modelling to modern vision-language models. We provide analysis of comparative merits and drawbacks of each approach to assist future research and highlight ethical consideration in developing multimodal AI. In practice, the quality and quantity of available training data, availability of computational resources, and clinical application dictates which fusion method may be most suitable.

Schlagwörter

Stichwörter der Autor:innen

AI in radiologymultimodal AIvision-language models for radiology

Autor:innen und Institutionen

  • Mayo Clinic, Phoenix, AZ, 85054, United States.
  • Department of Radiology and Imaging Sciences, Emory University, Atlanta, GA 30322, United States.

ORCID-Profile: Imon Banerjee, Judy Gichoya

Förderung

  • Radiology Society of North America Health Disparities

Zitieren

APA

Tariq, A., Banerjee, I., Trivedi, H., & Gichoya, J. (2025). Multimodal artificial intelligence models for radiology. BJR|Artificial Intelligence. https://doi.org/10.1093/bjrai/ubae017

Vancouver

Tariq A, Banerjee I, Trivedi H, Gichoya J. Multimodal artificial intelligence models for radiology. BJR|Artificial Intelligence. 2025. doi:10.1093/bjrai/ubae017

BibTeX
@article{Tariq2025,
  author = {Tariq, Amara and Banerjee, Imon and Trivedi, Hari and Gichoya, Judy},
  title = {Multimodal artificial intelligence models for radiology},
  journal = {BJR|Artificial Intelligence},
  year = {2025},
  doi = {10.1093/bjrai/ubae017}
}
Kostenlos starten →