Multimodal artificial intelligence models for radiology
BJR|Artificial Intelligence · 2025
DOI: 10.1093/bjrai/ubae017 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift BJR|Artificial Intelligence, 2025. Verfasst von Amara Tariq und 3 weiteren Autor:innen. Beteiligte Einrichtung: Mayo Clinic, Phoenix, AZ, 85054, United States. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Radiology Society of North America Health Disparities.
Abstract (Originalsprache)
Artificial intelligence (AI) models in medicine often fall short in real-world deployment due to inability to incorporate multiple data modalities in their decision-making process as clinicians do. Clinicians integrate evidence and signals from multiple data sources like radiology images, patient clinical status as recorded in electronic health records, consultations from fellow providers, and even subtle clues using the appearance of a patient, when making decisions about diagnosis or treatment. To bridge this gap, significant research effort has focused on building fusion models capable of harnessing multi-modal data for advanced decision making. We present a broad overview of the landscape of research in multimodal AI for radiology covering a wide variety of approaches from traditional fusion modelling to modern vision-language models. We provide analysis of comparative merits and drawbacks of each approach to assist future research and highlight ethical consideration in developing multimodal AI. In practice, the quality and quantity of available training data, availability of computational resources, and clinical application dictates which fusion method may be most suitable.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Mayo Clinic, Phoenix, AZ, 85054, United States.
- Department of Radiology and Imaging Sciences, Emory University, Atlanta, GA 30322, United States.
ORCID-Profile: Imon Banerjee, Judy Gichoya
Förderung
- Radiology Society of North America Health Disparities
Zitieren
APA
Tariq, A., Banerjee, I., Trivedi, H., & Gichoya, J. (2025). Multimodal artificial intelligence models for radiology. BJR|Artificial Intelligence. https://doi.org/10.1093/bjrai/ubae017
Vancouver
Tariq A, Banerjee I, Trivedi H, Gichoya J. Multimodal artificial intelligence models for radiology. BJR|Artificial Intelligence. 2025. doi:10.1093/bjrai/ubae017
BibTeX
@article{Tariq2025,
author = {Tariq, Amara and Banerjee, Imon and Trivedi, Hari and Gichoya, Judy},
title = {Multimodal artificial intelligence models for radiology},
journal = {BJR|Artificial Intelligence},
year = {2025},
doi = {10.1093/bjrai/ubae017}
}
EUVIMED