EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Advancements in Medical Radiology Through Multimodal Machine Learning: A Comprehensive Overview

Imran Ul Haq iD, Mustafa Mhamed, Mohammed Al-Harbi, Hamid Osman iD, Zuhal Y Hamd iD, Zhe Liu

Bioengineering · 30.04.2025 · 12 (5) · 477

DOI: 10.3390/bioengineering12050477 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Bioengineering, online erschienen am 30.04.2025. Verfasst von Imran Ul Haq und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang 212013, China. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 173 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Zhe Liu, the National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The majority of data collected and obtained from various sources over a patient’s lifetime can be assumed to comprise pertinent information for delivering the best possible treatment. Medical data, such as radiographic and histopathology images, electrocardiograms, and medical records, all guide a physician’s diagnostic approach. Nevertheless, most machine learning techniques in the healthcare field emphasize data analysis from a single modality, which is insufficiently reliable. This is especially evident in radiology, which has long been an essential topic of machine learning in healthcare because of its high data density, availability, and interpretation capability. In the future, computer-assisted diagnostic systems must be intelligent to process a variety of data simultaneously, similar to how doctors examine various resources while diagnosing patients. By extracting novel characteristics from diverse medical data sources, advanced identification techniques known as multimodal learning may be applied, enabling algorithms to analyze data from various sources and eliminating the need to train each modality. This approach enhances the flexibility of algorithms by incorporating diverse data. A growing quantity of current research has focused on the exploration of extracting data from multiple sources and constructing precise multimodal machine/deep learning models for medical examinations. A comprehensive analysis and synthesis of recent publications focusing on multimodal machine learning in detecting diseases is provided. Potential future research directions are also identified. This review presents an overview of multimodal machine learning (MMML) in radiology, a field at the cutting edge of integrating artificial intelligence into medical imaging. As radiological practices continue to evolve, the combination of various imaging and non-imaging data modalities is gaining increasing significance. This paper analyzes current methodologies, applications, and trends in MMML while outlining challenges and predicting upcoming research directions. Beginning with an overview of the different data modalities involved in radiology, namely, imaging, text, and structured medical data, this review explains the processes of modality fusion, representation learning, and modality translation, showing how they boost diagnosis efficacy and improve patient care. Additionally, this review discusses key datasets that have been instrumental in advancing MMML research. This review may help clinicians and researchers comprehend the spatial distribution of the field, outline the current level of advancement, and identify areas of research that need to be explored regarding MMML in radiology.

Schlagwörter

Stichwörter der Autor:innen

fusionmedical image and textmultimodal machine learningradiologyrepresentation learningtranslation

Autor:innen und Institutionen

  • School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang 212013, China.
  • College of Information and Electrical Engineering, China Agriculture University, Beijing 100083, China.
  • Medical Imaging Department, King Abdullah bin Abdulaziz University Hospital, Riyadh 11552, Saudi Arabia.
  • Radiological Sciences Department, College of Applied Medical Sciences, Taif University, Taif 21944, Saudi Arabia.
  • Department of Radiological Sciences, College of Health and Rehabilitation Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia.

ORCID-Profile: Imran Ul Haq, Hamid Osman, Zuhal Y Hamd

Förderung

  • Zhe Liu
  • the National Natural Science Foundation of China

Zitieren

APA

Haq, I. U., Mhamed, M., Al-Harbi, M., Osman, H., Hamd, Z. Y., & Liu, Z. (2025). Advancements in Medical Radiology Through Multimodal Machine Learning: A Comprehensive Overview. Bioengineering, 12(5), 477. https://doi.org/10.3390/bioengineering12050477

Vancouver

Haq IU, Mhamed M, Al-Harbi M, Osman H, Hamd ZY, Liu Z. Advancements in Medical Radiology Through Multimodal Machine Learning: A Comprehensive Overview. Bioengineering. 2025;12(5):477. doi:10.3390/bioengineering12050477

BibTeX
@article{Haq2025,
  author = {Haq, Imran Ul and Mhamed, Mustafa and Al-Harbi, Mohammed and Osman, Hamid and Hamd, Zuhal Y and Liu, Zhe},
  title = {Advancements in Medical Radiology Through Multimodal Machine Learning: A Comprehensive Overview},
  journal = {Bioengineering},
  year = {2025},
  volume = {12},
  number = {5},
  pages = {477},
  doi = {10.3390/bioengineering12050477}
}
Kostenlos starten →