EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large Language Models in Medical Image Analysis: A Systematic Survey and Future Directions

Bushra Urooj, Muhammad Fayaz iD, Shafqat Ali, L Minh Dang, Kyung Won Kim iD

Bioengineering · 29.07.2025 · 12 (8) · 818

DOI: 10.3390/bioengineering12080818 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 29.07.2025. Verfasst von Bushra Urooj und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, University of Ulsan College of Medicine, Seoul 05505, Re…. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 135 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Institute of Information & Communications Technology Planning & Evaluation (IITP), Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), the Institute of Information & Communications Technology Planning & Evaluation (IITP).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The integration of vision and language processing into a cohesive system has already shown promise with the application of large language models (LLMs) in medical image analysis. Their capabilities encompass the generation of medical reports, disease classification, visual question answering, and segmentation, providing yet another approach to interpreting multimodal data. This survey aims to compile all known applications of LLMs in the medical image analysis field, spotlighting their promises alongside critical challenges and future avenues. We introduce the concept of X-stage tuning which serves as a framework for LLMs fine-tuning across multiple stages: zero stage, one stage, and multi-stage, wherein each stage corresponds to task complexity and available data. The survey describes issues like sparsity of data, hallucination in outputs, privacy issues, and the requirement for dynamic knowledge updating. Alongside these, we cover prospective features including integration of LLMs with decision support systems, multimodal learning, and federated learning for privacy-preserving model training. The goal of this work is to provide structured guidance to the targeted audience, demystifying the prospects of LLMs in medical image analysis.

Schlagwörter

Stichwörter der Autor:innen

disease classificationlarge language modelsmedical image analysismedical report generationmultimodal learningvisual question answeringx-stage tuning

Autor:innen und Institutionen

  • Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, University of Ulsan College of Medicine, Seoul 05505, Republic of Korea.
  • Department of Computer Science and Engineering, Sejong University, Seoul 05006, Republic of Korea.
  • Department of Software Engineering, Sejong University, Seoul 05006, Republic of Korea.
  • The Institute of Research and Development, Duy Tan University, Da Nang 550000, Vietnam.
  • Faculty of Information Technology, Duy Tan University, Da Nang 550000, Vietnam.

ORCID-Profile: Muhammad Fayaz, Kyung Won Kim

Förderung

  • the Institute of Information & Communications Technology Planning & Evaluation (IITP)
  • Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI)
  • the Institute of Information & Communications Technology Planning & Evaluation (IITP)
  • Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI)

Zitieren

APA

Urooj, B., Fayaz, M., Ali, S., Dang, L. M., & Kim, K. W. (2025). Large Language Models in Medical Image Analysis: A Systematic Survey and Future Directions. Bioengineering, 12(8), 818. https://doi.org/10.3390/bioengineering12080818

Vancouver

Urooj B, Fayaz M, Ali S, Dang LM, Kim KW. Large Language Models in Medical Image Analysis: A Systematic Survey and Future Directions. Bioengineering. 2025;12(8):818. doi:10.3390/bioengineering12080818

BibTeX
@article{Urooj2025,
  author = {Urooj, Bushra and Fayaz, Muhammad and Ali, Shafqat and Dang, L Minh and Kim, Kyung Won},
  title = {Large Language Models in Medical Image Analysis: A Systematic Survey and Future Directions},
  journal = {Bioengineering},
  year = {2025},
  volume = {12},
  number = {8},
  pages = {818},
  doi = {10.3390/bioengineering12080818}
}
Kostenlos starten →