EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access

Foundation Models Meet Medical Image Interpretation

Licheng Jiao iD, Jiayao Hao iD, Ruiyang Li iD, Lingling Li iD, Xu Liu iD, Fang Liu iD, Wenping Ma iD, Puhua Chen iD, Zhongjian Huang iD, Jingyi Yang iD, Jiaxuan Zhao iD, Qigong Sun iD

Research · 01.01.2026 · 9

DOI: 10.34133/research.1024 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Research, online erschienen am 27.02.2026. Verfasst von Licheng Jiao und 11 weiteren Autor:innen. Beteiligte Einrichtung: School of Artificial Intelligence, Xidian University, Xi'an, China. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 216 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Joint Funds of the National Natural Science Foundation of China, National Natural Science Foundation of China, 111 Project, the Program for Cheung Kong Scholars and Innovative Research Team in University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facing challenges such as limited annotated data and insufficient model generalization in medical deep learning, foundation models (FMs) are reshaping the paradigm of medical image interpretation through large-scale pretraining and efficient fine-tuning. Unlike traditional models focused on single modality and task, FMs enable multi-modal representation and task-agnostic transfer, adapting to various downstream applications without extensive annotation or retraining. This paper systematically reviews the research progress on medical FMs, focusing on medical tasks, datasets, and evaluation metrics. It covers key interpretation tasks such as classification, segmentation, generation, and prognosis prediction. At the data level, it integrates multi-source data including 2-dimensional (2D)/3D medical imaging, vision-language data, electronic health records (EHRs), physiological signals, and bioinformatics data, and summarizes the evaluation metrics for each task. On this basis, the paper categorizes and analyzes mainstream medical FMs, including pretrained models, vision FMs, vision-language FMs, and extended multi-modal FMs, providing a systematic comparison of their performance and characteristics. Furthermore, we innovatively proposes the IPIU medical FM platform, which integrates large-scale medical data, universal vision models, medical vision-language models, and medical large language models, and verifies its effectiveness in typical clinical tasks. In addition, this work is the first to systematically analyze the key challenges and emerging trends of medical FMs across 12 critical dimensions, including data, modeling, security, and computational resources, filling the gaps in the existing reviews in systematic sorting and forward-looking analysis. Our aim is to provide theoretical support and practical reference for the sustainable development of medical FMs. Related resources and literature lists will be open sourced on https://github.com/JYAOii/Foundation-Models-meet-Medical-Image-Interpretation .

Autor:innen und Institutionen

  • School of Artificial Intelligence, Xidian University, Xi'an, China.
  • Sense Time, Shanghai, China.

ORCID-Profile: Licheng Jiao, Jiayao Hao, Ruiyang Li, Lingling Li, Xu Liu, Fang Liu, Wenping Ma, Puhua Chen, Zhongjian Huang, Jingyi Yang, Jiaxuan Zhao, Qigong Sun

Förderung

  • Joint Funds of the National Natural Science Foundation of China
  • National Natural Science Foundation of China
  • 111 Project, the Program for Cheung Kong Scholars and Innovative Research Team in University
  • National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi’an Jiaotong University

Zitieren

APA

Jiao, L., Hao, J., Li, R., Li, L., Liu, X., Liu, F., Ma, W., Chen, P., Huang, Z., Yang, J., Zhao, J., & Sun, Q. (2026). Foundation Models Meet Medical Image Interpretation. Research, 9. https://doi.org/10.34133/research.1024

Vancouver

Jiao L, Hao J, Li R, Li L, Liu X, Liu F, et al. Foundation Models Meet Medical Image Interpretation. Research. 2026;9. doi:10.34133/research.1024

BibTeX
@article{Jiao2026,
  author = {Jiao, Licheng and Hao, Jiayao and Li, Ruiyang and Li, Lingling and Liu, Xu and Liu, Fang and Ma, Wenping and Chen, Puhua and Huang, Zhongjian and Yang, Jingyi and Zhao, Jiaxuan and Sun, Qigong},
  title = {Foundation Models Meet Medical Image Interpretation},
  journal = {Research},
  year = {2026},
  volume = {9},
  doi = {10.34133/research.1024}
}
Kostenlos starten →