EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Application and Progress of Multimodal Models in the Medical Field

Qiyuan Zhang

Exploring Science Academic Conference Series · 25.03.2026 · 12 · 23-28

DOI: 10.70267/lshe.20260204 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Exploring Science Academic Conference Series, online erschienen am 25.03.2026. Verfasst von Qiyuan Zhang. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of artificial intelligence, especially generative models and multimodal large models, medical artificial intelligence has gradually moved from the early era of single-modal image recognition and text classification to the era of multimodal modeling. Medical data is inherently multimodal, including various modalities such as images, clinical texts, structured data, and genetic and signal information. For instance, in the diagnosis of lung diseases, multimodal models can integrate chest CT images with patients’ electronic health records (EHR) and medical history texts to quickly locate the lesions and generate preliminary diagnostic suggestions; in the orthopedic treatment scenarios, the models can combine X-ray images with surgical record texts to assist doctors in formulating personalized surgical plans. How to effectively integrate these modalities, and conduct tasks such as diagnostic assistance, report generation, multi-round questioning, pathological explanation and reasoning, has been a focus of research in recent years. This paper systematically reviews the development path of medical multimodal models, summarizes the changes in the capabilities of mainstream methods and the limitations of datasets, and looks forward to the challenges and future trends for practical deployment in clinical settings.

Zitieren

APA

Zhang, Q. (2026). The Application and Progress of Multimodal Models in the Medical Field. Exploring Science Academic Conference Series, 12, 23-28. https://doi.org/10.70267/lshe.20260204

Vancouver

Zhang Q. The Application and Progress of Multimodal Models in the Medical Field. Exploring Science Academic Conference Series. 2026;12:23-28. doi:10.70267/lshe.20260204

BibTeX
@article{Zhang2026,
  author = {Zhang, Qiyuan},
  title = {The Application and Progress of Multimodal Models in the Medical Field},
  journal = {Exploring Science Academic Conference Series},
  year = {2026},
  volume = {12},
  pages = {23--28},
  doi = {10.70267/lshe.20260204}
}
Kostenlos starten →