EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Interpreting ECG Images with Multimodal Large Language Models

Keyuan Jiang, Japp Adhikari, Gordon R Bernard

Studies in Health Technology and Informatics · 21.05.2026

DOI: 10.3233/shti260321 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Keyuan Jiang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Purdue University Northwest, Hammond, Indiana, U.S.A. Hauptthemen laut MEDLINE: Large Language Models, Electrocardiography, Heart Diseases, Natural Language Processing. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cardiac diseases are one of the leading causes of death worldwide. Electrocardiography (ECG) is one of the major diagnostic methods to detect cardiac diseases, including historical and acute myocardial infarction and arrhythmias. Recent advancements in AI, especially the introduction of multimodal large language models capable of understanding images, may provide a high level of accuracy in interpreting ECG images for possible cardiac diseases. We investigated Google Gemini 2.5 Pro and OpenAI GPT-4o for their abilities in recognizing the cardiac conditions on a corpus of 928 annotated ECG images and experimented on 10-shot and 5-shot classification methods, both with labelled examples to the models. In the 5-shot approach, examples fed to the LLMs agree with the annotation from a medical resident, and for 10-shot method, examples were randomly chosen from the train set. Our results show that few-shot classification methods significantly improved the accuracy with Gemini 2.5 Pro achieving 0.635 (10-shot) and 0.543 (5-shot) in accuracies, and GPT-4o reaching 0.819 (10-shot) and 0.829 (5-shot) accuracy, demonstrating their ability to interpret ECG images. Multimodal large language models may provide a cost effective and accurate way to interpret ECG images.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsElectrocardiographyHeart DiseasesNatural Language ProcessingHumansGenerative Artificial Intelligence

Stichwörter der Autor:innen

Cardiac disease diagnosisECG imagesfew-shot classificationimage understandingmultimodal large language model

Autor:innen und Institutionen

  • Purdue University Northwest, Hammond, Indiana, U.S.A.
  • Vanderbilt University, Nashville, Tennessee, U.S.A.

Zitieren

APA

Jiang, K., Adhikari, J., & Bernard, G. R. (2026). Interpreting ECG Images with Multimodal Large Language Models. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260321

Vancouver

Jiang K, Adhikari J, Bernard GR. Interpreting ECG Images with Multimodal Large Language Models. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260321

BibTeX
@article{Jiang2026,
  author = {Jiang, Keyuan and Adhikari, Japp and Bernard, Gordon R},
  title = {Interpreting ECG Images with Multimodal Large Language Models},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260321}
}
Kostenlos starten →