EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation of large language models in percutaneous coronary intervention decision-making

Chengze Lin, Yongying Lan, Zi Zeng, Lingfang Zhuang, Rui Dai, Gang Lv, Yun Xie, Qi Jin, Liqun Wu, Qing Cao, Kang Chen

Frontiers in Cardiovascular Medicine · 02.04.2026 · 13

DOI: 10.3389/fcvm.2026.1690716 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Cardiovascular Medicine, online erschienen am 02.04.2026. Verfasst von Chengze Lin und 10 weiteren Autor:innen. Beteiligte Einrichtung: Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, School of Medicine, Shanghai Jiao Tong University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Clinical decision-making for percutaneous coronary intervention (PCI) in patients with moderate-to-severe coronary stenosis is complex and sensitive to data completeness and guideline interpretation. We aimed to evaluate large language models (LLMs) for PCI support and to develop an ensemble framework for this complex decision setting.

Methods

In this retrospective study, 15 LLM versions were evaluated using data of 93 patients from Ruijin Hospital. A hierarchical framework was employed to assess performance across varying data inputs. To optimize accuracy, advanced grouped ensemble strategies were developed and validated via nested repeated stratified 5-fold cross-validation. Probabilistic reliability and clinical utility were quantified through calibration plots and Decision Curve Analysis (DCA). Statistical robustness was ensured by bootstrap ROC-AUC comparisons with Holm-Bonferroni adjustment and restricted cubic spline modeling to analyze age-performance interactions.

Results

Distinct behavioral patterns emerged across LLM families: Llama-3.3-70B-Instruct made more aggressive recommendations, whereas Grok-3 was more conservative. Holm-adjusted analysis identified significant performance gaps at age cut-points of 73, 75, and 76. A significant age-score interaction (LRT p = 0.00089) confirmed that patient age modulates model performance. The advanced ensemble strategies surpassed individual models, with an adaptive grouped ensemble achieving an F1 score of 0.921, compared to 0.807 for the best single model and 0.794 for a standard ensemble.

Conclusion

Tailored LLM ensembles are feasible for PCI decision support and can improve robustness. Further multicenter prospective validation and multimodal integration are needed before clinical deployment.

Schlagwörter

Stichwörter der Autor:innen

clinical decision supportdynamic guidelineslarge language modelsmodel ensemblepercutaneous coronary intervention

Autor:innen und Institutionen

  • Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • Shanghai Artificial Intelligence Laboratory, Shanghai, China.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China
  • School of Medicine, Shanghai Jiao Tong University

Zitieren

APA

Lin, C., Lan, Y., Zeng, Z., Zhuang, L., Dai, R., Lv, G., Xie, Y., Jin, Q., Wu, L., Cao, Q., & Chen, K. (2026). Evaluation of large language models in percutaneous coronary intervention decision-making. Frontiers in Cardiovascular Medicine, 13. https://doi.org/10.3389/fcvm.2026.1690716

Vancouver

Lin C, Lan Y, Zeng Z, Zhuang L, Dai R, Lv G, et al. Evaluation of large language models in percutaneous coronary intervention decision-making. Frontiers in Cardiovascular Medicine. 2026;13. doi:10.3389/fcvm.2026.1690716

BibTeX
@article{Lin2026,
  author = {Lin, Chengze and Lan, Yongying and Zeng, Zi and Zhuang, Lingfang and Dai, Rui and Lv, Gang and Xie, Yun and Jin, Qi and Wu, Liqun and Cao, Qing and Chen, Kang},
  title = {Evaluation of large language models in percutaneous coronary intervention decision-making},
  journal = {Frontiers in Cardiovascular Medicine},
  year = {2026},
  volume = {13},
  doi = {10.3389/fcvm.2026.1690716}
}
Kostenlos starten →