Evaluation of large language models in percutaneous coronary intervention decision-making
Frontiers in Cardiovascular Medicine · 02.04.2026 · 13
DOI: 10.3389/fcvm.2026.1690716 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Cardiovascular Medicine, online erschienen am 02.04.2026. Verfasst von Chengze Lin und 10 weiteren Autor:innen. Beteiligte Einrichtung: Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, School of Medicine, Shanghai Jiao Tong University.
Abstract (Originalsprache)
Background
Clinical decision-making for percutaneous coronary intervention (PCI) in patients with moderate-to-severe coronary stenosis is complex and sensitive to data completeness and guideline interpretation. We aimed to evaluate large language models (LLMs) for PCI support and to develop an ensemble framework for this complex decision setting.
Methods
In this retrospective study, 15 LLM versions were evaluated using data of 93 patients from Ruijin Hospital. A hierarchical framework was employed to assess performance across varying data inputs. To optimize accuracy, advanced grouped ensemble strategies were developed and validated via nested repeated stratified 5-fold cross-validation. Probabilistic reliability and clinical utility were quantified through calibration plots and Decision Curve Analysis (DCA). Statistical robustness was ensured by bootstrap ROC-AUC comparisons with Holm-Bonferroni adjustment and restricted cubic spline modeling to analyze age-performance interactions.
Results
Distinct behavioral patterns emerged across LLM families: Llama-3.3-70B-Instruct made more aggressive recommendations, whereas Grok-3 was more conservative. Holm-adjusted analysis identified significant performance gaps at age cut-points of 73, 75, and 76. A significant age-score interaction (LRT p = 0.00089) confirmed that patient age modulates model performance. The advanced ensemble strategies surpassed individual models, with an adaptive grouped ensemble achieving an F1 score of 0.921, compared to 0.807 for the best single model and 0.794 for a standard ensemble.
Conclusion
Tailored LLM ensembles are feasible for PCI decision support and can improve robustness. Further multicenter prospective validation and multimodal integration are needed before clinical deployment.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Shanghai Artificial Intelligence Laboratory, Shanghai, China.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- School of Medicine, Shanghai Jiao Tong University
Zitieren
APA
Lin, C., Lan, Y., Zeng, Z., Zhuang, L., Dai, R., Lv, G., Xie, Y., Jin, Q., Wu, L., Cao, Q., & Chen, K. (2026). Evaluation of large language models in percutaneous coronary intervention decision-making. Frontiers in Cardiovascular Medicine, 13. https://doi.org/10.3389/fcvm.2026.1690716
Vancouver
Lin C, Lan Y, Zeng Z, Zhuang L, Dai R, Lv G, et al. Evaluation of large language models in percutaneous coronary intervention decision-making. Frontiers in Cardiovascular Medicine. 2026;13. doi:10.3389/fcvm.2026.1690716
BibTeX
@article{Lin2026,
author = {Lin, Chengze and Lan, Yongying and Zeng, Zi and Zhuang, Lingfang and Dai, Rui and Lv, Gang and Xie, Yun and Jin, Qi and Wu, Liqun and Cao, Qing and Chen, Kang},
title = {Evaluation of large language models in percutaneous coronary intervention decision-making},
journal = {Frontiers in Cardiovascular Medicine},
year = {2026},
volume = {13},
doi = {10.3389/fcvm.2026.1690716}
}
EUVIMED