CoDE: A Patient Cohort-Based Study of Evidence Coverage and Support in Diagnostic Explanations Generated by Large Language Models
Bioengineering · 08.11.2026 · 13 (11) · 1325
DOI: 10.3390/bioengineering13111325 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioengineering, online erschienen am 08.11.2026. Verfasst von Ran Xin und 4 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Innovation and Development Special Fund of Hangzhou West Sci-Tech Innovation Corridor.
Abstract (Originalsprache)
Large language models (LLMs) generate medical diagnostic explanations using selected patient findings, raising the question of whether the cited evidence adequately supports the proposed diagnosis. Cohort models identify informative findings, but their value for evaluating independently generated explanations requires separate testing. We introduce CoDE (Cohort-based Diagnostic Evidence evaluation), a controlled empirical study comparing importance-weighted evidence coverage with joint diagnostic support from cited findings. On synthetic DDXPlus records and clinical-record-derived TRACE data, we examine evidence selection, generated explanations and controlled evidence changes using quantity-matched controls and separate evaluation predictors. Cohort importance improved selection, and guided evidence edits in DDXPlus changed diagnostic support more than matched random operations. For correct TRACE proposals, local positive-SHAP coverage exceeded uniform group coverage by 0.2371 failure-detection average precision (simultaneous 95% CI, 0.1093–0.3650), while tree-based direct support performed better. A second generator reproduced weighting gains, with uncertain ordering against direct support. Sparse failures and mapping sensitivity limited natural-explanation rankings in DDXPlus. These findings support using importance to prioritize evidence checks and joint support to assess evidence combinations. Potential omissions warrant testing by adding uncited evidence and measuring support changes; low coverage alone does not establish a reasoning error.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Innovation and Development Special Fund of Hangzhou West Sci-Tech Innovation Corridor
- Zhejiang Key Research and Development Program
Zitieren
APA
Xin, R., Wu, C., He, Y., Li, J., & Tian, Y. (2026). CoDE: A Patient Cohort-Based Study of Evidence Coverage and Support in Diagnostic Explanations Generated by Large Language Models. Bioengineering, 13(11), 1325. https://doi.org/10.3390/bioengineering13111325
Vancouver
Xin R, Wu C, He Y, Li J, Tian Y. CoDE: A Patient Cohort-Based Study of Evidence Coverage and Support in Diagnostic Explanations Generated by Large Language Models. Bioengineering. 2026;13(11):1325. doi:10.3390/bioengineering13111325
BibTeX
@article{Xin2026,
author = {Xin, Ran and Wu, Chengkai and He, Yuxiang and Li, Jingsong and Tian, Yu},
title = {CoDE: A Patient Cohort-Based Study of Evidence Coverage and Support in Diagnostic Explanations Generated by Large Language Models},
journal = {Bioengineering},
year = {2026},
volume = {13},
number = {11},
pages = {1325},
doi = {10.3390/bioengineering13111325}
}
EUVIMED