Discrepancy between medical knowledge and clinical reasoning: evaluating large language models in prenatal diagnosis
Frontiers in Digital Health · 22.09.2026 · 8
DOI: 10.3389/fdgth.2026.1917573 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Digital Health, online erschienen am 22.09.2026. Verfasst von Qiuling Guo und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ultrasound, Quanzhou Maternal and Child Health Hospital (Quanzhou Children's Hospital), Quanzhou, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Bureau of Quanzhou.
Abstract (Originalsprache)
Purpose
Large language models (LLMs) have demonstrated impressive performance across various medical examinations; however, their competency in subspecialty clinical reasoning, particularly in prenatal diagnosis, remains poorly characterized. Materials and methods A cross-sectional comparative study was conducted by using 125 questions from China's nationally standardized Prenatal Ultrasound Screening Qualification Examination. Three LLMs and two human physicians were evaluated. Questions were classified along three independent taxonomic axes: modality, disease system, and question format. Cochran's Q test was used for omnibus comparisons, with post-hoc pairwise McNemar tests where were significant.
Results
Overall accuracy did not differ significantly among the five test-takers ( p = 0.126): the chief physician scored highest (89.60%, 112/125), followed by Claude-Sonnet-4.6 (85.60%, 107/125), Grok-4 (84.80%, 106/125), ChatGPT-5 (84.00%, 105/125), and the attending physician (80.00%, 100/125). No significant differences were observed when stratified by modality (text-only, p = 0.146; imaging diagnostic questions, p = 0.603) or by any individual disease system (all p > 0.05). However, performance divergence emerged sharply across question types. In clinical vignette-based questions ( n = 20), the chief physician (95.00%) significantly outperformed all other test-takers ( p = 0.016), with a 25% gap over the best-performing LLM (Grok-4, 70.00%). In sequential item sets, Grok-4 (95.74%) and the chief physician (93.62%) both significantly outperformed the attending physician (76.60%; both p < 0.05). Conversely, LLMs excelled in knowledge-retrieval tasks, with ChatGPT-5 and Claude-Sonnet-4.6 both achieving 100% accuracy in matching questions. No significant differences were detected among test-takers for factual recall, matching, or multiple-choice multiple-answer questions (all p > 0.05).
Conclusion
LLMs are well-positioned to serve as powerful knowledge augmentation tools, but are not yet ready to function as autonomous clinical reasoners in this complex, ethically consequential subspecialty.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Ultrasound, Quanzhou Maternal and Child Health Hospital (Quanzhou Children's Hospital), Quanzhou, China.
- Department of Gynecology and Obstetrics, Quanzhou Maternal and Child Health Hospital (Quanzhou Children's Hospital), Quanzhou, China.
Förderung
- Science and Technology Bureau of Quanzhou
Zitieren
APA
Guo, Q., Du, Y., Dai, J., & Lin, W. (2026). Discrepancy between medical knowledge and clinical reasoning: evaluating large language models in prenatal diagnosis. Frontiers in Digital Health, 8. https://doi.org/10.3389/fdgth.2026.1917573
Vancouver
Guo Q, Du Y, Dai J, Lin W. Discrepancy between medical knowledge and clinical reasoning: evaluating large language models in prenatal diagnosis. Frontiers in Digital Health. 2026;8. doi:10.3389/fdgth.2026.1917573
BibTeX
@article{Guo2026,
author = {Guo, Qiuling and Du, Yanyun and Dai, Jingcheng and Lin, Weiru},
title = {Discrepancy between medical knowledge and clinical reasoning: evaluating large language models in prenatal diagnosis},
journal = {Frontiers in Digital Health},
year = {2026},
volume = {8},
doi = {10.3389/fdgth.2026.1917573}
}
EUVIMED