Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study
Journal of Medical Internet Research · 29.07.2026 · 28 · e93393-e93393
DOI: 10.2196/93393 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 29.07.2026. Verfasst von Ting Kang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pediatric Surgery, West China Hospital of Sichuan University, 37 Guoxue Xiang, Wuhou District, Chengdu, Sichuan, China, 86 189-8060-694…. Hauptthemen laut MEDLINE: Hypospadias, Referral and Consultation, Perioperative Care. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Hypospadias is a common congenital malformation requiring surgery. Caregivers face substantial perioperative information needs, and large language models (LLMs) offer a potential health education channel, but their performance in pediatric urology and the relation between citation accuracy and clinical content safety lack systematic evaluation.
Objective
This study aimed to evaluate 5 LLMs (ChatGPT-4o, Gemini-2.5-Pro, OpenEvidence, Zhipu Qingyan, and DeepSeek) for pediatric hypospadias perioperative consultation, and to characterize the dimensions clinicians and caregivers prioritize.
Methods
A noninterventional cross-sectional study was conducted at a tertiary hospital in April 2025. From a 40-item bank, 10 high-priority questions were selected by an independent caregiver screening cohort (N=34, cohort A) and classified into 3 risk levels. Twenty-three pediatric urology experts (6 dimensions) and 36 primary caregivers (cohort B; 4 dimensions) evaluated responses by double-blind forced-ranking (reverse-scored, 5=best). Friedman tests with Kendall W assessed overall differences; paired Wilcoxon tests with Bonferroni correction (adjusted α=.005) and rank-biserial r with Hodges-Lehmann 95% CIs were used post hoc. Reference authenticity was independently verified by 2 reviewers (XH and WH) using a 5-category scheme (V/PV/F/G/NR [V: Verifiable, PV: Partially Verifiable, F: Fabricated, G: Guideline-Based, Nonspecific, and NR: No References]), with consensus after canonical-source reverification (Cohen κ=0.702 preadjudication). An 8-reviewer clinical safety audit (7 senior specialists plus 1 European Association of Urology [EAU]-anchored intermediate-title clinician) applied a 4-level severity scheme (None/Mild/Moderate/Severe).
Results
Models differed significantly (caregiver: χ ² 4 =77.5, W =0.538, P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Pediatric Surgery, West China Hospital of Sichuan University, 37 Guoxue Xiang, Wuhou District, Chengdu, Sichuan, China, 86 189-8060-6946.
Zitieren
APA
Kang, T., Yuan, C., Hu, X., & Huang, W. (2026). Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study. Journal of Medical Internet Research, 28, e93393-e93393. https://doi.org/10.2196/93393
Vancouver
Kang T, Yuan C, Hu X, Huang W. Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study. Journal of Medical Internet Research. 2026;28:e93393-e93393. doi:10.2196/93393
BibTeX
@article{Kang2026,
author = {Kang, Ting and Yuan, Chi and Hu, Xinyu and Huang, Wenjiao},
title = {Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study},
journal = {Journal of Medical Internet Research},
year = {2026},
volume = {28},
pages = {e93393--e93393},
doi = {10.2196/93393}
}
EUVIMED