EUVIMEDDescoperă EUVIMED
VergleichsstudieQuerschnittstudieOpen access

Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study

Ting Kang, Chi Yuan, Xinyu Hu, Wenjiao Huang

Journal of Medical Internet Research · 2026-07-29 · 28 · e93393-e93393

DOI: 10.2196/93393 ↗

At a glance

Vergleichsstudie in Journal of Medical Internet Research, published online on 2026-07-29. Written by Ting Kang and 3 co-authors. Institution: Department of Pediatric Surgery, West China Hospital of Sichuan University, 37 Guoxue Xiang, Wuhou District, Chengdu, Sichuan, China, 86 189-8060-694…. Major MEDLINE topics: Hypospadias, Referral and Consultation, Perioperative Care. Cited 1 times so far (Crossref); 52 references. The full text is freely available in PubMed Central.

RezumatSubjectsDate bibliograficeCiteRelated studies

Abstract (original language)

Background

Hypospadias is a common congenital malformation requiring surgery. Caregivers face substantial perioperative information needs, and large language models (LLMs) offer a potential health education channel, but their performance in pediatric urology and the relation between citation accuracy and clinical content safety lack systematic evaluation.

Objective

This study aimed to evaluate 5 LLMs (ChatGPT-4o, Gemini-2.5-Pro, OpenEvidence, Zhipu Qingyan, and DeepSeek) for pediatric hypospadias perioperative consultation, and to characterize the dimensions clinicians and caregivers prioritize.

Methods

A noninterventional cross-sectional study was conducted at a tertiary hospital in April 2025. From a 40-item bank, 10 high-priority questions were selected by an independent caregiver screening cohort (N=34, cohort A) and classified into 3 risk levels. Twenty-three pediatric urology experts (6 dimensions) and 36 primary caregivers (cohort B; 4 dimensions) evaluated responses by double-blind forced-ranking (reverse-scored, 5=best). Friedman tests with Kendall W assessed overall differences; paired Wilcoxon tests with Bonferroni correction (adjusted α=.005) and rank-biserial r with Hodges-Lehmann 95% CIs were used post hoc. Reference authenticity was independently verified by 2 reviewers (XH and WH) using a 5-category scheme (V/PV/F/G/NR [V: Verifiable, PV: Partially Verifiable, F: Fabricated, G: Guideline-Based, Nonspecific, and NR: No References]), with consensus after canonical-source reverification (Cohen κ=0.702 preadjudication). An 8-reviewer clinical safety audit (7 senior specialists plus 1 European Association of Urology [EAU]-anchored intermediate-title clinician) applied a 4-level severity scheme (None/Mild/Moderate/Severe).

Results

Models differed significantly (caregiver: χ ² 4 =77.5, W =0.538, P

Subjects

MeSH terms (MEDLINE)

HypospadiasReferral and ConsultationPerioperative CareHumansCross-Sectional StudiesLarge Language ModelsMaleChildCaregivers

Author keywords

artificial intelligencecaregivershypospadiaslarge language modelsperioperative care

Authors and institutions

  • Department of Pediatric Surgery, West China Hospital of Sichuan University, 37 Guoxue Xiang, Wuhou District, Chengdu, Sichuan, China, 86 189-8060-6946.

Cite

APA

Kang, T., Yuan, C., Hu, X., & Huang, W. (2026). Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study. Journal of Medical Internet Research, 28, e93393-e93393. https://doi.org/10.2196/93393

Vancouver

Kang T, Yuan C, Hu X, Huang W. Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study. Journal of Medical Internet Research. 2026;28:e93393-e93393. doi:10.2196/93393

BibTeX
@article{Kang2026,
  author = {Kang, Ting and Yuan, Chi and Hu, Xinyu and Huang, Wenjiao},
  title = {Performance of 5 Large Language Models in Perioperative Consultation for Pediatric Hypospadias: Cross-Sectional Comparative Study},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  volume = {28},
  pages = {e93393--e93393},
  doi = {10.2196/93393}
}
Start for free →