EUVIMEDEUVIMED entdecken
Vergleichsstudie

Comparative study on the efficacy of large language models (LLMs) in health management for patients with urological and andrological diseases: a multidimensional quality evaluation and applicability analysis

Guanqiu Chen, Kaipeng Bi, Qi Cai, Zheng Wang, Ziyan An, Weijun Fu

World Journal of Urology · 16.05.2026 · 44 (1)

DOI: 10.1007/s00345-026-06198-3 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift World Journal of Urology, online erschienen am 16.05.2026. Verfasst von Guanqiu Chen und 5 weiteren Autor:innen. Beteiligte Einrichtung: Medical School of Chinese PLA, Beijing, China. Hauptthemen laut MEDLINE: Large Language Models, Urologic Diseases, Disease Management. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE: This study aims to evaluate the efficacy of large language models (LLMs) in health management for urological and andrological conditions by comparing two Chinese LLMs: DeepSeek and Kimi. METHODS: The responses of DeepSeek and Kimi to 30 questions on six urological and andrological diseases were quantitatively assessed using quality assessment tools, expert assessments, and readability metrics. RESULTS: In quality assessments, DeepSeek outperformed Kimi in only two instances: responses to "What are the surgical options for kidney stones?" (PEMAT-AI: P = 0.012; DISCERN-AI: P = 0.024) and "What are the treatment modalities for bladder cancer?" (PEMAT-AI and DISCERN-AI: P < 0.001). Expert assessments revealed that DeepSeek demonstrated superior accuracy and safety compared to Kimi only in addressing "Dietary considerations for kidney stone patients" (accuracy: P < 0.001; safety: P = 0.02). No statistically significant differences were found in quality assessments or expert assessments between the models for disease-specific categories. However, Kimi outperformed DeepSeek in readability evaluations. CONCLUSION: Both DeepSeek and Kimi exhibit substantial efficacy and clinical applicability in managing urological and andrological diseases. To enhance their practical use, Kimi requires improvements in accuracy and safety, while DeepSeek should focus on improving readability.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsUrologic DiseasesDisease ManagementHumans

Stichwörter der Autor:innen

Artificial intelligenceHealth managementLarge language modelsUrological and andrological diseases

Autor:innen und Institutionen

  • Medical School of Chinese PLA, Beijing, China.
  • Department of Urology, The Third Medical Center, Chinese PLA General Hospital, Yongding Road No. 69, 100039, Beijing, China.
  • School of Medicine, Nankai University, Tianjin, China.
  • Department of Urology, The Third Medical Center, Chinese PLA General Hospital, Yongding Road No. 69, 100039, Beijing, China. anziyan301@163.com.
  • Department of Urology, The Third Medical Center, Chinese PLA General Hospital, Yongding Road No. 69, 100039, Beijing, China. fuweijun@hotmail.com.
  • Department of Urology, The Fifth Medical Center, Chinese PLA General Hospital, Beijing, China. fuweijun@hotmail.com.

Zitieren

APA

Chen, G., Bi, K., Cai, Q., Wang, Z., An, Z., & Fu, W. (2026). Comparative study on the efficacy of large language models (LLMs) in health management for patients with urological and andrological diseases: a multidimensional quality evaluation and applicability analysis. World Journal of Urology, 44(1). https://doi.org/10.1007/s00345-026-06198-3

Vancouver

Chen G, Bi K, Cai Q, Wang Z, An Z, Fu W. Comparative study on the efficacy of large language models (LLMs) in health management for patients with urological and andrological diseases: a multidimensional quality evaluation and applicability analysis. World Journal of Urology. 2026;44(1). doi:10.1007/s00345-026-06198-3

BibTeX
@article{Chen2026,
  author = {Chen, Guanqiu and Bi, Kaipeng and Cai, Qi and Wang, Zheng and An, Ziyan and Fu, Weijun},
  title = {Comparative study on the efficacy of large language models (LLMs) in health management for patients with urological and andrological diseases: a multidimensional quality evaluation and applicability analysis},
  journal = {World Journal of Urology},
  year = {2026},
  volume = {44},
  number = {1},
  doi = {10.1007/s00345-026-06198-3}
}
Kostenlos starten →