EUVIMEDEUVIMED entdecken
Querschnittstudie

Large language model chatbots for patient-facing erectile dysfunction information: a cross-sectional evaluation of safety, accuracy, empathy, information quality and readability

Dalian Liang iD, Zhengkun Zhang, Wenli Zhao, Jingli Shang, Haiyan Li

Sexual Health · 17.12.2026 · 23 (6)

DOI: 10.1071/sh26186 ↗

Kurz gefasst

Querschnittstudie in der Zeitschrift Sexual Health, online erschienen am 05.11.2026. Verfasst von Dalian Liang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Critical Care, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, …. Hauptthemen laut MEDLINE: Erectile Dysfunction, Empathy. Die Arbeit nennt 49 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Generative artificial intelligence chatbots are increasingly used for health information, including sensitive conditions, such as erectile dysfunction (ED), but their safety and quality remain uncertain. To compare six large language model chatbot interfaces for ED information across safety, accuracy, empathy, information quality, source-related transparency, readability and response length.

Methods

Thirty-eight standardized ED questions were submitted once to six chatbot interfaces, yielding 228 responses. Five independent raters assessed Safety, Accuracy, Empathy, DISCERN, Ensuring Quality Information for Patients, the Journal of the American Medical Association benchmark and Global Quality Score. Readability and response length were also evaluated. Between-interface differences were tested using Cochran’s Q or Friedman tests.

Results

Twenty-six responses (11.4%) were safety-flagged. Safety-flag frequency differed across interfaces (Q = 11.765, P = 0.038), but the effect size was small (0.062; 95% CI, 0.026–0.148), and no pairwise difference remained significant after multiplicity correction. Accuracy was generally high (median 4.00/5 for all interfaces), but differed slightly overall (P = 0.010, Kendall’s W = 0.080). Empathy (P < 0.001, W = 0.160), DISCERN (P = 0.003, W = 0.508), Ensuring Quality Information for Patients (P < 0.001, W = 0.576), and Journal of the American Medical Association benchmark scores (P < 0.001, W = 0.888) differed significantly, whereas Global Quality Score did not (P = 0.146). Readability and response length also differed (all P < 0.001).

Conclusion

Large language model chatbots generally provided accurate ED-related information, but performance varied across clinically relevant dimensions. They may support information seeking, but should not replace individualized clinical assessment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Erectile DysfunctionEmpathyHumansMaleLarge Language ModelsCross-Sectional StudiesComprehensionGenerative Artificial Intelligence

Stichwörter der Autor:innen

accuracychatbot health adviceempathyerectile dysfunctiongenerative artificial intelligenceinformation qualitylarge language modelsreadabilitysafety

Autor:innen und Institutionen

  • Department of Critical Care, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, Guangdong, China.

ORCID-Profile: Dalian Liang

Zitieren

APA

Liang, D., Zhang, Z., Zhao, W., Shang, J., & Li, H. (2026). Large language model chatbots for patient-facing erectile dysfunction information: a cross-sectional evaluation of safety, accuracy, empathy, information quality and readability. Sexual Health, 23(6). https://doi.org/10.1071/sh26186

Vancouver

Liang D, Zhang Z, Zhao W, Shang J, Li H. Large language model chatbots for patient-facing erectile dysfunction information: a cross-sectional evaluation of safety, accuracy, empathy, information quality and readability. Sexual Health. 2026;23(6). doi:10.1071/sh26186

BibTeX
@article{Liang2026,
  author = {Liang, Dalian and Zhang, Zhengkun and Zhao, Wenli and Shang, Jingli and Li, Haiyan},
  title = {Large language model chatbots for patient-facing erectile dysfunction information: a cross-sectional evaluation of safety, accuracy, empathy, information quality and readability},
  journal = {Sexual Health},
  year = {2026},
  volume = {23},
  number = {6},
  doi = {10.1071/sh26186}
}
Kostenlos starten →