EUVIMEDEUVIMED entdecken
Leitlinie

Conformity of ChatGPT recommendations with the AUA/SUFU guideline on postprostatectomy urinary incontinence

Vicktor B P Pinto iD, Matheus F de Azevedo, Marcelo L Wroclawski, Guilherme Gentile, Vinicius L M Jesus, Jose de Bessa Junior, William C Nahas, Carlos A R Sacomani, Jaspreet S Sandhu, Cristiano M Gomes iD

Neurourology and Urodynamics · 2024

DOI: 10.1002/nau.25442 ↗

Kurz gefasst

Leitlinie in der Zeitschrift Neurourology and Urodynamics, 2024. Verfasst von Vicktor B P Pinto und 9 weiteren Autor:innen. Beteiligte Einrichtung: Division of Urology, University of Sao Paulo School of Medicine, Sao Paulo, Brazil. Hauptthemen laut MEDLINE: Artificial Intelligence, Urinary Incontinence. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 17 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Artificial intelligence (AI) shows immense potential in medicine and Chat generative pretrained transformer (ChatGPT) has been used for different purposes in the field. However, it may not match the complexity and nuance of certain medical scenarios. This study evaluates the accuracy of ChatGPT 3.5 and 4 in providing recommendations regarding the management of postprostatectomy urinary incontinence (PPUI), considering The Incontinence After Prostate Treatment: AUA/SUFU Guideline as the best practice benchmark. Materials and Methods A set of questions based on the AUA/SUFU Guideline was prepared. Queries included 10 conceptual questions and 10 case‐based questions. All questions were open and entered into the ChatGPT with a recommendation to limit the answer to 200 words, for greater objectivity. Responses were graded as correct (1 point); partially correct (0.5 point), or incorrect (0 point). Performances of versions 3.5 and 4 of ChatGPT were analyzed overall and separately for the conceptual and the case‐based questions.

Results

ChatGPT 3.5 scored 11.5 out of 20 points (57.5% accuracy), while ChatGPT 4 scored 18 (90.0%; p = 0.031). In the conceptual questions, ChatGPT 3.5 provided accurate answers to six questions along with one partially correct response and three incorrect answers, with a final score of 6.5. In contrast, ChatGPT 4 provided correct answers to eight questions and partially correct answers to two questions, scoring 9.0. In the case‐based questions, ChatGPT 3.5 scored 5.0, while ChatGPT 4 scored 9.0. The domains where ChatGPT performed worst were evaluation, treatment options, surgical complications, and special situations.

Conclusion

ChatGPT 4 demonstrated superior performance compared to ChatGPT 3.5 in providing recommendations for the management of PPUI, using the AUA/SUFU Guideline as a benchmark. Continuous monitoring is essential for evaluating the development and precision of AI‐generated medical information.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceUrinary IncontinenceMaleHumansSocial BehaviorPelvisProstatectomyRepressor Proteins

Stichwörter der Autor:innen

ChatGPTartificial intelligenceprostatectomyurinary incontinenceurology

Substanzen

SUFU protein, humanRepressor Proteins

Autor:innen und Institutionen

  • Division of Urology, University of Sao Paulo School of Medicine, Sao Paulo, Brazil.
  • Division of Urology, ABC Medical School, Sao Paulo, Brazil.
  • Department of Urology, Albert Einstein Jewish Hospital, Sao Paulo, Brazil.
  • Department of Urologic Oncology, BP-a Beneficência Portuguesa de São Paulo, Sao Paulo, Brazil.
  • Department of Surgery, State University of Feira de Santana, Bahia, Brazil.
  • Innovation and Information Technology Sector, AC Camargo Cancer Hospital, Sao Paulo, Brazil.

ORCID-Profile: Vicktor B P Pinto, Cristiano M Gomes

Zitieren

APA

Pinto, V. B. P., de Azevedo, M. F., Wroclawski, M. L., Gentile, G., Jesus, V. L. M., de Bessa Junior, J., Nahas, W. C., Sacomani, C. A. R., Sandhu, J. S., & Gomes, C. M. (2024). Conformity of ChatGPT recommendations with the AUA/SUFU guideline on postprostatectomy urinary incontinence. Neurourology and Urodynamics. https://doi.org/10.1002/nau.25442

Vancouver

Pinto VBP, de Azevedo MF, Wroclawski ML, Gentile G, Jesus VLM, de Bessa Junior J, et al. Conformity of ChatGPT recommendations with the AUA/SUFU guideline on postprostatectomy urinary incontinence. Neurourology and Urodynamics. 2024. doi:10.1002/nau.25442

BibTeX
@article{Pinto2024,
  author = {Pinto, Vicktor B P and de Azevedo, Matheus F and Wroclawski, Marcelo L and Gentile, Guilherme and Jesus, Vinicius L M and de Bessa Junior, Jose and Nahas, William C and Sacomani, Carlos A R and Sandhu, Jaspreet S and Gomes, Cristiano M},
  title = {Conformity of ChatGPT recommendations with the AUA/SUFU guideline on postprostatectomy urinary incontinence},
  journal = {Neurourology and Urodynamics},
  year = {2024},
  doi = {10.1002/nau.25442}
}
Kostenlos starten →