EUVIMEDEUVIMED entdecken
Crossref

Assessing the Knowledge of ChatGPT in Answering Questions Regarding Female Urology.

Hakan Cakir, Ufuk Caglar, Ahmet Halis, Omer Sarilar, Huseyin Burak Yazili, Faruk Ozgor

Urology journal./Urology jornal. · 27.11.2024 · 21 (6) · 410-414

DOI: 10.22037/uj.v21i.8194 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Urology journal./Urology jornal., erschienen am 27.11.2024. Verfasst von Hakan Cakir und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Urology, Fulya Acibadem Hospital, Istanbul, Turkey. hakancakirmd@gmail.com. Hauptthemen laut MEDLINE: Urology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE: With the recent increase in the use of artificial intelligence in the medical field, this study aimed to evaluate the accuracy and adequacy of ChatGPT's responses to questions related to female urology. METHODS: Intensive internet research was performed to prepare a frequently asked question (FAQs) list. Scientific questions were created in accordance with the European Urology Association (EAU) Non-neurogenic Female Lower Urinary Tract Symptoms Guidelines, EAU Chronic Pelvis Pain Guidelines, and EAU Neuro-Urology Guidelines. All answers by ChatGPT were analysed by two experienced urologists and each answer was scored between 1 and 4 by the physicians. A score of 1 was the highest and showed that the answer was completely true and sufficient. The reproducibility of ChatGPT answers was evaluated by asking each question twice using two different computers. RESULTS: A total of 96 (97.0%) ChatGPT answers about female urology were accurate and sufficient, and categorized as grade 1. Additionally, two (2.0%) answers were scored as grade 2, and one answer (1.0%) was scored as grade 3. None of ChatGPT's responses about female urology were classified as grade 4. In total, 83 questions were prepared according to EAU guidelines recommendations, and ChatGPT gave complete accurate and satisfactory answers for 68 (82.9%) questions. The reproducibility rate was highest for ChatGPT answers for questions related to urinary incontinence, pelvic organ prolapses, and pelvic pain syndromes, and reproducibility rate was 100% for each subgroup. The reproducibility rate for ChatGPT answers was lowest for CPG questions (84.1%). CONCLUSION: For the first time our study revealed that ChatGPT had an excellent accuracy rate in answering questions related to female urology with 97% success rate. In addition, the outcomes of this study showed that ChatGPT accurately and satisfactorily answered 82.9% of questions about female urology based on EAU guidelines.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

UrologyHumansFemaleSurveys and QuestionnairesReproducibility of ResultsInternet

Autor:innen und Institutionen

  • Department of Urology, Fulya Acibadem Hospital, Istanbul, Turkey. hakancakirmd@gmail.com.
  • Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey. ufukcglr@gmail.com.
  • Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey. dr.ahmethls@gmail.com.
  • Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey. Omersarilar58@yahoo.com.
  • Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey. yaziliburak@gmail.com.
  • Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey. md.farukozgor@gmail.com.

Zitieren

APA

Cakir, H., Caglar, U., Halis, A., Sarilar, O., Yazili, H. B., & Ozgor, F. (2024). Assessing the Knowledge of ChatGPT in Answering Questions Regarding Female Urology. Urology journal./Urology jornal., 21(6), 410-414. https://doi.org/10.22037/uj.v21i.8194

Vancouver

Cakir H, Caglar U, Halis A, Sarilar O, Yazili HB, Ozgor F. Assessing the Knowledge of ChatGPT in Answering Questions Regarding Female Urology. Urology journal./Urology jornal.. 2024;21(6):410-414. doi:10.22037/uj.v21i.8194

BibTeX
@article{Cakir2024,
  author = {Cakir, Hakan and Caglar, Ufuk and Halis, Ahmet and Sarilar, Omer and Yazili, Huseyin Burak and Ozgor, Faruk},
  title = {Assessing the Knowledge of ChatGPT in Answering Questions Regarding Female Urology},
  journal = {Urology journal./Urology jornal.},
  year = {2024},
  volume = {21},
  number = {6},
  pages = {410--414},
  doi = {10.22037/uj.v21i.8194}
}
Kostenlos starten →