Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis
Journal of Medical Systems · 03.04.2024 · 48 (1)
DOI: 10.1007/s10916-024-02056-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Systems, online erschienen am 03.04.2024. Verfasst von Mehmet Fatih Şahin und 6 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine Department of Urology, Tekirdağ Namık Kemal University, Süleymanpaşa, Tekirdağ, 59020, Turkey. mfatihsahin@gmail.com. Hauptthemen laut MEDLINE: Artificial Intelligence, Erectile Dysfunction. Die Arbeit wurde bisher 67-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Tekirdag Namık Kemal University.
Abstract (Originalsprache)
The aim of the study is to evaluate and compare the quality and readability of responses generated by five different artificial intelligence (AI) chatbots—ChatGPT, Bard, Bing, Ernie, and Copilot—to the top searched queries of erectile dysfunction (ED). Google Trends was used to identify ED-related relevant phrases. Each AI chatbot received a specific sequence of 25 frequently searched terms as input. Responses were evaluated using DISCERN, Ensuring Quality Information for Patients (EQIP), and Flesch-Kincaid Grade Level (FKGL) and Reading Ease (FKRE) metrics. The top three most frequently searched phrases were “erectile dysfunction cause”, “how to erectile dysfunction,” and “erectile dysfunction treatment.” Zimbabwe, Zambia, and Ghana exhibited the highest level of interest in ED. None of the AI chatbots achieved the necessary degree of readability. However, Bard exhibited significantly higher FKRE and FKGL ratings ( p = 0.001), and Copilot achieved better EQIP and DISCERN ratings than the other chatbots ( p = 0.001). Bard exhibited the simplest linguistic framework and posed the least challenge in terms of readability and comprehension, and Copilot’s text quality on ED was superior to the other chatbots. As new chatbots are introduced, their understandability and text quality increase, providing better guidance to patients.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Medicine Department of Urology, Tekirdağ Namık Kemal University, Süleymanpaşa, Tekirdağ, 59020, Turkey. mfatihsahin@gmail.com.
- Faculty of Medicine Department of Urology, Tekirdağ Namık Kemal University, Süleymanpaşa, Tekirdağ, 59020, Turkey.
- Department of Urology, Bursa State Hospital, Nilüfer, Bursa, 16110, Turkey.
Förderung
- Tekirdag Namık Kemal University
Zitieren
APA
Şahin, M. F., Ateş, H., Keleş, A., Özcan, R., Doğan, Ç., Akgül, M., & Yazıcı, C. M. (2024). Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis. Journal of Medical Systems, 48(1). https://doi.org/10.1007/s10916-024-02056-0
Vancouver
Şahin MF, Ateş H, Keleş A, Özcan R, Doğan Ç, Akgül M, et al. Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis. Journal of Medical Systems. 2024;48(1). doi:10.1007/s10916-024-02056-0
BibTeX
@article{ahin2024,
author = {Şahin, Mehmet Fatih and Ateş, Hüseyin and Keleş, Anıl and Özcan, Rıdvan and Doğan, Çağrı and Akgül, Murat and Yazıcı, Cenk Murat},
title = {Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis},
journal = {Journal of Medical Systems},
year = {2024},
volume = {48},
number = {1},
doi = {10.1007/s10916-024-02056-0}
}
EUVIMED