Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review
Vergleichende Analyse von ChatGPT und Gemini (Bard) in medizinischen Anfragen: Scoping Review
Frontiers in Digital Health · 03.02.2025 · 7
DOI: 10.3389/fdgth.2025.1482712 ↗Auf einen Blick
Die Scoping Review vergleicht ChatGPT und Gemini in medizinischen Anwendungen. ChatGPT war insgesamt genauer und lieferte kürzere Antworten als Gemini.
Fragestellung
Wie unterscheiden sich ChatGPT und Gemini in medizinischen Anfragen hinsichtlich Genauigkeit und Antwortlänge?
Methode
Scoping Review; Suche in englischsprachigen Studien vom 1. Januar bis 20. Oktober 2023.
Ergebnisse
11 Studien mit 1.177 Samples. ChatGPT war in Radiologie genauer (87,43 % vs. 71 %) und kürzer (907 vs. 1.428 Zeichen); p < .001 für beide Maße.
Schlussfolgerung der Autor:innen
Die Scoping Review legt nahe, dass ChatGPT in medizinischen Studien eine höhere Genauigkeit und kürzere Antworten als Gemini zeigen kann.
Kernaussagen
- 11 Studien mit 1.177 Samples
- Radiologie: 87,43 % vs. 71 % und 907 vs. 1.428 Zeichen
- p < .001 für Genauigkeit und Antwortlänge
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Systematische Übersicht in der Zeitschrift Frontiers in Digital Health, online erschienen am 03.02.2025. Verfasst von Fattah H Fattah und 11 weiteren Autor:innen. Beteiligte Einrichtung: Scientific Affairs Department, Smart Health Tower, Sulaymaniyah, Iraq. Die Arbeit wurde bisher 58-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Artificial intelligence and machine learning are popular interconnected technologies. AI chatbots like ChatGPT and Gemini show considerable promise in medical inquiries. This scoping review aims to assess the accuracy and response length (in characters) of ChatGPT and Gemini in medical applications.
Methods
The eligible databases were searched to find studies published in English from January 1 to October 20, 2023. The inclusion criteria consisted of studies that focused on using AI in medicine and assessed outcomes based on the accuracy and character count (length) of ChatGPT and Gemini. Data collected from the studies included the first author's name, the country where the study was conducted, the type of study design, publication year, sample size, medical speciality, and the accuracy and response length.
Results
The initial search identified 64 papers, with 11 meeting the inclusion criteria, involving 1,177 samples. ChatGPT showed higher accuracy in radiology (87.43% vs. Gemini's 71%) and shorter responses (907 vs. 1,428 characters). Similar trends were noted in other specialties. However, Gemini outperformed ChatGPT in emergency scenarios (87% vs. 77%) and in renal diets with low potassium and high phosphorus (79% vs. 60% and 100% vs. 77%). Statistical analysis confirms that ChatGPT has greater accuracy and shorter responses than Gemini in medical studies, with a p -value of <.001 for both metrics.
Conclusion
This Scoping review suggests that ChatGPT may demonstrate higher accuracy and provide shorter responses than Gemini in medical studies.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Scientific Affairs Department, Smart Health Tower, Sulaymaniyah, Iraq.
- College of Medicine, University of Sulaimani, Sulaymaniyah, Iraq.
- Civil Engineering Department, College of Engineering, University of Sulaimani, Sulaymaniyah, Iraq.
- Department of Urology, Sulaimani Surgical Teaching Hospital, Sulaymaniyah, Iraq.
- Kscien Organization for Scientific Research (Middle East Office), Sulaymaniyah, Iraq.
Zitieren
APA
Fattah, F. H., Salih, A. M., Salih, A. M., Asaad, S. K., Ghafour, A. K., Bapir, R., Abdalla, B. A., Othman, S., Ahmed, S. M., Hasan, S. J., Mahmood, Y. M., & Kakamad, F. H. (2025). Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review. Frontiers in Digital Health, 7. https://doi.org/10.3389/fdgth.2025.1482712
Vancouver
Fattah FH, Salih AM, Salih AM, Asaad SK, Ghafour AK, Bapir R, et al. Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review. Frontiers in Digital Health. 2025;7. doi:10.3389/fdgth.2025.1482712
BibTeX
@article{Fattah2025,
author = {Fattah, Fattah H and Salih, Abdulwahid M and Salih, Ameer M and Asaad, Saywan K and Ghafour, Abdullah K and Bapir, Rawa and Abdalla, Berun A and Othman, Snur and Ahmed, Sasan M and Hasan, Sabah Jalal and Mahmood, Yousif M and Kakamad, Fahmi H},
title = {Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review},
journal = {Frontiers in Digital Health},
year = {2025},
volume = {7},
doi = {10.3389/fdgth.2025.1482712}
}
EUVIMED