Comparative Accuracy of ChatGPT 4.0 and Google Gemini in Answering Pediatric Radiology Text-Based Questions
Cureus · 05.10.2024
DOI: 10.7759/cureus.70897 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cureus, erschienen am 05.10.2024. Verfasst von Mohammed Abdul Sami und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Diagnostic Radiology and Nuclear Medicine, Rush University Medical Center, Chicago, USA. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
AIMS AND OBJECTIVES: This study evaluates the accuracy of two AI language models, ChatGPT 4.0 and Google Gemini (as of August 2024), in answering a set of 79 text-based pediatric radiology questions from "Pediatric Imaging: A Core Review." Accurate interpretation of text and images is critical in radiology, making AI tools valuable in medical education. METHODS: The study involved 79 questions selected from a pediatric radiology question set, focusing solely on text-based questions. ChatGPT 4.0 and Google Gemini answered these questions, and their responses were evaluated using a binary scoring system. Statistical analyses, including chi-square tests and relative risk (RR) calculations, were performed to compare the overall and subsection accuracy of the models. RESULTS: ChatGPT 4.0 demonstrated superior accuracy, correctly answering 83.5% (66/79) of the questions, compared to Google Gemini's 68.4% (54/79), with a statistically significant difference (p=0.0255, RR=1.221). No statistically significant differences were found between the models within individual subsections, with p-values ranging from 0.136 to 1. CONCLUSION: ChatGPT 4.0 outperformed Google Gemini in overall accuracy for text-based pediatric radiology questions, highlighting its potential utility in medical education. However, the lack of significant differences within subsections and the exclusion of image-based questions underscore the need for further research with larger sample sizes and multimodal inputs to fully assess AI models' capabilities in radiology.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Diagnostic Radiology and Nuclear Medicine, Rush University Medical Center, Chicago, USA.
- Department of Diagnostic Radiology, Des Moines University College of Osteopathic Medicine, West Des Moines, USA.
Zitieren
APA
Abdul Sami, M., Abdul Samad, M., Parekh, K., & Suthar, P. P. (2024). Comparative Accuracy of ChatGPT 4.0 and Google Gemini in Answering Pediatric Radiology Text-Based Questions. Cureus. https://doi.org/10.7759/cureus.70897
Vancouver
Abdul Sami M, Abdul Samad M, Parekh K, Suthar PP. Comparative Accuracy of ChatGPT 4.0 and Google Gemini in Answering Pediatric Radiology Text-Based Questions. Cureus. 2024. doi:10.7759/cureus.70897
BibTeX
@article{AbdulSami2024,
author = {Abdul Sami, Mohammed and Abdul Samad, Mohammed and Parekh, Keyur and Suthar, Pokhraj P},
title = {Comparative Accuracy of ChatGPT 4.0 and Google Gemini in Answering Pediatric Radiology Text-Based Questions},
journal = {Cureus},
year = {2024},
doi = {10.7759/cureus.70897}
}
EUVIMED