Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study
Dentomaxillofacial Radiology · 2025
DOI: 10.1093/dmfr/twaf085 ↗Kurz gefasst
Beobachtungsstudie in der Zeitschrift Dentomaxillofacial Radiology, 2025. Verfasst von Mohammed Najmuddin. Beteiligte Einrichtung: Department of Oral and Maxillofacial Surgery and Diagnostic Sciences, Division of Diagnostic Sciences, College of Dentistry, Jazan University, Jazan …. Hauptthemen laut MEDLINE: Artificial Intelligence, Educational Measurement, Radiography, Dental. Die Arbeit nennt 27 Literaturangaben.
Abstract (Originalsprache)
Objectives
The objective was to assess the accuracy of different AI tools in providing the right responses for multiple choice questions (MCQs) and the time taken to complete the responses.
Methods
The study included 80 MCQs, each with 4 options and a correct answer related to oral radiology used to assess the knowledge and skill across 5 different domains. The accuracy levels of ChatGPT, ChatGPT-4o (4o), Microsoft Co-pilot, DeepSeek, Gemini, and Meta AI were assessed and compared using the Chi-Square test. In addition, One-way ANOVA was used to compare the response time between different AI chatbots.
Results
Overall, Microsoft Co-pilot and ChatGPT-4o had the highest accuracy. ChatGPT had the fastest response time. Microsoft Co-pilot and DeepSeek, though not significant, had the highest accuracy for knowledge-based and skill-based queries. For accuracy on 5 domains, Microsoft Co-pilot and ChatGPT-4o had an accuracy of 100% for radiographic safety and DeepSeek was more accurate for radiographic diagnosis. Students took more time to respond than the collective time taken by AI chatbots.
Conclusion
Microsoft Co-pilot had an overall higher accuracy, responded more accurately for knowledge-based questions, and was 100% accurate for queries related to radiographic safety. ChatGPT-4o had the second highest accuracy and DeepSeek served better for radiographic diagnosis.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Oral and Maxillofacial Surgery and Diagnostic Sciences, Division of Diagnostic Sciences, College of Dentistry, Jazan University, Jazan 82848, KSA.
ORCID-Profile: Mohammed Najmuddin
Zitieren
APA
Najmuddin, M. (2025). Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study. Dentomaxillofacial Radiology. https://doi.org/10.1093/dmfr/twaf085
Vancouver
Najmuddin M. Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study. Dentomaxillofacial Radiology. 2025. doi:10.1093/dmfr/twaf085
BibTeX
@article{Najmuddin2025,
author = {Najmuddin, Mohammed},
title = {Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study},
journal = {Dentomaxillofacial Radiology},
year = {2025},
doi = {10.1093/dmfr/twaf085}
}
EUVIMED