EUVIMEDEUVIMED entdecken
Beobachtungsstudie

Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study

Mohammed Najmuddin iD

Dentomaxillofacial Radiology · 2025

DOI: 10.1093/dmfr/twaf085 ↗

Kurz gefasst

Beobachtungsstudie in der Zeitschrift Dentomaxillofacial Radiology, 2025. Verfasst von Mohammed Najmuddin. Beteiligte Einrichtung: Department of Oral and Maxillofacial Surgery and Diagnostic Sciences, Division of Diagnostic Sciences, College of Dentistry, Jazan University, Jazan …. Hauptthemen laut MEDLINE: Artificial Intelligence, Educational Measurement, Radiography, Dental. Die Arbeit nennt 27 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

The objective was to assess the accuracy of different AI tools in providing the right responses for multiple choice questions (MCQs) and the time taken to complete the responses.

Methods

The study included 80 MCQs, each with 4 options and a correct answer related to oral radiology used to assess the knowledge and skill across 5 different domains. The accuracy levels of ChatGPT, ChatGPT-4o (4o), Microsoft Co-pilot, DeepSeek, Gemini, and Meta AI were assessed and compared using the Chi-Square test. In addition, One-way ANOVA was used to compare the response time between different AI chatbots.

Results

Overall, Microsoft Co-pilot and ChatGPT-4o had the highest accuracy. ChatGPT had the fastest response time. Microsoft Co-pilot and DeepSeek, though not significant, had the highest accuracy for knowledge-based and skill-based queries. For accuracy on 5 domains, Microsoft Co-pilot and ChatGPT-4o had an accuracy of 100% for radiographic safety and DeepSeek was more accurate for radiographic diagnosis. Students took more time to respond than the collective time taken by AI chatbots.

Conclusion

Microsoft Co-pilot had an overall higher accuracy, responded more accurately for knowledge-based questions, and was 100% accurate for queries related to radiographic safety. ChatGPT-4o had the second highest accuracy and DeepSeek served better for radiographic diagnosis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceEducational MeasurementRadiography, DentalHumansClinical Competence

Stichwörter der Autor:innen

AI chatbotsChatGPT-4o accuracyMicrosoft Co-pilotartificial intelligenceoral radiology

Autor:innen und Institutionen

  • Department of Oral and Maxillofacial Surgery and Diagnostic Sciences, Division of Diagnostic Sciences, College of Dentistry, Jazan University, Jazan 82848, KSA.

ORCID-Profile: Mohammed Najmuddin

Zitieren

APA

Najmuddin, M. (2025). Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study. Dentomaxillofacial Radiology. https://doi.org/10.1093/dmfr/twaf085

Vancouver

Najmuddin M. Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study. Dentomaxillofacial Radiology. 2025. doi:10.1093/dmfr/twaf085

BibTeX
@article{Najmuddin2025,
  author = {Najmuddin, Mohammed},
  title = {Assessing the accuracy of multiple-choice questions using different artificial intelligence-driven tools—an observational study},
  journal = {Dentomaxillofacial Radiology},
  year = {2025},
  doi = {10.1093/dmfr/twaf085}
}
Kostenlos starten →