Comparative Evaluation of Chatgpt, Gemini and Grok with and without Deep Research Mode in Answering Bone Augmentation Queries
Mugla Journal of Science and Technology · 30.06.2026 · 12 (1) · 85-100
DOI: 10.22531/muglajsci.1862743 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mugla Journal of Science and Technology, online erschienen am 30.06.2026. Verfasst von Ali Batuhan Bayırlı und 3 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben.
Abstract (Originalsprache)
This study aimed to evaluate the information generation performance of four large language models (ChatGPT-o1-pro, ChatGPT-4o, Gemini 2.5 Flash, and Grok-3) using multidimensional criteria, based on their responses to expert-level questions in the field of intraoral bone augmentation. In addition, the study investigated the effect of enabling Deep Search mode on model performance. A total of 20 expert-generated questions, developed with input from domain specialists, were submitted to each model under two different retrieval configurations, including Deep Search. The responses were assessed independently by two periodontology experts in terms of accuracy, content quality, readability, and reading level. The findings indicated that the ChatGPT-o1-pro model with Deep Search achieved the highest and most balanced performance across all evaluation criteria. Similarly, ChatGPT-4o with Deep Search demonstrated strong performance, particularly in accuracy and content quality, although its readability was comparatively lower. In contrast, Gemini 2.5 Flash and Grok-3 showed relatively weaker performance across all dimensions. Overall, the results revealed that activating Deep Search mode provided a statistically significant improvement in performance. These findings underscore the growing potential of large language models in clinically complex and information-intensive domains such as dentistry. The results also suggest that, beyond model selection, the operational mode—particularly the use of advanced retrieval configurations—plays a crucial role in determining the quality of generated information.
Zitieren
APA
Bayırlı, A. B., Uytun, M., Erdem, R., & Genç, Y. S. (2026). Comparative Evaluation of Chatgpt, Gemini and Grok with and without Deep Research Mode in Answering Bone Augmentation Queries. Mugla Journal of Science and Technology, 12(1), 85-100. https://doi.org/10.22531/muglajsci.1862743
Vancouver
Bayırlı AB, Uytun M, Erdem R, Genç YS. Comparative Evaluation of Chatgpt, Gemini and Grok with and without Deep Research Mode in Answering Bone Augmentation Queries. Mugla Journal of Science and Technology. 2026;12(1):85-100. doi:10.22531/muglajsci.1862743
BibTeX
@article{Bayrl2026,
author = {Bayırlı, Ali Batuhan and Uytun, Mehmetcan and Erdem, Ruşen and Genç, Yavuz Selim},
title = {Comparative Evaluation of Chatgpt, Gemini and Grok with and without Deep Research Mode in Answering Bone Augmentation Queries},
journal = {Mugla Journal of Science and Technology},
year = {2026},
volume = {12},
number = {1},
pages = {85--100},
doi = {10.22531/muglajsci.1862743}
}
EUVIMED