Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study
European Journal of Dental Education · 05.11.2026
DOI: 10.1111/eje.70338 ↗Kurz gefasst
Fachartikel in der Zeitschrift European Journal of Dental Education, online erschienen am 05.11.2026. Verfasst von Sholem Hack und 6 weiteren Autor:innen. Beteiligte Einrichtung: City St. George's University London School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Isra…. Die Arbeit nennt 52 Literaturangaben.
Abstract (Originalsprache)
Objective
To evaluate whether dental professionals can distinguish human‐authored from generative artificial intelligence (GenAI)‐generated dental research abstracts under blinded conditions and to explore differences in detectability across contemporary large language models (LLMs).
Methods
In this exploratory blinded cross‐sectional study, 23 dental professionals (10 general dentists, 7 specialists, 6 dental students) evaluated 60 abstracts derived from 15 published dental research articles: the 15 published abstracts and 45 GenAI‐generated abstracts produced from the main text of the same articles by Claude Sonnet 4.6, GPT‐5.4 and Gemini 3. Participants classified each abstract as human‐authored, AI‐generated or ‘Unsure’ and rated confidence, quality and credibility on five‐point scales. Discrimination was assessed using sensitivity, specificity, balanced accuracy and signal‐detection measures, with a probit mixed‐effects model accounting for variability between participants, abstracts and source articles.
Results
Of 1377 classifications, 10.0% were ‘Unsure’. Balanced accuracy was 56.0% (95% CI 49.6%–62.4%) and did not differ significantly from chance ( p = 0.070). In the mixed‐effects model, discrimination was weak and not statistically significant ( d ' = 0.39, 95% CI −0.08–0.86) and participants showed no systematic response bias. Detectability did not differ between LLMs ( p = 0.157) or expertise groups ( p = 0.99). Confidence was not calibrated to accuracy (mean 3.58 for correct vs. 3.61 for incorrect classifications, p = 0.75) and GenAI‐generated abstracts were not rated lower than human‐authored abstracts in quality or credibility. Findings were consistent across sensitivity analyses.
Conclusion
Dental professionals showed limited ability to distinguish human‐authored from fully GenAI‐generated dental research abstracts, regardless of expertise or LLM and their confidence did not reflect their accuracy. These exploratory findings support explicit training in AI literacy and critical appraisal within dental education, rather than reliance on stylistic intuition.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- City St. George's University London School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Israel.
- Department of Oral Rehabilitation, The Maurice and Gabriela Goldschleger School of Dental Medicine, Tel-Aviv University, Tel Aviv, Israel.
- Department of Otolaryngology-Head and Neck Surgery, Meir Medical Center, Kfar Saba, Israel.
- Gray Faculty of Medical & Health Sciences, Tel-Aviv University, Tel Aviv, Israel.
ORCID-Profile: Sholem Hack, Amir Laviv, Ameen Biadsee, Ameer Biadsee
Zitieren
APA
Hack, S., Masri, M., Reema, Y., Laviv, A., Attal, R., Biadsee, A., & Biadsee, A. (2026). Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study. European Journal of Dental Education. https://doi.org/10.1111/eje.70338
Vancouver
Hack S, Masri M, Reema Y, Laviv A, Attal R, Biadsee A, et al. Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study. European Journal of Dental Education. 2026. doi:10.1111/eje.70338
BibTeX
@article{Hack2026,
author = {Hack, Sholem and Masri, Mahmoud and Reema, Yusef and Laviv, Amir and Attal, Rebecca and Biadsee, Ameen and Biadsee, Ameer},
title = {Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study},
journal = {European Journal of Dental Education},
year = {2026},
doi = {10.1111/eje.70338}
}
EUVIMED