EUVIMEDEUVIMED entdecken
Crossref

Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study

Sholem Hack iD, Mahmoud Masri, Yusef Reema, Amir Laviv iD, Rebecca Attal, Ameen Biadsee iD, Ameer Biadsee iD

European Journal of Dental Education · 05.11.2026

DOI: 10.1111/eje.70338 ↗

Kurz gefasst

Fachartikel in der Zeitschrift European Journal of Dental Education, online erschienen am 05.11.2026. Verfasst von Sholem Hack und 6 weiteren Autor:innen. Beteiligte Einrichtung: City St. George's University London School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Isra…. Die Arbeit nennt 52 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To evaluate whether dental professionals can distinguish human‐authored from generative artificial intelligence (GenAI)‐generated dental research abstracts under blinded conditions and to explore differences in detectability across contemporary large language models (LLMs).

Methods

In this exploratory blinded cross‐sectional study, 23 dental professionals (10 general dentists, 7 specialists, 6 dental students) evaluated 60 abstracts derived from 15 published dental research articles: the 15 published abstracts and 45 GenAI‐generated abstracts produced from the main text of the same articles by Claude Sonnet 4.6, GPT‐5.4 and Gemini 3. Participants classified each abstract as human‐authored, AI‐generated or ‘Unsure’ and rated confidence, quality and credibility on five‐point scales. Discrimination was assessed using sensitivity, specificity, balanced accuracy and signal‐detection measures, with a probit mixed‐effects model accounting for variability between participants, abstracts and source articles.

Results

Of 1377 classifications, 10.0% were ‘Unsure’. Balanced accuracy was 56.0% (95% CI 49.6%–62.4%) and did not differ significantly from chance ( p = 0.070). In the mixed‐effects model, discrimination was weak and not statistically significant ( d ' = 0.39, 95% CI −0.08–0.86) and participants showed no systematic response bias. Detectability did not differ between LLMs ( p = 0.157) or expertise groups ( p = 0.99). Confidence was not calibrated to accuracy (mean 3.58 for correct vs. 3.61 for incorrect classifications, p = 0.75) and GenAI‐generated abstracts were not rated lower than human‐authored abstracts in quality or credibility. Findings were consistent across sensitivity analyses.

Conclusion

Dental professionals showed limited ability to distinguish human‐authored from fully GenAI‐generated dental research abstracts, regardless of expertise or LLM and their confidence did not reflect their accuracy. These exploratory findings support explicit training in AI literacy and critical appraisal within dental education, rather than reliance on stylistic intuition.

Schlagwörter

Stichwörter der Autor:innen

authorship detectiondentistrygenerative artificial intelligencelarge language modelsscientific abstracts

Autor:innen und Institutionen

  • City St. George's University London School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Israel.
  • Department of Oral Rehabilitation, The Maurice and Gabriela Goldschleger School of Dental Medicine, Tel-Aviv University, Tel Aviv, Israel.
  • Department of Otolaryngology-Head and Neck Surgery, Meir Medical Center, Kfar Saba, Israel.
  • Gray Faculty of Medical & Health Sciences, Tel-Aviv University, Tel Aviv, Israel.

ORCID-Profile: Sholem Hack, Amir Laviv, Ameen Biadsee, Ameer Biadsee

Zitieren

APA

Hack, S., Masri, M., Reema, Y., Laviv, A., Attal, R., Biadsee, A., & Biadsee, A. (2026). Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study. European Journal of Dental Education. https://doi.org/10.1111/eje.70338

Vancouver

Hack S, Masri M, Reema Y, Laviv A, Attal R, Biadsee A, et al. Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study. European Journal of Dental Education. 2026. doi:10.1111/eje.70338

BibTeX
@article{Hack2026,
  author = {Hack, Sholem and Masri, Mahmoud and Reema, Yusef and Laviv, Amir and Attal, Rebecca and Biadsee, Ameen and Biadsee, Ameer},
  title = {Can Dental Professionals Distinguish Human‐Authored From AI ‐Generated Scientific Abstracts? A Blinded Cross‐Sectional Study},
  journal = {European Journal of Dental Education},
  year = {2026},
  doi = {10.1111/eje.70338}
}
Kostenlos starten →