EUVIMEDEUVIMED entdecken
Beobachtungsstudie

Accuracy and Consistency of Gemini Responses Regarding the Management of Traumatized Permanent Teeth

Nicolas Dufey Portilla iD, Marc Garcia-Font iD, Venkateshbabu Nagendrababu iD, Paul V Abbott, Jose Antonio Gonzalez Sanchez, Francesc Abella

Dental Traumatology · 2025-04 · 41 (2) · 171-177

DOI: 10.1111/edt.13004 ↗

Kurz gefasst

Beobachtungsstudie in der Zeitschrift Dental Traumatology, online erschienen am 26.10.2024. Verfasst von Nicolas Dufey Portilla und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Endodontics, School of Dentistry, Universitat International de Catalunya, Barcelona, Spain. Hauptthemen laut MEDLINE: Tooth Injuries, Endodontics. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 28 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The aim of this cross‐sectional observational analytical study was to assess the accuracy and consistency of responses provided by Google Gemini (GG), a free‐access high‐performance multimodal large language model, to questions related to the European Society of Endodontology position statement on the management of traumatized permanent teeth (MTPT). Materials and Methods Three academic endodontists developed a set of 99 yes/no questions covering all areas of the MTPT. Nine general dentists and 22 endodontic specialists evaluated these questions for clarity and comprehension through an iterative process. Two academic dental trauma experts categorized the knowledge required to answer each question into three levels. The three academic endodontists submitted the 99 questions to the GG, resulting in 297 responses, which were then assessed for accuracy and consistency. Accuracy was evaluated using the Wald binomial method, while the consistency of GG responses was assessed using the kappa‐Fleiss coefficient with a confidence interval of 95%. A 5% significance level chi‐squared test was used to evaluate the influence of question level of knowledge on accuracy and consistency.

Results

The responses generated by Gemini showed an overall moderate accuracy of 80.81%, with no significant differences found between the responses of the academic endodontists. Overall, high consistency (95.96%) was demonstrated, with no significant differences between GG responses across the three accounts. The analysis also revealed no correlation between question level of knowledge and accuracy or consistency, with no significant differences.

Conclusions

The results of this study could significantly impact the potential use of Gemini as a free‐access source of information for clinicians in the MTPT.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Tooth InjuriesEndodonticsHumansCross-Sectional StudiesSurveys and QuestionnairesDentition, Permanent

Stichwörter der Autor:innen

Google Geminiartificial intelligencedental traumaendodontic managementlarge language modelstooth injuries

Autor:innen und Institutionen

  • Department of Endodontics, School of Dentistry, Universitat International de Catalunya, Barcelona, Spain.
  • Department of Endodontics, School of Dentistry, Universidad Andres Bello, Viña del Mar, Chile.
  • Department of Preventive and Restorative Dentistry, College of Dental Medicine, University of Sharjah, Sharjah, UAE.
  • UWA Dental School, The University of Western Australia, Perth, Western Australia, Australia.

ORCID-Profile: Nicolas Dufey Portilla, Marc Garcia-Font, Venkateshbabu Nagendrababu

Zitieren

APA

Portilla, N. D., Garcia-Font, M., Nagendrababu, V., Abbott, P. V., Sanchez, J. A. G., & Abella, F. (2025). Accuracy and Consistency of Gemini Responses Regarding the Management of Traumatized Permanent Teeth. Dental Traumatology, 41(2), 171-177. https://doi.org/10.1111/edt.13004

Vancouver

Portilla ND, Garcia-Font M, Nagendrababu V, Abbott PV, Sanchez JAG, Abella F. Accuracy and Consistency of Gemini Responses Regarding the Management of Traumatized Permanent Teeth. Dental Traumatology. 2025;41(2):171-177. doi:10.1111/edt.13004

BibTeX
@article{Portilla2025,
  author = {Portilla, Nicolas Dufey and Garcia-Font, Marc and Nagendrababu, Venkateshbabu and Abbott, Paul V and Sanchez, Jose Antonio Gonzalez and Abella, Francesc},
  title = {Accuracy and Consistency of Gemini Responses Regarding the Management of Traumatized Permanent Teeth},
  journal = {Dental Traumatology},
  year = {2025},
  volume = {41},
  number = {2},
  pages = {171--177},
  doi = {10.1111/edt.13004}
}
Kostenlos starten →