EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Evaluating AI-Generated informed consent documents in oral surgery: A comparative study of ChatGPT-4, Bard gemini advanced, and human-written consents

Luigi Angelo Vaira, Jerome R Lechien, Antonino Maniaci, Giuseppe Tanda, Vincenzo Abbate, Fabiana Allevi, Antonio Arena, Giada Anna Beltramini, Michela Bergonzani, Alessandro Remigio Bolzoni, Salvatore Crimi, Andrea Frosolini und 14 weitere

Journal of Cranio-Maxillofacial Surgery · 2025-01 · 53 (1) · 18-23

DOI: 10.1016/j.jcms.2024.10.002 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Journal of Cranio-Maxillofacial Surgery, 2025-01. Verfasst von Luigi Angelo Vaira und 25 weiteren Autor:innen. Beteiligte Einrichtung: Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy; PhD School of Biomedical S…. Hauptthemen laut MEDLINE: Consent Forms. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Sassari.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluates the quality and readability of informed consent documents generated by AI platforms ChatGPT-4 and Bard Gemini Advanced compared to those written by a first-year oral surgery resident for common oral surgery procedures. The evaluation, conducted by 18 experienced oral and maxillofacial surgeons, assessed consents for accuracy, completeness, readability, and overall quality. ChatGPT-4 consistently outperformed both Bard and human-written consents. ChatGPT-4 consents had a median accuracy score of 4 [IQR 4-4], compared to Bard's 3 [IQR 3-4] and human's 4 [IQR 3-4]. Completeness scores were higher for ChatGPT-4 (4 [IQR 4-5]) than Bard (3 [IQR 3-4]) and human (4 [IQR 3-4]). Readability was also superior for ChatGPT-4, with a median score of 4 [IQR 4-5] compared to Bard and human consents, both at 4 [IQR 4-4] and 4 [IQR 3-4], respectively. The Gunning Fog Index for ChatGPT-4 was 17.2 [IQR 16.5-18.2], better than Bard's 23.1 [IQR 20.5-24.7] and the human consents' 20 [IQR 19.2-20.9]. Overall, ChatGPT-4's consents received the highest quality ratings, underscoring AI's potential in enhancing patient communication and the informed consent process. The study suggests AI can reduce misinformation risks and improve patient understanding, but continuous evaluation, oversight, and patient feedback integration are crucial to ensure the effectiveness and appropriateness of AI-generated content in clinical practice.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Consent FormsHumansComprehensionOral Surgical ProceduresSurgery, OralInformed Consent

Stichwörter der Autor:innen

AI in healthcareArtificial intelligenceConsent accuracyDocument qualityInformed consentLarge language modelsMaxillofacial surgeryOral surgeryPatient education

Autor:innen und Institutionen

  • Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy; PhD School of Biomedical Science, Biomedical Sciences Department, University of Sassari, Sassari…
  • Department of Anatomy and Experimental Oncology, Mons School of Medicine, UMONS. Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium; Department of Otolaryngology-Head Neck S…
  • Department of Medicine and Surgery, University of Enna Kore, Enna, Italy.
  • Dental School, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy.
  • Head and Neck Section, Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy.
  • Maxillofacial Surgery Department, ASSt Santi Paolo e Carlo, University of Milan, Milan, Italy.

Förderung

  • University of Sassari

Zitieren

APA

Vaira, L. A., Lechien, J. R., Maniaci, A., Tanda, G., Abbate, V., Allevi, F., Arena, A., Beltramini, G. A., Bergonzani, M., Bolzoni, A. R., Crimi, S., Frosolini, A., Gabriele, G., Maglitto, F., Mayo-Yáñez, M., Orrù, L., Petrocelli, M., Pucci, R., Saibene, A. M., …, & De Riu, G. (2025). Evaluating AI-Generated informed consent documents in oral surgery: A comparative study of ChatGPT-4, Bard gemini advanced, and human-written consents. Journal of Cranio-Maxillofacial Surgery, 53(1), 18-23. https://doi.org/10.1016/j.jcms.2024.10.002

Vancouver

Vaira LA, Lechien JR, Maniaci A, Tanda G, Abbate V, Allevi F, et al. Evaluating AI-Generated informed consent documents in oral surgery: A comparative study of ChatGPT-4, Bard gemini advanced, and human-written consents. Journal of Cranio-Maxillofacial Surgery. 2025;53(1):18-23. doi:10.1016/j.jcms.2024.10.002

BibTeX
@article{Vaira2025,
  author = {Vaira, Luigi Angelo and Lechien, Jerome R and Maniaci, Antonino and Tanda, Giuseppe and Abbate, Vincenzo and Allevi, Fabiana and Arena, Antonio and Beltramini, Giada Anna and Bergonzani, Michela and Bolzoni, Alessandro Remigio and Crimi, Salvatore and Frosolini, Andrea and Gabriele, Guido and Maglitto, Fabio and Mayo-Yáñez, Miguel and Orrù, Ludovica and Petrocelli, Marzia and Pucci, Resi and Saibene, Alberto Maria and Troise, Stefania and Tel, Alessandro and Vellone, Valentino and Chiesa-Estomba, Carlos Miguel and Boscolo-Rizzo, Paolo and Salzano, Giovanni and De Riu, Giacomo},
  title = {Evaluating AI-Generated informed consent documents in oral surgery: A comparative study of ChatGPT-4, Bard gemini advanced, and human-written consents},
  journal = {Journal of Cranio-Maxillofacial Surgery},
  year = {2025},
  volume = {53},
  number = {1},
  pages = {18--23},
  doi = {10.1016/j.jcms.2024.10.002}
}
Kostenlos starten →