Content analysis of AI-generated (ChatGPT) responses concerning orthodontic clear aligners
The Angle Orthodontist · 2024-05 · 94 (3) · 263-272
DOI: 10.2319/071123-484.1 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Angle Orthodontist, 2024-05. Verfasst von Sarah Abu Arqub und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Artificial Intelligence, Orthodontic Appliances, Removable. Die Arbeit wurde bisher 84-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Objectives
To assess the accuracy of ChatGPT answers concerning orthodontic clear aligners. Materials and Methods A cross-sectional content analysis of ChatGPT generated responses to queries related to clear aligner treatment (CAT) was undertaken. A total of 111 questions were generated by three orthodontists based on a set of predefined domains and subdomains. The artificial intelligence (AI)-generated (ChatGPT) answers were extracted and their accuracy was determined independently by five orthodontists. The accuracy of answers was assessed using a prepiloted four-point scale scoring rubric. Descriptive statistics were performed.
Results
The total mean accuracy score for the entire set was 2.6 ± 1.1. It was noted that 58% of the AI-generated answers were scored as objectively true, 18% were selected facts, 9% were minimal facts, and 15% were false. False claims included the ability of CAT to reduce the need for orthognathic surgery (4.0 ± 0.0), improve airway function (3.8 ± 0.5), achieve root parallelism (3.6 ± 0.5), alleviate sleep apnea (3.8 ± 0.5), and produce more stable results compared to fixed appliances (3.8 ± 0.5).
Conclusions
The overall level of accuracy of ChatGPT responses to questions concerning CAT was suboptimal and lacked citations to relevant literature. Ability of the software to offer current and precise information was limited. Therefore, clinicians and patients must be mindful of false claims and relevant facts omitted in the answers generated by ChatGPT.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Zitieren
APA
Abu Arqub, S., Al-Moghrabi, D., Allareddy, V., Upadhyay, M., Vaid, N., & Yadav, S. (2024). Content analysis of AI-generated (ChatGPT) responses concerning orthodontic clear aligners. The Angle Orthodontist, 94(3), 263-272. https://doi.org/10.2319/071123-484.1
Vancouver
Abu Arqub S, Al-Moghrabi D, Allareddy V, Upadhyay M, Vaid N, Yadav S. Content analysis of AI-generated (ChatGPT) responses concerning orthodontic clear aligners. The Angle Orthodontist. 2024;94(3):263-272. doi:10.2319/071123-484.1
BibTeX
@article{AbuArqub2024,
author = {Abu Arqub, Sarah and Al-Moghrabi, Dalya and Allareddy, Veerasathpurush and Upadhyay, Madhur and Vaid, Nikhilesh and Yadav, Sumit},
title = {Content analysis of AI-generated (ChatGPT) responses concerning orthodontic clear aligners},
journal = {The Angle Orthodontist},
year = {2024},
volume = {94},
number = {3},
pages = {263--272},
doi = {10.2319/071123-484.1}
}
EUVIMED