Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study
Journal of Clinical Medicine · 27.01.2024 · 13 (3) · 735
DOI: 10.3390/jcm13030735 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 27.01.2024. Verfasst von Arjeta Hatia und 13 weiteren Autor:innen. Beteiligte Einrichtung: Orthodontics Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy. Die Arbeit wurde bisher 94-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. Materials and Methods: ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all of the subspecialities of interceptive orthodontics and 7 comprehensive clinical cases. Questions and scenarios were inputted into ChatGPT4, and the resulting answers were evaluated by the researchers using predefined accuracy (range 1–6) and completeness (range 1–3) Likert scales.
Results
For the open-ended questions, the overall median score was 4.9/6 for the accuracy and 2.4/3 for completeness. In addition, the reviewers rated the accuracy of open-ended answers as entirely correct (score 6 on Likert scale) in 40.5% of cases and completeness as entirely correct (score 3 n Likert scale) in 50.5% of cases. As for the clinical cases, the overall median score was 4.9/6 for accuracy and 2.5/3 for completeness. Overall, the reviewers rated the accuracy of clinical case answers as entirely correct in 46% of cases and the completeness of clinical case answers as entirely correct in 54.3% of cases.
Conclusions
The results showed a high level of accuracy and completeness in AI responses and a great ability to solve difficult clinical cases, but the answers were not 100% accurate and complete. ChatGPT is not yet sophisticated enough to replace the intellectual work of human beings.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Orthodontics Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
- Oral Surgery Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
- Orthodontics Postgraduate School, University of Ferrara, 44121 Ferrara, Italy.
- Orthodontics Postgraduate School, University of Cagliari, 09121 Cagliari, Italy.
- Orthodontics Postgraduate School, "Sapienza" University of Rome, 00185 Rome, Italy.
- Orthodontics Postgraduate School, University of Milano, 20019 Milan, Italy.
ORCID-Profile: Glauco Chisci
Zitieren
APA
Hatia, A., Doldo, T., Parrini, S., Chisci, E., Cipriani, L., Montagna, L., Lagana, G., Guenza, G., Agosta, E., Vinjolli, F., Hoxha, M., D'Amelio, C., Favaretto, N., & Chisci, G. (2024). Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study. Journal of Clinical Medicine, 13(3), 735. https://doi.org/10.3390/jcm13030735
Vancouver
Hatia A, Doldo T, Parrini S, Chisci E, Cipriani L, Montagna L, et al. Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study. Journal of Clinical Medicine. 2024;13(3):735. doi:10.3390/jcm13030735
BibTeX
@article{Hatia2024,
author = {Hatia, Arjeta and Doldo, Tiziana and Parrini, Stefano and Chisci, Elettra and Cipriani, Linda and Montagna, Livia and Lagana, Giuseppina and Guenza, Guia and Agosta, Edoardo and Vinjolli, Franceska and Hoxha, Meladiona and D'Amelio, Claudio and Favaretto, Nicolò and Chisci, Glauco},
title = {Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study},
journal = {Journal of Clinical Medicine},
year = {2024},
volume = {13},
number = {3},
pages = {735},
doi = {10.3390/jcm13030735}
}
EUVIMED