EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study

Arjeta Hatia, Tiziana Doldo, Stefano Parrini, Elettra Chisci, Linda Cipriani, Livia Montagna, Giuseppina Lagana, Guia Guenza, Edoardo Agosta, Franceska Vinjolli, Meladiona Hoxha, Claudio D'Amelio und 2 weitere

Journal of Clinical Medicine · 27.01.2024 · 13 (3) · 735

DOI: 10.3390/jcm13030735 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 27.01.2024. Verfasst von Arjeta Hatia und 13 weiteren Autor:innen. Beteiligte Einrichtung: Orthodontics Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy. Die Arbeit wurde bisher 94-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. Materials and Methods: ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all of the subspecialities of interceptive orthodontics and 7 comprehensive clinical cases. Questions and scenarios were inputted into ChatGPT4, and the resulting answers were evaluated by the researchers using predefined accuracy (range 1–6) and completeness (range 1–3) Likert scales.

Results

For the open-ended questions, the overall median score was 4.9/6 for the accuracy and 2.4/3 for completeness. In addition, the reviewers rated the accuracy of open-ended answers as entirely correct (score 6 on Likert scale) in 40.5% of cases and completeness as entirely correct (score 3 n Likert scale) in 50.5% of cases. As for the clinical cases, the overall median score was 4.9/6 for accuracy and 2.5/3 for completeness. Overall, the reviewers rated the accuracy of clinical case answers as entirely correct in 46% of cases and the completeness of clinical case answers as entirely correct in 54.3% of cases.

Conclusions

The results showed a high level of accuracy and completeness in AI responses and a great ability to solve difficult clinical cases, but the answers were not 100% accurate and complete. ChatGPT is not yet sophisticated enough to replace the intellectual work of human beings.

Schlagwörter

Stichwörter der Autor:innen

ChatGPTartificial botartificial intelligenceinterceptive orthodonticsmethodologyorthodontics

Autor:innen und Institutionen

  • Orthodontics Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
  • Oral Surgery Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
  • Orthodontics Postgraduate School, University of Ferrara, 44121 Ferrara, Italy.
  • Orthodontics Postgraduate School, University of Cagliari, 09121 Cagliari, Italy.
  • Orthodontics Postgraduate School, "Sapienza" University of Rome, 00185 Rome, Italy.
  • Orthodontics Postgraduate School, University of Milano, 20019 Milan, Italy.

ORCID-Profile: Glauco Chisci

Zitieren

APA

Hatia, A., Doldo, T., Parrini, S., Chisci, E., Cipriani, L., Montagna, L., Lagana, G., Guenza, G., Agosta, E., Vinjolli, F., Hoxha, M., D'Amelio, C., Favaretto, N., & Chisci, G. (2024). Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study. Journal of Clinical Medicine, 13(3), 735. https://doi.org/10.3390/jcm13030735

Vancouver

Hatia A, Doldo T, Parrini S, Chisci E, Cipriani L, Montagna L, et al. Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study. Journal of Clinical Medicine. 2024;13(3):735. doi:10.3390/jcm13030735

BibTeX
@article{Hatia2024,
  author = {Hatia, Arjeta and Doldo, Tiziana and Parrini, Stefano and Chisci, Elettra and Cipriani, Linda and Montagna, Livia and Lagana, Giuseppina and Guenza, Guia and Agosta, Edoardo and Vinjolli, Franceska and Hoxha, Meladiona and D'Amelio, Claudio and Favaretto, Nicolò and Chisci, Glauco},
  title = {Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study},
  journal = {Journal of Clinical Medicine},
  year = {2024},
  volume = {13},
  number = {3},
  pages = {735},
  doi = {10.3390/jcm13030735}
}
Kostenlos starten →