AI in Dental Radiology—Improving the Efficiency of Reporting With ChatGPT: Comparative Study
Journal of Medical Internet Research · 2024-12-23 · 26 · e60684
DOI: 10.2196/60684 ↗At a glance
Vergleichsstudie in Journal of Medical Internet Research, published online on 2024-12-23. Written by Daniel Stephan and 6 co-authors. Institution: Department of Oral and Maxillofacial Surgery, Facial Plastic Surgery, University Medical Centre of the Johannes Gutenberg-University Mainz, Mainz, Ge…. Major MEDLINE topics: Artificial Intelligence, Radiology. Cited 38 times so far (Crossref); 46 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Structured and standardized documentation is critical for accurately recording diagnostic findings, treatment plans, and patient progress in health care. Manual documentation can be labor-intensive and error-prone, especially under time constraints, prompting interest in the potential of artificial intelligence (AI) to automate and optimize these processes, particularly in medical documentation.
Objective
This study aimed to assess the effectiveness of ChatGPT (OpenAI) in generating radiology reports from dental panoramic radiographs, comparing the performance of AI-generated reports with those manually created by dental students.
Methods
A total of 100 dental students were tasked with analyzing panoramic radiographs and generating radiology reports manually or assisted by ChatGPT using a standardized prompt derived from a diagnostic checklist.
Results
Reports generated by ChatGPT showed a high degree of textual similarity to reference reports; however, they often lacked critical diagnostic information typically included in reports authored by students. Despite this, the AI-generated reports were consistent in being error-free and matched the readability of student-generated reports.
Conclusions
The findings from this study suggest that ChatGPT has considerable potential for generating radiology reports, although it currently faces challenges in accuracy and reliability. This underscores the need for further refinement in the AI’s prompt design and the development of robust validation mechanisms to enhance its use in clinical settings.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Oral and Maxillofacial Surgery, Facial Plastic Surgery, University Medical Centre of the Johannes Gutenberg-University Mainz, Mainz, Germany.
- Department of Oral and Maxillofacial Surgery, Radboud University Medical Center, Nijmegen, Netherlands.
ORCID profiles: Daniel Stephan, Annika Bertsch, Matthias Burwinkel, Shankeeth Vinayahalingam, Bilal Al-Nawas, Peer W Kämmerer, Daniel Ge Thiem
Cite
APA
Stephan, D., Bertsch, A., Burwinkel, M., Vinayahalingam, S., Al-Nawas, B., Kämmerer, P. W., & Thiem, D. G. (2024). AI in Dental Radiology—Improving the Efficiency of Reporting With ChatGPT: Comparative Study. Journal of Medical Internet Research, 26, e60684. https://doi.org/10.2196/60684
Vancouver
Stephan D, Bertsch A, Burwinkel M, Vinayahalingam S, Al-Nawas B, Kämmerer PW, et al. AI in Dental Radiology—Improving the Efficiency of Reporting With ChatGPT: Comparative Study. Journal of Medical Internet Research. 2024;26:e60684. doi:10.2196/60684
BibTeX
@article{Stephan2024,
author = {Stephan, Daniel and Bertsch, Annika and Burwinkel, Matthias and Vinayahalingam, Shankeeth and Al-Nawas, Bilal and Kämmerer, Peer W and Thiem, Daniel Ge},
title = {AI in Dental Radiology—Improving the Efficiency of Reporting With ChatGPT: Comparative Study},
journal = {Journal of Medical Internet Research},
year = {2024},
volume = {26},
pages = {e60684},
doi = {10.2196/60684}
}
EUVIMED