The performance of large language models in dentomaxillofacial radiology: a systematic review
Dentomaxillofacial Radiology · 01.11.2025 · 54 (8) · 613-631
DOI: 10.1093/dmfr/twaf060 ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift Dentomaxillofacial Radiology, online erschienen am 12.08.2025. Verfasst von Zekai Liu und 6 weiteren Autor:innen. Beteiligte Einrichtung: Oral and Maxillofacial Radiology, Division of Applied Oral Sciences and Community Dental Care, Faculty of Dentistry, The University of Hong Kong, Hon…. Hauptthemen laut MEDLINE: Radiography, Dental, Language. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HKU URC Seed Fund for Basic Research for New Staff and Matching Fund.
Abstract (Originalsprache)
Objectives
This study aimed to systematically review the current performance of large language models (LLMs) in dento-maxillofacial radiology (DMFR).
Methods
Five electronic databases were used to identify studies that developed, fine-tuned, or evaluated LLMs for DMFR-related tasks. Data extracted included study purpose, LLM type, images/text source, applied language, dataset characteristics, input and output, performance outcomes, evaluation methods, and reference standards. Customized assessment criteria adapted from the TRIPOD-LLM reporting guideline were used to evaluate the risk-of-bias in the included studies specifically regarding the clarity of dataset origin, the robustness of performance evaluation methods, and the validity of the reference standards.
Results
The initial search yielded 1621 titles, and 19 studies were included. These studies investigated the use of LLMs for tasks including the production and answering of DMFR-related qualification exams and educational questions (n = 8), diagnosis and treatment recommendations (n = 7), and radiology report generation and patient communication (n = 4). LLMs demonstrated varied performance in diagnosing dental conditions, with accuracy ranging from 37% to 92.5% and expert ratings for differential diagnosis and treatment planning between 3.6 and 4.7 on a 5-point scale. For DMFR-related qualification exams and board-style questions, LLMs achieved correctness rates between 33.3% and 86.1%. Automated radiology report generation showed moderate performance with accuracy ranging from 70.4% to 81.3%.
Conclusions
LLMs demonstrate promising potential in DMFR, particularly for diagnostic, educational, and report generation tasks. However, their current accuracy, completeness, and consistency remain variable. Further development, validation, and standardization are needed before LLMs can be reliably integrated as supportive tools in clinical workflows and educational settings.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Oral and Maxillofacial Radiology, Division of Applied Oral Sciences and Community Dental Care, Faculty of Dentistry, The University of Hong Kong, Hong Kong SAR, 999077, China.
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, 999077, China.
ORCID-Profile: Qi Yong H Ai, Andy Wai Kan Yeung, Ray Tanaka, Kuo Feng Hung
Förderung
- HKU URC Seed Fund for Basic Research for New Staff and Matching Fund
Zitieren
APA
Liu, Z., Nalley, A., Hao, J., Ai, Q. Y. H., Yeung, A. W. K., Tanaka, R., & Hung, K. F. (2025). The performance of large language models in dentomaxillofacial radiology: a systematic review. Dentomaxillofacial Radiology, 54(8), 613-631. https://doi.org/10.1093/dmfr/twaf060
Vancouver
Liu Z, Nalley A, Hao J, Ai QYH, Yeung AWK, Tanaka R, et al. The performance of large language models in dentomaxillofacial radiology: a systematic review. Dentomaxillofacial Radiology. 2025;54(8):613-631. doi:10.1093/dmfr/twaf060
BibTeX
@article{Liu2025,
author = {Liu, Zekai and Nalley, Andrew and Hao, Jing and Ai, Qi Yong H and Yeung, Andy Wai Kan and Tanaka, Ray and Hung, Kuo Feng},
title = {The performance of large language models in dentomaxillofacial radiology: a systematic review},
journal = {Dentomaxillofacial Radiology},
year = {2025},
volume = {54},
number = {8},
pages = {613--631},
doi = {10.1093/dmfr/twaf060}
}
EUVIMED