EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access · CC BY 4.0

The performance of large language models in dentomaxillofacial radiology: a systematic review

Zekai Liu, Andrew Nalley, Jing Hao, Qi Yong H Ai iD, Andy Wai Kan Yeung iD, Ray Tanaka iD, Kuo Feng Hung iD

Dentomaxillofacial Radiology · 01.11.2025 · 54 (8) · 613-631

DOI: 10.1093/dmfr/twaf060 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Dentomaxillofacial Radiology, online erschienen am 12.08.2025. Verfasst von Zekai Liu und 6 weiteren Autor:innen. Beteiligte Einrichtung: Oral and Maxillofacial Radiology, Division of Applied Oral Sciences and Community Dental Care, Faculty of Dentistry, The University of Hong Kong, Hon…. Hauptthemen laut MEDLINE: Radiography, Dental, Language. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HKU URC Seed Fund for Basic Research for New Staff and Matching Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

This study aimed to systematically review the current performance of large language models (LLMs) in dento-maxillofacial radiology (DMFR).

Methods

Five electronic databases were used to identify studies that developed, fine-tuned, or evaluated LLMs for DMFR-related tasks. Data extracted included study purpose, LLM type, images/text source, applied language, dataset characteristics, input and output, performance outcomes, evaluation methods, and reference standards. Customized assessment criteria adapted from the TRIPOD-LLM reporting guideline were used to evaluate the risk-of-bias in the included studies specifically regarding the clarity of dataset origin, the robustness of performance evaluation methods, and the validity of the reference standards.

Results

The initial search yielded 1621 titles, and 19 studies were included. These studies investigated the use of LLMs for tasks including the production and answering of DMFR-related qualification exams and educational questions (n = 8), diagnosis and treatment recommendations (n = 7), and radiology report generation and patient communication (n = 4). LLMs demonstrated varied performance in diagnosing dental conditions, with accuracy ranging from 37% to 92.5% and expert ratings for differential diagnosis and treatment planning between 3.6 and 4.7 on a 5-point scale. For DMFR-related qualification exams and board-style questions, LLMs achieved correctness rates between 33.3% and 86.1%. Automated radiology report generation showed moderate performance with accuracy ranging from 70.4% to 81.3%.

Conclusions

LLMs demonstrate promising potential in DMFR, particularly for diagnostic, educational, and report generation tasks. However, their current accuracy, completeness, and consistency remain variable. Further development, validation, and standardization are needed before LLMs can be reliably integrated as supportive tools in clinical workflows and educational settings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Radiography, DentalLanguageHumansLarge Language Models

Stichwörter der Autor:innen

chatbotsdento-maxillofacial radiologygenerative artificial intelligencelarge language models

Autor:innen und Institutionen

  • Oral and Maxillofacial Radiology, Division of Applied Oral Sciences and Community Dental Care, Faculty of Dentistry, The University of Hong Kong, Hong Kong SAR, 999077, China.
  • Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, 999077, China.

ORCID-Profile: Qi Yong H Ai, Andy Wai Kan Yeung, Ray Tanaka, Kuo Feng Hung

Förderung

  • HKU URC Seed Fund for Basic Research for New Staff and Matching Fund

Zitieren

APA

Liu, Z., Nalley, A., Hao, J., Ai, Q. Y. H., Yeung, A. W. K., Tanaka, R., & Hung, K. F. (2025). The performance of large language models in dentomaxillofacial radiology: a systematic review. Dentomaxillofacial Radiology, 54(8), 613-631. https://doi.org/10.1093/dmfr/twaf060

Vancouver

Liu Z, Nalley A, Hao J, Ai QYH, Yeung AWK, Tanaka R, et al. The performance of large language models in dentomaxillofacial radiology: a systematic review. Dentomaxillofacial Radiology. 2025;54(8):613-631. doi:10.1093/dmfr/twaf060

BibTeX
@article{Liu2025,
  author = {Liu, Zekai and Nalley, Andrew and Hao, Jing and Ai, Qi Yong H and Yeung, Andy Wai Kan and Tanaka, Ray and Hung, Kuo Feng},
  title = {The performance of large language models in dentomaxillofacial radiology: a systematic review},
  journal = {Dentomaxillofacial Radiology},
  year = {2025},
  volume = {54},
  number = {8},
  pages = {613--631},
  doi = {10.1093/dmfr/twaf060}
}
Kostenlos starten →