Multimodal Large Language Models for Dental Chart Image Interpretation: Cross-Sectional Benchmarking Study With Students and Clinicians
JMIR Medical Education · 04.09.2026 · 12 · e91809-e91809
DOI: 10.2196/91809 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift JMIR Medical Education, online erschienen am 04.09.2026. Verfasst von Ah-Young Cho und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Conservative Dentistry and Dental Research Institute, School of Dentistry, Seoul National University, 101 Daehakno, Jongno-Gu, Seoul, 0…. Hauptthemen laut MEDLINE: Large Language Models, Benchmarking, Students, Dental, Dental Records. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Entering clinical training, dental students must learn to read tooth-centered electronic dental records, but limited teaching time in patient-centered clinics can leave gaps in chart-reading literacy. Multimodal large language models (LLMs) that process dental record images may offer scalable educational support, yet their performance has not been benchmarked.
Objective
This study evaluated multimodal ChatGPT models on dental chart image interpretation and compared the best-performing model with dental students and residents.
Methods
A retrospective, cross-sectional benchmark study used deidentified dental chart images from 15 patients at Seoul National University Dental Hospital (2017‐2025). Charts containing Korean and English text were captured as sequential screenshots (154 images). For each patient, 24 Korean-language questions (360 total) spanned four categories: Type A, general factual retrieval; Type B, tooth- or procedure-specific retrieval; Type C, interpretation requiring multientry synthesis; and Type D, absent-information questions assessing abstention. Nine multimodal ChatGPT models (available August 2, 2025‐August 9, 2025) were evaluated under standardized conditions. Outputs were scored against a gold standard using 7 metrics, with sentence bidirectional encoder representations from transformers (SBERT) similarity prespecified as the primary semantic measure. Human baselines included 2 third-year students and 2 first-year residents. Groups were compared with Kruskal-Wallis tests and Dunn post hoc analyses. Gold-standard reliability was assessed by independent senior-expert review and chance-corrected agreement (Gwet AC1) among clinical reference raters, and the model ranking was confirmed by content-based clinical accuracy analysis.
Results
Across 360 items, GPT-5 Thinking achieved the highest median SBERT similarity (0.900, IQR 0.525‐1.000), followed by GPT-5 Pro (0.861, IQR 0.501‐1.000) and OpenAI o3 (0.831, IQR 0.489‐1.000), with significant overall group differences ( P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Conservative Dentistry and Dental Research Institute, School of Dentistry, Seoul National University, 101 Daehakno, Jongno-Gu, Seoul, 03080, Republic of Korea, 82 2-6256-3182.
- Graduate School, Department of Urban Big Data Convergence, University of Seoul, Seoul, Republic of Korea.
- AI Agent Team, CryptoLab Inc., Seoul, Republic of Korea.
- Department of Conservative Dentistry and Oral Science Research Center, Yonsei University College of Dentistry, Seoul, Republic of Korea.
- Department of Dental Education, Dental and Life Science Institute, School of Dentistry, Pusan National University and Dental Research Institute, Busan, Republic of Korea.
- Department of Dental Education and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Republic of Korea.
ORCID-Profile: Ah-Young Cho, Soo-Heang Eo, Mi-Jeong Jeon, Jae-Hoon Kim, Jungjoon Ihm, Deog-Gyu Seo
Zitieren
APA
Cho, A. Y., Eo, S. H., Jeon, M. J., Kim, J. H., Ihm, J., & Seo, D. G. (2026). Multimodal Large Language Models for Dental Chart Image Interpretation: Cross-Sectional Benchmarking Study With Students and Clinicians. JMIR Medical Education, 12, e91809-e91809. https://doi.org/10.2196/91809
Vancouver
Cho AY, Eo SH, Jeon MJ, Kim JH, Ihm J, Seo DG. Multimodal Large Language Models for Dental Chart Image Interpretation: Cross-Sectional Benchmarking Study With Students and Clinicians. JMIR Medical Education. 2026;12:e91809-e91809. doi:10.2196/91809
BibTeX
@article{Cho2026,
author = {Cho, Ah-Young and Eo, Soo-Heang and Jeon, Mi-Jeong and Kim, Jae-Hoon and Ihm, Jungjoon and Seo, Deog-Gyu},
title = {Multimodal Large Language Models for Dental Chart Image Interpretation: Cross-Sectional Benchmarking Study With Students and Clinicians},
journal = {JMIR Medical Education},
year = {2026},
volume = {12},
pages = {e91809--e91809},
doi = {10.2196/91809}
}
EUVIMED