Multimodal AI and Large Language Models for Orthopantomography Radiology Report Generation and Q&A
Applied System Innovation · 17.03.2025 · 8 (2) · 39
DOI: 10.3390/asi8020039 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied System Innovation, online erschienen am 17.03.2025. Verfasst von Chirath Dasanayaka und 4 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Access to high-quality dental healthcare remains a challenge in many countries due to limited resources, lack of trained professionals, and time-consuming report generation tasks. An intelligent clinical decision support system (ICDSS), which can make informed decisions based on past data, is an innovative solution to address these shortcomings while improving continuous patient support in dental healthcare. This study proposes a viable solution with the aid of multimodal artificial intelligence (AI) and large language models (LLMs), focusing on their application for generating orthopantomography radiology reports and answering questions in the dental domain. This work also discusses efficient adaptation methods of LLMs for specific language and application domains. The proposed system primarily consists of a Blip-2-based caption generator tuned on DPT images followed by a Llama 3 8B based LLM for radiology report generation. The performance of the entire system is evaluated in two ways. The diagnostic performance of the system achieved an overall accuracy of 81.3%, with specific detection rates of 87.9% for dental caries, 89.7% for impacted teeth, 88% for bone loss, and 81.8% for periapical lesions. Subjective evaluation of AI-generated radiology reports by certified dental professionals demonstrates an overall accuracy score of 7.5 out of 10. In addition, the proposed solution includes a question-answering platform in the native Sinhala language, alongside the English language, designed to function as a chatbot for dental-related queries. We hope that this platform will eventually bridge the gap between dental services and patients, created due to a lack of human resources. Overall, our proposed solution creates new opportunities for LLMs in healthcare by introducing a robust end-to-end system for the automated generation of dental radiology reports and enhancing patient interaction and awareness.
Zitieren
APA
Dasanayaka, C., Dandeniya, K., Dissanayake, M. B., Gunasena, C., & Jayasinghe, R. (2025). Multimodal AI and Large Language Models for Orthopantomography Radiology Report Generation and Q&A. Applied System Innovation, 8(2), 39. https://doi.org/10.3390/asi8020039
Vancouver
Dasanayaka C, Dandeniya K, Dissanayake MB, Gunasena C, Jayasinghe R. Multimodal AI and Large Language Models for Orthopantomography Radiology Report Generation and Q&A. Applied System Innovation. 2025;8(2):39. doi:10.3390/asi8020039
BibTeX
@article{Dasanayaka2025,
author = {Dasanayaka, Chirath and Dandeniya, Kanishka and Dissanayake, Maheshi B. and Gunasena, Chandira and Jayasinghe, Ruwan},
title = {Multimodal AI and Large Language Models for Orthopantomography Radiology Report Generation and Q&A},
journal = {Applied System Innovation},
year = {2025},
volume = {8},
number = {2},
pages = {39},
doi = {10.3390/asi8020039}
}
EUVIMED