EUVIMEDScopri EUVIMED
Open access

Explainable AI-Driven Analysis of Radiology Reports Using Text and Image Data: Experimental Study

Muhammad Tayyab Zamir iD, Safir Ullah Khan iD, Alexander Gelbukh iD, Edgardo Manuel Felipe Riverón iD, Irina Gelbukh iD

JMIR Formative Research · 2025-10-14 · 9 · e77482

DOI: 10.2196/77482 ↗

At a glance

Journal article in JMIR Formative Research, published online on 2025-10-14. Written by Muhammad Tayyab Zamir and 4 co-authors. Institution: Centro de Investigación en Computación (CIC), Instituto Politécnico Nacional (IPN), Ciudad de México, CDMX, Mexico. Major MEDLINE topics: Artificial Intelligence, Radiology. Cited 14 times so far (Crossref); 48 references. The full text is freely available in PubMed Central.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Artificial intelligence (AI) is increasingly being integrated into clinical diagnostics; yet, its lack of transparency hinders trust and adoption among health care professionals. The explainable artificial intelligence (XAI) has the potential to improve the interpretability and reliability of AI-based decisions in clinical practice.

Objective

This study evaluates the use of XAI for interpreting radiology reports to improve health care practitioners’ confidence and comprehension of AI-assisted diagnostics.

Methods

This study used the Indiana University chest x-ray dataset containing 3169 textual reports and 6471 images. Textual data were being classified as either normal or abnormal by using a range of machine learning approaches. This includes traditional machine learning models and ensemble methods, deep learning models (long short-term memory network), and advanced transformer-based language models (GPT-2, T5, LLaMA-2, and LLaMA-3.1). For image-based classifications, convolutional neural networks, including DenseNet121 and DenseNet169, were used. Top-performing models were interpreted using XAI methods SHAP (Shapley Adaptive Explanations) and Local Interpretable Model-Agnostic Explanations to support clinical decision making by enhancing transparency and trust in model predictions.

Results

The LLaMA-3.1 model achieved the highest accuracy of 98% in classifying the textual radiology reports. Statistical analysis confirmed the model’s robustness, with Cohen κ (k=0.981) indicating near-perfect agreement beyond chance. Both the chi-square and Fisher exact tests revealed a highly significant association between the actual and predicted labels (P

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceRadiologyHumansReproducibility of ResultsMachine LearningNeural Networks, Computer

Author keywords

LIMELocal Interpretable Model-Agnostic ExplanationsSHAPShapley Adaptive Explanationsartificial intelligenceexplainable AInatural language processingradiology

Authors and institutions

  • Centro de Investigación en Computación (CIC), Instituto Politécnico Nacional (IPN), Ciudad de México, CDMX, Mexico.
  • Department of Cell Biology, Center for Research and Advanced Studies of the National Polytechnic Institute, Ciudad de México, CDMX, Mexico.

ORCID profiles: Muhammad Tayyab Zamir, Safir Ullah Khan, Alexander Gelbukh, Edgardo Manuel Felipe Riverón, Irina Gelbukh

Cite

APA

Zamir, M. T., Khan, S. U., Gelbukh, A., Felipe Riverón, E. M., & Gelbukh, I. (2025). Explainable AI-Driven Analysis of Radiology Reports Using Text and Image Data: Experimental Study. JMIR Formative Research, 9, e77482. https://doi.org/10.2196/77482

Vancouver

Zamir MT, Khan SU, Gelbukh A, Felipe Riverón EM, Gelbukh I. Explainable AI-Driven Analysis of Radiology Reports Using Text and Image Data: Experimental Study. JMIR Formative Research. 2025;9:e77482. doi:10.2196/77482

BibTeX
@article{Zamir2025,
  author = {Zamir, Muhammad Tayyab and Khan, Safir Ullah and Gelbukh, Alexander and Felipe Riverón, Edgardo Manuel and Gelbukh, Irina},
  title = {Explainable AI-Driven Analysis of Radiology Reports Using Text and Image Data: Experimental Study},
  journal = {JMIR Formative Research},
  year = {2025},
  volume = {9},
  pages = {e77482},
  doi = {10.2196/77482}
}
Start for free →