EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

CNX-B2: A Novel CNN-Transformer Approach For Chest X-Ray Medical Report Generation

Fawaz F. Alqahtani, Mashood Mohammad Mohsan, Khalaf Alshamrani, Jahan Zeb, Salihah Alhamami, Dareen Alqarni

IEEE Access · 2024 · 12 · 26626-26635

DOI: 10.1109/access.2024.3367360 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Fawaz F. Alqahtani und 5 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Deputy for Research and Innovation Ministry of Education, Kingdom of Saudi Arabia through the Institutional Funding Committee at Najran University, Kingdom of….

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Medical imaging techniques are the most popular non-invasive methods to diagnose chest diseases. Chest X-ray scans are employed commonly to detect chronic obstructive pulmonary diseases and other respiratory diseases. Despite the significance of these diagnostic methods, the process of disease detection and the subsequent task of CXR report writing is tedious for radiologists. Therefore, Automated radiological report generation is a highly desirable task for radiologists. Previous studies were focused on the automated generation of medical reports to achieve greater quantitative scores rather than focusing on the quality of reports. Such approaches suffer from the problem of generating normal reports for CXR with diseases. Additionally, the absence of clear segregation between normal and abnormal samples in publicly available datasets its impossible to evaluate the performance of models in generating rare abnormal reports. To address these issues, we propose CNX-B2 which is a Convolutional Neural Network (CNN) combined with a Transformer approach to generate medical reports. The proposed encoder is designed to be both hybrid and efficient, capturing meaningful spatial features through inherent convolution biases. This enables the transformer-based decoder to robustly convert these features into coherent medical reports. Secondly, we also introduce a new radiological report dataset to evaluate model performances on abnormal reports separately. Our proposed model is further evaluated on the IU-Xray dataset, achieving competitive scores of 0.479 BLEU-1, 0.188 METEOR, and 0.586 CIDER.

Förderung

  • Deputy for Research and Innovation Ministry of Education, Kingdom of Saudi Arabia through the Institutional Funding Committee at Najran University, Kingdom of…

Zitieren

APA

Alqahtani, F. F., Mohsan, M. M., Alshamrani, K., Zeb, J., Alhamami, S., & Alqarni, D. (2024). CNX-B2: A Novel CNN-Transformer Approach For Chest X-Ray Medical Report Generation. IEEE Access, 12, 26626-26635. https://doi.org/10.1109/access.2024.3367360

Vancouver

Alqahtani FF, Mohsan MM, Alshamrani K, Zeb J, Alhamami S, Alqarni D. CNX-B2: A Novel CNN-Transformer Approach For Chest X-Ray Medical Report Generation. IEEE Access. 2024;12:26626-26635. doi:10.1109/access.2024.3367360

BibTeX
@article{Alqahtani2024,
  author = {Alqahtani, Fawaz F. and Mohsan, Mashood Mohammad and Alshamrani, Khalaf and Zeb, Jahan and Alhamami, Salihah and Alqarni, Dareen},
  title = {CNX-B2: A Novel CNN-Transformer Approach For Chest X-Ray Medical Report Generation},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {26626--26635},
  doi = {10.1109/access.2024.3367360}
}
Kostenlos starten →