Denoising Multi-Level Cross-Attention and Contrastive Learning for Chest Radiology Report Generation
Journal of Imaging Informatics in Medicine · 2025
DOI: 10.1007/s10278-025-01422-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging Informatics in Medicine, 2025. Verfasst von Deng Zhu und 4 weiteren Autor:innen. Beteiligte Einrichtung: Cologe of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan, 650500, P. R. China. Hauptthemen laut MEDLINE: Radiography, Thoracic, Machine Learning. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, Kunming University of Science and Technology.
Abstract (Originalsprache)
Chest radiology report generation plays a vital role in supporting diagnosis, alleviating physician workload, and reducing the risk of misdiagnosis. However, significant challenges persist: (1) Data bias and background noise in chest images often obscure subtle lesion details, leading models to generate similar reports; (2) the distinct modal spaces of radiology images and reports weaken the semantic correlation between detailed visual lesion features and report sentences; (3) generated reports often lack crucial patient background and disease extent details, impeding report quality and accuracy. To address these challenges, this paper proposes a novel approach for generating chest radiology reports, utilizing denoising multi-level cross-attention and multi-level contrastive. The proposed method first involves sequential encoding of frontal and lateral radiology images into a visual extractor to enhance semantic coherence across image patches and improve visual feature representation. The enhanced visual features are processed through denoising multi-level cross-attention, which effectively suppresses noise and highlights the details of subtle lesions. Secondly, a multi-level contrastive learning module leverages contrastive among images, text, and disease labels to distinguish positive samples from negative ones, thereby strengthening the semantic correlation between detailed visual lesion features and report sentences. Finally, relevant knowledge is incorporated into the report generator to enhance the description of patient lesion details. Comparative experiments were performed against other state-of-the-art methods on the IU-Xray and MIMIC-CXR datasets, demonstrating that the proposed method significantly improves model performance. Additionally, ablation studies confirm that each module contributes to enhancing the quality of generated reports.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Cologe of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan, 650500, P. R. China.
- Cologe of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan, 650500, P. R. China. cloneiq@kust.edu.cn.
- Yunnan Key Laboratory of Computer Technology Application, Kunming, 650500, P. R. China. cloneiq@kust.edu.cn.
Förderung
- National Natural Science Foundation of China
- Kunming University of Science and Technology
Zitieren
APA
Zhu, D., Liu, L., Yang, X., Liu, L., & Peng, W. (2025). Denoising Multi-Level Cross-Attention and Contrastive Learning for Chest Radiology Report Generation. Journal of Imaging Informatics in Medicine. https://doi.org/10.1007/s10278-025-01422-9
Vancouver
Zhu D, Liu L, Yang X, Liu L, Peng W. Denoising Multi-Level Cross-Attention and Contrastive Learning for Chest Radiology Report Generation. Journal of Imaging Informatics in Medicine. 2025. doi:10.1007/s10278-025-01422-9
BibTeX
@article{Zhu2025,
author = {Zhu, Deng and Liu, Lijun and Yang, Xiaobing and Liu, Li and Peng, Wei},
title = {Denoising Multi-Level Cross-Attention and Contrastive Learning for Chest Radiology Report Generation},
journal = {Journal of Imaging Informatics in Medicine},
year = {2025},
doi = {10.1007/s10278-025-01422-9}
}
EUVIMED