Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation
IEEE Transactions on Medical Imaging · 2023-08 · 42 (8) · 2211-2222
DOI: 10.1109/tmi.2023.3245608 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2023-08. Verfasst von Sixing Yan und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: X-Rays. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Despite the recent success of deep learning models for text generation, generating clinically accurate reports remains challenging. More precisely modeling the relationships of the abnormalities revealed in an X-ray image has been found promising to enhance the clinical accuracy. In this paper, we first introduce a novel knowledge graph structure called an attributed abnormality graph (ATAG). It consists of interconnected abnormality nodes and attribute nodes for better capturing more fine-grained abnormality details. In contrast to the existing methods where the abnormality graph are constructed manually, we propose a methodology to automatically construct the fine-grained graph structure based on annotated X-ray reports and the RadLex radiology lexicon. We then learn the ATAG embeddings as part of a deep model with an encoder-decoder architecture for the report generation. In particular, graph attention networks are explored to encode the relationships among the abnormalities and their attributes. A hierarchical attention attention and a gating mechanism are specifically designed to further enhance the generation quality. We carry out extensive experiments based on the benchmark datasets, and show that the proposed ATAG-based deep model outperforms the SOTA methods by a large margin in ensuring the clinical accuracy of the generated reports.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Zitieren
APA
Yan, S., Cheung, W. K., Chiu, K., Tong, T. M., Cheung, K. C., & See, S. (2023). Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation. IEEE Transactions on Medical Imaging, 42(8), 2211-2222. https://doi.org/10.1109/tmi.2023.3245608
Vancouver
Yan S, Cheung WK, Chiu K, Tong TM, Cheung KC, See S. Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation. IEEE Transactions on Medical Imaging. 2023;42(8):2211-2222. doi:10.1109/tmi.2023.3245608
BibTeX
@article{Yan2023,
author = {Yan, Sixing and Cheung, William K and Chiu, Keith and Tong, Terence M and Cheung, Ka Chun and See, Simon},
title = {Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation},
journal = {IEEE Transactions on Medical Imaging},
year = {2023},
volume = {42},
number = {8},
pages = {2211--2222},
doi = {10.1109/tmi.2023.3245608}
}
EUVIMED