DSTAN: A Deformable Spatial-temporal Attention Network with Bidirectional Sequence Feature Refinement for Speckle Noise Removal in Thyroid Ultrasound Video
Journal of Imaging Informatics in Medicine · 2024
DOI: 10.1007/s10278-023-00935-5 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging Informatics in Medicine, 2024. Verfasst von Jianning Chi und 5 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Robot Science and Engineering, Northeastern University, Zhihui Street, Shenyang, 110169, Liaoning, China. chijianning@neu.edu.cn. Hauptthemen laut MEDLINE: Ultrasonography, Thyroid Gland. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, Science and Technology Plan of Liaoning Province.
Abstract (Originalsprache)
Thyroid ultrasound video provides significant value for thyroid diseases diagnosis, but the ultrasound imaging process is often affected by the speckle noise, resulting in poor quality of the ultrasound video. Numerous video denoising methods have been proposed to remove noise while preserving texture details. However, existing methods still suffer from the following problems: (1) relevant temporal features in the low-contrast ultrasound video cannot be accurately aligned and effectively aggregated by simple optical flow or motion estimation, resulting in the artifacts and motion blur in the video; (2) fixed receptive field in spatial features integration lacks the flexibility of aggregating features in the global region of interest and is susceptible to interference from irrelevant noisy regions. In this work, we propose a deformable spatial-temporal attention denoising network to remove speckle noise in thyroid ultrasound video. The entire network follows the bidirectional feature propagation mechanism to efficiently exploit the spatial-temporal information of the whole video sequence. In this process, two modules are proposed to address the above problems: (1) a deformable temporal attention module (DTAM) is designed after optical flow pre-alignment to further capture and aggregate relevant temporal features according to the learned offsets between frames, so that inter-frame information can be better exploited even with the imprecise flow estimation under the low contrast of ultrasound video; (2) a deformable spatial attention module (DSAM) is proposed to flexibly integrate spatial features in the global region of interest through the learned intra-frame offsets, so that irrelevant noisy information can be ignored and essential information can be precisely exploited. Finally, all these refined features are rectified and merged through residual convolution blocks to recover the clean video frames. Experimental results on our thyroid ultrasound video (US-V) dataset and the DDTI dataset demonstrate that our proposed method exceeds 1.2 ∼ 1.3 dB on PSNR and has clearer texture detail compared to other state-of-the-art methods. In the meantime, the proposed model can also assist thyroid nodule segmentation methods to achieve more accurate segmentation effect, which provides an important basis for thyroid diagnosis. In the future, the proposed model can be improved and extended to other medical image sequence datasets, including CT and MRI slice denoising. The code and datasets are provided at https://github.com/Meta-MJ/DSTAN .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Robot Science and Engineering, Northeastern University, Zhihui Street, Shenyang, 110169, Liaoning, China. chijianning@neu.edu.cn.
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Zhihui Street, Shenyang, 110169, Liaoning, China. chijianning@neu.edu.cn.
- Faculty of Robot Science and Engineering, Northeastern University, Zhihui Street, Shenyang, 110169, Liaoning, China.
- Department of Ultrasound, Shengjing Hospital of China Medical University, Shenyang, 110004, Liaoning, China.
- Department of Ultrasound, Shengjing Hospital of China Medical University, Shenyang, 110004, Liaoning, China. huangying712@163.com.
ORCID-Profile: Jianning Chi
Förderung
- National Natural Science Foundation of China
- Science and Technology Plan of Liaoning Province
Zitieren
APA
Chi, J., Miao, J., Chen, J. H., Wang, H., Yu, X., & Huang, Y. (2024). DSTAN: A Deformable Spatial-temporal Attention Network with Bidirectional Sequence Feature Refinement for Speckle Noise Removal in Thyroid Ultrasound Video. Journal of Imaging Informatics in Medicine. https://doi.org/10.1007/s10278-023-00935-5
Vancouver
Chi J, Miao J, Chen JH, Wang H, Yu X, Huang Y. DSTAN: A Deformable Spatial-temporal Attention Network with Bidirectional Sequence Feature Refinement for Speckle Noise Removal in Thyroid Ultrasound Video. Journal of Imaging Informatics in Medicine. 2024. doi:10.1007/s10278-023-00935-5
BibTeX
@article{Chi2024,
author = {Chi, Jianning and Miao, Jian and Chen, Jia-Hui and Wang, Huan and Yu, Xiaosheng and Huang, Ying},
title = {DSTAN: A Deformable Spatial-temporal Attention Network with Bidirectional Sequence Feature Refinement for Speckle Noise Removal in Thyroid Ultrasound Video},
journal = {Journal of Imaging Informatics in Medicine},
year = {2024},
doi = {10.1007/s10278-023-00935-5}
}
EUVIMED