TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration
IEEE Transactions on Medical Imaging · 2024-01 · 43 (1) · 15-27
DOI: 10.1109/tmi.2023.3288136 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024-01. Verfasst von Zeyuan Chen und 2 weiteren Autor:innen. Hauptthemen laut MEDLINE: Algorithms, Brain. Die Arbeit wurde bisher 185-mal zitiert (Crossref) und nennt 38 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Major Basic Research Project of Shandong Province, New Twentieth Items of Universities in Jinan.
Abstract (Originalsprache)
Feature matching, which refers to establishing the correspondence of regions between two images (usually voxel features), is a crucial prerequisite of feature-based registration. For deformable image registration tasks, traditional feature-based registration methods typically use an iterative matching strategy for interest region matching, where feature selection and matching are explicit, but specific feature selection schemes are often useful in solving application-specific problems and require several minutes for each registration. In the past few years, the feasibility of learning-based methods, such as VoxelMorph and TransMorph, has been proven, and their performance has been shown to be competitive compared to traditional methods. However, these methods are usually single-stream, where the two images to be registered are concatenated into a 2-channel whole, and then the deformation field is output directly. The transformation of image features into interimage matching relationships is implicit. In this paper, we propose a novel end-to-end dual-stream unsupervised framework, named TransMatch, where each image is fed into a separate stream branch, and each branch performs feature extraction independently. Then, we implement explicit multilevel feature matching between image pairs via the query-key matching idea of the self-attention mechanism in the Transformer model. Comprehensive experiments are conducted on three 3D brain MR datasets, LPBA40, IXI, and OASIS, and the results show that the proposed method achieves state-of-the-art performance in several evaluation metrics compared to the commonly utilized registration methods, including SyN, NiftyReg, VoxelMorph, CycleMorph, ViT-V-Net, and TransMorph, demonstrating the effectiveness of our model in deformable medical image registration.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Major Basic Research Project of Shandong Province
- New Twentieth Items of Universities in Jinan
- Taishan Scholar Program of Shandong Province
Zitieren
APA
Chen, Z., Zheng, Y., & Gee, J. C. (2024). TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration. IEEE Transactions on Medical Imaging, 43(1), 15-27. https://doi.org/10.1109/tmi.2023.3288136
Vancouver
Chen Z, Zheng Y, Gee JC. TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration. IEEE Transactions on Medical Imaging. 2024;43(1):15-27. doi:10.1109/tmi.2023.3288136
BibTeX
@article{Chen2024,
author = {Chen, Zeyuan and Zheng, Yuanjie and Gee, James C},
title = {TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration},
journal = {IEEE Transactions on Medical Imaging},
year = {2024},
volume = {43},
number = {1},
pages = {15--27},
doi = {10.1109/tmi.2023.3288136}
}
EUVIMED