EUVIMEDEUVIMED entdecken
Crossref

TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration

Zeyuan Chen, Yuanjie Zheng, James C Gee

IEEE Transactions on Medical Imaging · 2024-01 · 43 (1) · 15-27

DOI: 10.1109/tmi.2023.3288136 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024-01. Verfasst von Zeyuan Chen und 2 weiteren Autor:innen. Hauptthemen laut MEDLINE: Algorithms, Brain. Die Arbeit wurde bisher 185-mal zitiert (Crossref) und nennt 38 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Major Basic Research Project of Shandong Province, New Twentieth Items of Universities in Jinan.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Feature matching, which refers to establishing the correspondence of regions between two images (usually voxel features), is a crucial prerequisite of feature-based registration. For deformable image registration tasks, traditional feature-based registration methods typically use an iterative matching strategy for interest region matching, where feature selection and matching are explicit, but specific feature selection schemes are often useful in solving application-specific problems and require several minutes for each registration. In the past few years, the feasibility of learning-based methods, such as VoxelMorph and TransMorph, has been proven, and their performance has been shown to be competitive compared to traditional methods. However, these methods are usually single-stream, where the two images to be registered are concatenated into a 2-channel whole, and then the deformation field is output directly. The transformation of image features into interimage matching relationships is implicit. In this paper, we propose a novel end-to-end dual-stream unsupervised framework, named TransMatch, where each image is fed into a separate stream branch, and each branch performs feature extraction independently. Then, we implement explicit multilevel feature matching between image pairs via the query-key matching idea of the self-attention mechanism in the Transformer model. Comprehensive experiments are conducted on three 3D brain MR datasets, LPBA40, IXI, and OASIS, and the results show that the proposed method achieves state-of-the-art performance in several evaluation metrics compared to the commonly utilized registration methods, including SyN, NiftyReg, VoxelMorph, CycleMorph, ViT-V-Net, and TransMorph, demonstrating the effectiveness of our model in deformable medical image registration.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsBrainImage Processing, Computer-Assisted

Förderung

  • National Natural Science Foundation of China
  • Major Basic Research Project of Shandong Province
  • New Twentieth Items of Universities in Jinan
  • Taishan Scholar Program of Shandong Province

Zitieren

APA

Chen, Z., Zheng, Y., & Gee, J. C. (2024). TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration. IEEE Transactions on Medical Imaging, 43(1), 15-27. https://doi.org/10.1109/tmi.2023.3288136

Vancouver

Chen Z, Zheng Y, Gee JC. TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration. IEEE Transactions on Medical Imaging. 2024;43(1):15-27. doi:10.1109/tmi.2023.3288136

BibTeX
@article{Chen2024,
  author = {Chen, Zeyuan and Zheng, Yuanjie and Gee, James C},
  title = {TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2024},
  volume = {43},
  number = {1},
  pages = {15--27},
  doi = {10.1109/tmi.2023.3288136}
}
Kostenlos starten →