Multitask Weakly Supervised Generative Network for MR-US Registration
IEEE Transactions on Medical Imaging · 2024
DOI: 10.1109/tmi.2024.3400899 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024. Verfasst von Mohammad Farid Azampour und 9 weiteren Autor:innen. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Ultrasonography, Prostate. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bavarian State Ministry of Economic Affairs, Regional Development and Energy (funding Program Bayerischen Verbundforschungsprogramms, German Research Foundation (DFG), through the Collaborative Research Center, Exzellenzverbünde und Universität-skooperationen (EVUK) Program (“Next-Generation Al for Integrated Diagnostics”) of the Free State of Bavaria.
Abstract (Originalsprache)
Registering pre-operative modalities, such as magnetic resonance imaging or computed tomography, to ultrasound images is crucial for guiding clinicians during surgeries and biopsies. Recently, deep-learning approaches have been proposed to increase the speed and accuracy of this registration problem. However, all of these approaches need expensive supervision from the ultrasound domain. In this work, we propose a multitask generative framework that needs weak supervision only from the pre-operative imaging domain during training. To perform a deformable registration, the proposed framework translates a magnetic resonance image to the ultrasound domain while preserving the structural content. To demonstrate the efficacy of the proposed method, we tackle the registration problem of pre-operative 3D MR to transrectal ultrasonography images as necessary for targeted prostate biopsies. We use an in-house dataset of 600 patients, divided into 540 for training, 30 for validation, and the remaining for testing. An expert manually segmented the prostate in both modalities for validation and test sets to assess the performance of our framework. The proposed framework achieves a 3.58 mm target registration error on the expert-selected landmarks, 89.2% in the Dice score, and 1.81 mm 95th percentile Hausdorff distance on the prostate masks in the test set. Our experiments demonstrate that the proposed generative model successfully translates magnetic resonance images into the ultrasound domain. The translated image contains the structural content and fine details due to an ultrasound-specific two-path design of the generative model. The proposed framework enables training learning-based registration methods while only weak supervision from the pre-operative domain is available.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- Bavarian State Ministry of Economic Affairs, Regional Development and Energy (funding Program Bayerischen Verbundforschungsprogramms
- German Research Foundation (DFG), through the Collaborative Research Center
- Exzellenzverbünde und Universität-skooperationen (EVUK) Program (“Next-Generation Al for Integrated Diagnostics”) of the Free State of Bavaria
Zitieren
APA
Azampour, M. F., Mach, K., Fatemizadeh, E., Demiray, B., Westenfelder, K., Steiger, K., Eiber, M., Wendler, T., Kainz, B., & Navab, N. (2024). Multitask Weakly Supervised Generative Network for MR-US Registration. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2024.3400899
Vancouver
Azampour MF, Mach K, Fatemizadeh E, Demiray B, Westenfelder K, Steiger K, et al. Multitask Weakly Supervised Generative Network for MR-US Registration. IEEE Transactions on Medical Imaging. 2024. doi:10.1109/tmi.2024.3400899
BibTeX
@article{Azampour2024,
author = {Azampour, Mohammad Farid and Mach, Kristina and Fatemizadeh, Emad and Demiray, Beatrice and Westenfelder, Kay and Steiger, Katja and Eiber, Matthias and Wendler, Thomas and Kainz, Bernhard and Navab, Nassir},
title = {Multitask Weakly Supervised Generative Network for MR-US Registration},
journal = {IEEE Transactions on Medical Imaging},
year = {2024},
doi = {10.1109/tmi.2024.3400899}
}
EUVIMED