EUVIMEDEUVIMED entdecken
Crossref

MRI super-resolution using similarity distance and multi-scale receptive field based feature fusion GAN and pre-trained slice interpolation network

Nimitha U, Ameer P M

Magnetic Resonance Imaging · 2024

DOI: 10.1016/j.mri.2024.04.021 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Magnetic Resonance Imaging, 2024. Verfasst von Nimitha U und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics and Communication Engineering, National Institute of Technology Calicut, Kerala 673601, India. Electronic address: nimithau…. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Neural Networks, Computer, Image Processing, Computer-Assisted, Imaging, Three-Dimensional. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: Department of Science and Technology, Ministry of Science and Technology, India.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Challenges arise in achieving high-resolution Magnetic Resonance Imaging (MRI) to improve disease diagnosis accuracy due to limitations in hardware, patient discomfort, long acquisition times, and high costs. While Convolutional Neural Networks (CNNs) have shown promising results in MRI super-resolution, they often don't look into the structural similarity and prior information available in consecutive MRI slices. By leveraging information from sequential slices, more robust features can be obtained, potentially leading to higher-quality MRI slices. We propose a multi-slice two-dimensional (2D) MRI super-resolution network that combines a Generative Adversarial Network (GAN) with feature fusion and a pre-trained slice interpolation network to achieve three-dimensional (3D) super-resolution. The proposed model requires consecutively acquired three low-resolution (LR) MRI slices along a specific axis, and achieves the reconstruction of the MRI slices in the remaining two axes. The network effectively enhances both in-plane and out-of-plane resolution along the sagittal axis while addressing computational and memory constraints in 3D super-resolution. The proposed generator has a in-plane and out-of-plane Attention (IOA) network that fuses both in-plane and out-plane features of MRI dynamically. In terms of out-of-plane attention, the network merges features by considering the similarity distance between features and for in-plane attention, the network employs a two-level pyramid structure with varying receptive fields to extract features at different scales, ensuring the inclusion of both global and local features. Subsequently, to achieve 3D MRI super-resolution, a pre-trained slice interpolation network is used that takes two consecutive super-resolved MRI slices to generate a new intermediate slice. To further enhance the network performance and perceptual quality, we introduce a feature up-sampling layer and a feature extraction block with Scaled Exponential Linear Unit (SeLU). Moreover, our super-resolution network incorporates VGG loss from a fine-tuned VGG-19 network to provide additional enhancement. Through experimental evaluations on the IXI dataset and BRATS dataset, using the peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM) and the number of training parameters, we demonstrate the superior performance of our method compared to the existing techniques. Also, the proposed model can be adapted or modified to achieve super-resolution for both 2D and 3D MRI data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Magnetic Resonance ImagingNeural Networks, ComputerImage Processing, Computer-AssistedImaging, Three-DimensionalHumansAlgorithmsBrain

Stichwörter der Autor:innen

Deep learningFrame interpolationGenerative adversarial networksIn-plane and out-of-plane attentionMagnetic resonance imagingSuper-resolution

Autor:innen und Institutionen

  • Department of Electronics and Communication Engineering, National Institute of Technology Calicut, Kerala 673601, India. Electronic address: nimithau@gmail.com.
  • Department of Electronics and Communication Engineering, National Institute of Technology Calicut, Kerala 673601, India. Electronic address: ameer@nitc.ac.in.

Förderung

  • Department of Science and Technology, Ministry of Science and Technology, India

Zitieren

APA

U, N., & P M, A. (2024). MRI super-resolution using similarity distance and multi-scale receptive field based feature fusion GAN and pre-trained slice interpolation network. Magnetic Resonance Imaging. https://doi.org/10.1016/j.mri.2024.04.021

Vancouver

U N, P M A. MRI super-resolution using similarity distance and multi-scale receptive field based feature fusion GAN and pre-trained slice interpolation network. Magnetic Resonance Imaging. 2024. doi:10.1016/j.mri.2024.04.021

BibTeX
@article{U2024,
  author = {U, Nimitha and P M, Ameer},
  title = {MRI super-resolution using similarity distance and multi-scale receptive field based feature fusion GAN and pre-trained slice interpolation network},
  journal = {Magnetic Resonance Imaging},
  year = {2024},
  doi = {10.1016/j.mri.2024.04.021}
}
Kostenlos starten →