EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19

Venu Allapakam, Yepuganti Karuna iD

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0309651 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Venu Allapakam und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronics Engineering, Vellore Institute of Technology, Vellore, India. Hauptthemen laut MEDLINE: Deep Learning, Neural Networks, Computer. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal medical image fusion methods, which combine complementary information from many multi-modality medical images, are among the most important and practical approaches in numerous clinical applications. Various conventional image fusion techniques have been developed for multimodality image fusion. Complex procedures for weight map computing, fixed fusion strategy and lack of contextual understanding remain difficult in conventional and machine learning approaches, usually resulting in artefacts that degrade the image quality. This work proposes an efficient hybrid learning model for medical image fusion using pre-trained and non-pre-trained networks i.e. VGG-19 and SNN with stacking ensemble method. The model leveraging the unique capabilities of each architecture, can effectively preserve the detailed information with high visual quality, for numerous combinations of image modalities in image fusion challenges, notably improved contrast, increased resolution, and lower artefacts. Additionally, this ensemble model can be more robust in the fusion of various combinations of source images that are publicly available from Havard-Medical-Image-Fusion Datasets, GitHub. and Kaggle. Our proposed model performance is superior in terms of visual quality and performance metrics to that of the existing fusion methods in literature like PCA+DTCWT, NSCT, DWT, DTCWT+NSCT, GADCT, CNN and VGG-19.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningNeural Networks, ComputerHumansImage Processing, Computer-AssistedMultimodal ImagingMagnetic Resonance ImagingAlgorithms

Autor:innen und Institutionen

  • School of Electronics Engineering, Vellore Institute of Technology, Vellore, India.
  • School of Electronics Engineering, VIT-AP University, Amaravathi, India.

ORCID-Profile: Yepuganti Karuna

Zitieren

APA

Allapakam, V., & Karuna, Y. (2024). An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19. PLOS ONE. https://doi.org/10.1371/journal.pone.0309651

Vancouver

Allapakam V, Karuna Y. An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19. PLOS ONE. 2024. doi:10.1371/journal.pone.0309651

BibTeX
@article{Allapakam2024,
  author = {Allapakam, Venu and Karuna, Yepuganti},
  title = {An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0309651}
}
Kostenlos starten →