DeepPyramid+: medical image segmentation using Pyramid View Fusion and Deformable Pyramid Reception
International Journal of Computer Assisted Radiology and Surgery · 2024
DOI: 10.1007/s11548-023-03046-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Negin Ghamsarian und 4 weiteren Autor:innen. Beteiligte Einrichtung: ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland. negin.ghamsarian@unibe.ch. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Haag-Streit Foundation, Switzerland.
Abstract (Originalsprache)
Purpose
Semantic segmentation plays a pivotal role in many applications related to medical image and video analysis. However, designing a neural network architecture for medical image and surgical video segmentation is challenging due to the diverse features of relevant classes, including heterogeneity, deformability, transparency, blunt boundaries, and various distortions. We propose a network architecture, DeepPyramid+, which addresses diverse challenges encountered in medical image and surgical video segmentation.
Methods
The proposed DeepPyramid+ incorporates two major modules, namely “Pyramid View Fusion” (PVF) and “Deformable Pyramid Reception” (DPR), to address the outlined challenges. PVF replicates a deduction process within the neural network, aligning with the human visual system, thereby enhancing the representation of relative information at each pixel position. Complementarily, DPR introduces shape- and scale-adaptive feature extraction techniques using dilated deformable convolutions, enhancing accuracy and robustness in handling heterogeneous classes and deformable shapes.
Results
Extensive experiments conducted on diverse datasets, including endometriosis videos, MRI images, OCT scans, and cataract and laparoscopy videos, demonstrate the effectiveness of DeepPyramid+ in handling various challenges such as shape and scale variation, reflection, and blur degradation. DeepPyramid+ demonstrates significant improvements in segmentation performance, achieving up to a 3.65% increase in Dice coefficient for intra-domain segmentation and up to a 17% increase in Dice coefficient for cross-domain segmentation.
Conclusions
DeepPyramid+ consistently outperforms state-of-the-art networks across diverse modalities considering different backbone networks, showcasing its versatility. Accordingly, DeepPyramid+ emerges as a robust and effective solution, successfully overcoming the intricate challenges associated with relevant content segmentation in medical images and surgical videos. Its consistent performance and adaptability indicate its potential to enhance precision in computerized medical image and surgical video analysis applications.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland. negin.ghamsarian@unibe.ch.
- Department of Ophthalmology, Inselspital, Bern, Switzerland.
- Department of Information Technology, University of Klagenfurt, Klagenfurt, Austria.
- ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland.
Förderung
- Haag-Streit Foundation, Switzerland
Zitieren
APA
Ghamsarian, N., Wolf, S., Zinkernagel, M., Schoeffmann, K., & Sznitman, R. (2024). DeepPyramid+: medical image segmentation using Pyramid View Fusion and Deformable Pyramid Reception. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-023-03046-2
Vancouver
Ghamsarian N, Wolf S, Zinkernagel M, Schoeffmann K, Sznitman R. DeepPyramid+: medical image segmentation using Pyramid View Fusion and Deformable Pyramid Reception. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-023-03046-2
BibTeX
@article{Ghamsarian2024,
author = {Ghamsarian, Negin and Wolf, Sebastian and Zinkernagel, Martin and Schoeffmann, Klaus and Sznitman, Raphael},
title = {DeepPyramid+: medical image segmentation using Pyramid View Fusion and Deformable Pyramid Reception},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
doi = {10.1007/s11548-023-03046-2}
}
EUVIMED