EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MCV-UNet: a modified convolution & transformer hybrid encoder-decoder network with multi-scale information fusion for ultrasound image semantic segmentation

Zihong Xu, Ziyang Wang

PeerJ Computer Science · 24.06.2024 · 10 · e2146

DOI: 10.7717/peerj-cs.2146 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 24.06.2024. Verfasst von Zihong Xu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mechanical Engineering, Columbia University, New York, United States of America. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, the growing importance of accurate semantic segmentation in ultrasound images has led to numerous advances in deep learning-based techniques. In this article, we introduce a novel hybrid network that synergistically combines convolutional neural networks (CNN) and Vision Transformers (ViT) for ultrasound image semantic segmentation. Our primary contribution is the incorporation of multi-scale CNN in both the encoder and decoder stages, enhancing feature learning capabilities across multiple scales. Further, the bottleneck of the network leverages the ViT to capture long-range high-dimension spatial dependencies, a critical factor often overlooked in conventional CNN-based approaches. We conducted extensive experiments using a public benchmark ultrasound nerve segmentation dataset. Our proposed method was benchmarked against 17 existing baseline methods, and the results underscored its superiority, as it outperformed all competing methods including a 4.6% improvement of Dice compared against TransUNet, 13.0% improvement of Dice against Attention UNet, 10.5% improvement of precision compared against UNet. This research offers significant potential for real-world applications in medical imaging, demonstrating the power of blending CNN and ViT in a unified framework.

Schlagwörter

Stichwörter der Autor:innen

Convolutional neural networkImage semantic segmentationUltrasound imagingVision transformer

Autor:innen und Institutionen

  • Department of Mechanical Engineering, Columbia University, New York, United States of America.
  • Department of Computer Science, University of Oxford, Oxford, United Kingdom.

Zitieren

APA

Xu, Z., & Wang, Z. (2024). MCV-UNet: a modified convolution & transformer hybrid encoder-decoder network with multi-scale information fusion for ultrasound image semantic segmentation. PeerJ Computer Science, 10, e2146. https://doi.org/10.7717/peerj-cs.2146

Vancouver

Xu Z, Wang Z. MCV-UNet: a modified convolution & transformer hybrid encoder-decoder network with multi-scale information fusion for ultrasound image semantic segmentation. PeerJ Computer Science. 2024;10:e2146. doi:10.7717/peerj-cs.2146

BibTeX
@article{Xu2024,
  author = {Xu, Zihong and Wang, Ziyang},
  title = {MCV-UNet: a modified convolution & transformer hybrid encoder-decoder network with multi-scale information fusion for ultrasound image semantic segmentation},
  journal = {PeerJ Computer Science},
  year = {2024},
  volume = {10},
  pages = {e2146},
  doi = {10.7717/peerj-cs.2146}
}
Kostenlos starten →