EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

GLClick: Interactive Segmentation Combining Global and Local Features

Jiaying Tang, Hongyuan Wang, Zongyuan Ding, Zihao Xin

Applied Sciences · 28.12.2024 · 15 (1) · 186

DOI: 10.3390/app15010186 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 28.12.2024. Verfasst von Jiaying Tang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Postgraduate Research and Practice Innovation Program of Jiangsu Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Convolutional neural networks (CNNs) are the backbone of most modern interactive segmentation algorithms. However, the limited receptive field of CNNs restricts their ability to capture long-range semantic relationships. Recently, transformers have gained significant attention for their capacity to capture long-range dependencies. Nevertheless, CNNs still outperform Transformer in extracting local information. An effective interactive segmentation algorithm should accurately capture fine-grained local details alongside global semantic relationships. Therefore, we propose GLClick, a global–local click-based interactive image segmentation model that integrates local and global information through a novel fusion mechanism. We design an efficient global–local feature fusion module (GLFM) that integrates fine-grained features from various layers of ResNet50 with those from the Transformer feature pyramid. This approach maintains ResNet50’s ability to extract local features while effectively leveraging the Transformer to capture global context. Additionally, we enhance the multi-layer perceptron (MLP) to improve performance. Extensive experiments on diverse benchmark datasets demonstrate significant improvements in interactive image segmentation, confirming the effectiveness of our approach. Moreover, we conduct experiments on medical image datasets, further illustrating the model’s versatility and effectiveness across different domains.

Förderung

  • National Natural Science Foundation of China
  • Postgraduate Research and Practice Innovation Program of Jiangsu Province

Zitieren

APA

Tang, J., Wang, H., Ding, Z., & Xin, Z. (2024). GLClick: Interactive Segmentation Combining Global and Local Features. Applied Sciences, 15(1), 186. https://doi.org/10.3390/app15010186

Vancouver

Tang J, Wang H, Ding Z, Xin Z. GLClick: Interactive Segmentation Combining Global and Local Features. Applied Sciences. 2024;15(1):186. doi:10.3390/app15010186

BibTeX
@article{Tang2024,
  author = {Tang, Jiaying and Wang, Hongyuan and Ding, Zongyuan and Xin, Zihao},
  title = {GLClick: Interactive Segmentation Combining Global and Local Features},
  journal = {Applied Sciences},
  year = {2024},
  volume = {15},
  number = {1},
  pages = {186},
  doi = {10.3390/app15010186}
}
Kostenlos starten →