EUVIMEDEUVIMED entdecken
Crossref

Cross-Modality Neighborhood Attention Network for Fine-Grained Sketch-Based Image Retrieval

Donglin Zhang, Chang-Xing Li, Xiao-Jun Wu

IEEE Transactions on Circuits and Systems for Video Technology · 2026-08 · 36 (8) · 12156-12167

DOI: 10.1109/tcsvt.2026.3682932 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-08. Verfasst von Donglin Zhang und 2 weiteren Autor:innen. Die Arbeit nennt 62 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) is a challenging task that focuses on retrieving relevant images based on sketch queries at the instance level. Most existing works tend to make cross-modality interactions between features at the global level and treat each feature equally when calculating similarity. However, this equal treatment may reduce the contribution of fine-grained information. To address these challenges, we propose a novel Cross-Modality Neighborhood Attention Network, named CMNA-Net. Specifically, we develop a novel CMNA mechanism in the proposed method to adjust the importance of modality-agnostic features, which not only performs neighborhood attention operation on the current modality but also performs cross-neighborhood attention on both modalities. Additionally, the edge map is innovatively introduced to reduce the modality gap. Furthermore, this work proposes a Neighborhood Weighted module that integrates the local feature weight scheme and top-k feature selection strategy, yielding more discriminative features tailored to fine-grained retrieval. Extensive experiments on three benchmark datasets demonstrate that our proposed CMNA-Net can achieve better performance compared to some existing state-of-the-art methods in FG-SBIR scenarios. The code of our method will be available at https://github.com/li1changxing/CMNA-Net

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Zhang, D., Li, C., & Wu, X. (2026). Cross-Modality Neighborhood Attention Network for Fine-Grained Sketch-Based Image Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 36(8), 12156-12167. https://doi.org/10.1109/tcsvt.2026.3682932

Vancouver

Zhang D, Li C, Wu X. Cross-Modality Neighborhood Attention Network for Fine-Grained Sketch-Based Image Retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(8):12156-12167. doi:10.1109/tcsvt.2026.3682932

BibTeX
@article{Zhang2026,
  author = {Zhang, Donglin and Li, Chang-Xing and Wu, Xiao-Jun},
  title = {Cross-Modality Neighborhood Attention Network for Fine-Grained Sketch-Based Image Retrieval},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2026},
  volume = {36},
  number = {8},
  pages = {12156--12167},
  doi = {10.1109/tcsvt.2026.3682932}
}
Kostenlos starten →