EUVIMEDEUVIMED entdecken
Crossref

Graph Attention Transformer Network for Multi-label Image Classification

Jin Yuan, Shikai Chen, Yao Zhang, Zhongchao Shi, Xin Geng, Jianping Fan, Yong Rui

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2023 · 19 (4) · 1-16

DOI: 10.1145/3578518 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 27.02.2023. Verfasst von Jin Yuan und 6 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 61 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-label classification aims to recognize multiple objects or attributes from images. The key to solving this issue relies on effectively characterizing the inter-label correlations or dependencies, which bring the prevailing graph neural network. However, current methods often use the co-occurrence probability of labels based on the training set as the adjacency matrix to model this correlation, which is greatly limited by the dataset and affects the model’s generalization ability. This article proposes a Graph Attention Transformer Network, a general framework for multi-label image classification by mining rich and effective label correlation. First, we use the cosine similarity value of the pre-trained label word embedding as the initial correlation matrix, which can represent richer semantic information than the co-occurrence one. Subsequently, we propose the graph attention transformer layer to transfer this adjacency matrix to adapt to the current domain. Our extensive experiments have demonstrated that our proposed methods can achieve highly competitive performance on three datasets.

Zitieren

APA

Yuan, J., Chen, S., Zhang, Y., Shi, Z., Geng, X., Fan, J., & Rui, Y. (2023). Graph Attention Transformer Network for Multi-label Image Classification. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(4), 1-16. https://doi.org/10.1145/3578518

Vancouver

Yuan J, Chen S, Zhang Y, Shi Z, Geng X, Fan J, et al. Graph Attention Transformer Network for Multi-label Image Classification. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(4):1-16. doi:10.1145/3578518

BibTeX
@article{Yuan2023,
  author = {Yuan, Jin and Chen, Shikai and Zhang, Yao and Shi, Zhongchao and Geng, Xin and Fan, Jianping and Rui, Yong},
  title = {Graph Attention Transformer Network for Multi-label Image Classification},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2023},
  volume = {19},
  number = {4},
  pages = {1--16},
  doi = {10.1145/3578518}
}
Kostenlos starten →