Graph Attention Transformer Network for Multi-label Image Classification
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2023 · 19 (4) · 1-16
DOI: 10.1145/3578518 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 27.02.2023. Verfasst von Jin Yuan und 6 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 61 Literaturangaben.
Abstract (Originalsprache)
Multi-label classification aims to recognize multiple objects or attributes from images. The key to solving this issue relies on effectively characterizing the inter-label correlations or dependencies, which bring the prevailing graph neural network. However, current methods often use the co-occurrence probability of labels based on the training set as the adjacency matrix to model this correlation, which is greatly limited by the dataset and affects the model’s generalization ability. This article proposes a Graph Attention Transformer Network, a general framework for multi-label image classification by mining rich and effective label correlation. First, we use the cosine similarity value of the pre-trained label word embedding as the initial correlation matrix, which can represent richer semantic information than the co-occurrence one. Subsequently, we propose the graph attention transformer layer to transfer this adjacency matrix to adapt to the current domain. Our extensive experiments have demonstrated that our proposed methods can achieve highly competitive performance on three datasets.
Zitieren
APA
Yuan, J., Chen, S., Zhang, Y., Shi, Z., Geng, X., Fan, J., & Rui, Y. (2023). Graph Attention Transformer Network for Multi-label Image Classification. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(4), 1-16. https://doi.org/10.1145/3578518
Vancouver
Yuan J, Chen S, Zhang Y, Shi Z, Geng X, Fan J, et al. Graph Attention Transformer Network for Multi-label Image Classification. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(4):1-16. doi:10.1145/3578518
BibTeX
@article{Yuan2023,
author = {Yuan, Jin and Chen, Shikai and Zhang, Yao and Shi, Zhongchao and Geng, Xin and Fan, Jianping and Rui, Yong},
title = {Graph Attention Transformer Network for Multi-label Image Classification},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2023},
volume = {19},
number = {4},
pages = {1--16},
doi = {10.1145/3578518}
}
EUVIMED