Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification
Sensors · 23.03.2024 · 24 (7) · 2055
DOI: 10.3390/s24072055 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 23.03.2024. Verfasst von Jiahang Lyu und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: International Cooperation Foundation of Jilin Province.
Abstract (Originalsprache)
In recent years, computer vision has witnessed remarkable advancements in image classification, specifically in the domains of fully convolutional neural networks (FCNs) and self-attention mechanisms. Nevertheless, both approaches exhibit certain limitations. FCNs tend to prioritize local information, potentially overlooking crucial global contexts, whereas self-attention mechanisms are computationally intensive despite their adaptability. In order to surmount these challenges, this paper proposes cross-and-diagonal networks (CDNet), innovative network architecture that adeptly captures global information in images while preserving local details in a more computationally efficient manner. CDNet achieves this by establishing long-range relationships between pixels within an image, enabling the indirect acquisition of contextual information. This inventive indirect self-attention mechanism significantly enhances the network’s capacity. In CDNet, a new attention mechanism named “cross and diagonal attention” is proposed. This mechanism adopts an indirect approach by integrating two distinct components, cross attention and diagonal attention. By computing attention in different directions, specifically vertical and diagonal, CDNet effectively establishes remote dependencies among pixels, resulting in improved performance in image classification tasks. Experimental results highlight several advantages of CDNet. Firstly, it introduces an indirect self-attention mechanism that can be effortlessly integrated as a module into any convolutional neural network (CNN). Additionally, the computational cost of the self-attention mechanism has been effectively reduced, resulting in improved overall computational efficiency. Lastly, CDNet attains state-of-the-art performance on three benchmark datasets for similar types of image classification networks. In essence, CDNet addresses the constraints of conventional approaches and provides an efficient and effective solution for capturing global context in image classification tasks.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China.
- Faculty of Engineering & Information Technology, University of Technology Sydney, Sydney, NWS 2007, Australia.
- Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528400, China.
Förderung
- International Cooperation Foundation of Jilin Province
Zitieren
APA
Lyu, J., Zou, R., Wan, Q., Xi, W., Yang, Q., Kodagoda, S., & Wang, S. (2024). Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification. Sensors, 24(7), 2055. https://doi.org/10.3390/s24072055
Vancouver
Lyu J, Zou R, Wan Q, Xi W, Yang Q, Kodagoda S, et al. Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification. Sensors. 2024;24(7):2055. doi:10.3390/s24072055
BibTeX
@article{Lyu2024,
author = {Lyu, Jiahang and Zou, Rongxin and Wan, Qin and Xi, Wang and Yang, Qinglin and Kodagoda, Sarath and Wang, Shifeng},
title = {Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification},
journal = {Sensors},
year = {2024},
volume = {24},
number = {7},
pages = {2055},
doi = {10.3390/s24072055}
}
EUVIMED