CF-ViT: A General Coarse-to-Fine Method for Vision Transformer
Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (6) · 7042-7052
DOI: 10.1609/aaai.v37i6.25860 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Mengzhao Chen und 6 weiteren Autor:innen. Die Arbeit wurde bisher 65-mal zitiert (Crossref).
Abstract (Originalsprache)
Vision Transformers (ViT) have made many breakthroughs in computer vision tasks. However, considerable redundancy arises in the spatial dimension of an input image, leading to massive computational costs. Therefore, We propose a coarse-to-fine vision transformer (CF-ViT) to relieve computational burden while retaining performance in this paper. Our proposed CF-ViT is motivated by two important observations in modern ViT models: (1) The coarse-grained patch splitting can locate informative regions of an input image. (2) Most images can be well recognized by a ViT model in a small-length token sequence. Therefore, our CF-ViT implements network inference in a two-stage manner. At coarse inference stage, an input image is split into a small-length patch sequence for a computationally economical classification. If not well recognized, the informative patches are identified and further re-split in a fine-grained granularity. Extensive experiments demonstrate the efficacy of our CF-ViT. For example, without any compromise on performance, CF-ViT reduces 53% FLOPs of LV-ViT, and also achieves 2.01x throughput. Code of this project is at https://github.com/ChenMnZ/CF-V
Zitieren
APA
Chen, M., Lin, M., Li, K., Shen, Y., Wu, Y., Chao, F., & Ji, R. (2023). CF-ViT: A General Coarse-to-Fine Method for Vision Transformer. Proceedings of the AAAI Conference on Artificial Intelligence, 37(6), 7042-7052. https://doi.org/10.1609/aaai.v37i6.25860
Vancouver
Chen M, Lin M, Li K, Shen Y, Wu Y, Chao F, et al. CF-ViT: A General Coarse-to-Fine Method for Vision Transformer. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(6):7042-7052. doi:10.1609/aaai.v37i6.25860
BibTeX
@article{Chen2023,
author = {Chen, Mengzhao and Lin, Mingbao and Li, Ke and Shen, Yunhang and Wu, Yongjian and Chao, Fei and Ji, Rongrong},
title = {CF-ViT: A General Coarse-to-Fine Method for Vision Transformer},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2023},
volume = {37},
number = {6},
pages = {7042--7052},
doi = {10.1609/aaai.v37i6.25860}
}
EUVIMED