CycleMLP: A MLP-Like Architecture for Dense Visual Predictions
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023-12 · 45 (12) · 14284-14300
DOI: 10.1109/tpami.2023.3303397 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023-12. Verfasst von Shoufa Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 119-mal zitiert (Crossref) und nennt 129 Literaturangaben. Gefördert von: National Key R&D Program of China, General Research Fund of Hong Kong.
Abstract (Originalsprache)
This article presents a simple yet effective multilayer perceptron (MLP) architecture, namely CycleMLP, which is a versatile neural backbone network capable of solving various tasks of dense visual predictions such as object detection, segmentation, and human pose estimation. Compared to recent advanced MLP architectures such as MLP-Mixer (Tolstikhin et al. 2021), ResMLP (Touvron et al. 2021), and gMLP (Liu et al. 2021), whose architectures are sensitive to image size and are infeasible in dense prediction tasks, CycleMLP has two appealing advantages: 1) CycleMLP can cope with various spatial sizes of images; 2) CycleMLP achieves linear computational complexity with respect to the image size by using local windows. In contrast, previous MLPs have O(N2) computational complexity due to their full connections in space. 3) The relationship between convolution, multi-head self-attention in Transformer, and CycleMLP are discussed through an intuitive theoretical analysis. We build a family of models that can surpass state-of-the-art MLP and Transformer models e.g., Swin Transformer (Liu et al. 2021), while using fewer parameters and FLOPs. CycleMLP expands the MLP-like models' applicability, making them versatile backbone networks that achieve competitive results on dense prediction tasks For example, CycleMLP-Tiny outperforms Swin-Tiny by 1.3% mIoU on ADE20 K dataset with fewer FLOPs. Moreover, CycleMLP also shows excellent zero-shot robustness on ImageNet-C dataset.
Förderung
- National Key R&D Program of China
- General Research Fund of Hong Kong
Zitieren
APA
Chen, S., Xie, E., Ge, C., Chen, R., Liang, D., & Luo, P. (2023). CycleMLP: A MLP-Like Architecture for Dense Visual Predictions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(12), 14284-14300. https://doi.org/10.1109/tpami.2023.3303397
Vancouver
Chen S, Xie E, Ge C, Chen R, Liang D, Luo P. CycleMLP: A MLP-Like Architecture for Dense Visual Predictions. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(12):14284-14300. doi:10.1109/tpami.2023.3303397
BibTeX
@article{Chen2023,
author = {Chen, Shoufa and Xie, Enze and Ge, Chongjian and Chen, Runjian and Liang, Ding and Luo, Ping},
title = {CycleMLP: A MLP-Like Architecture for Dense Visual Predictions},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {12},
pages = {14284--14300},
doi = {10.1109/tpami.2023.3303397}
}
EUVIMED