Sparse R-CNN: An End-to-End Framework for Object Detection
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023-12 · 45 (12) · 15650-15664
DOI: 10.1109/tpami.2023.3292030 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023-12. Verfasst von Peize Sun und 8 weiteren Autor:innen. Die Arbeit wurde bisher 134-mal zitiert (Crossref) und nennt 89 Literaturangaben. Gefördert von: General Research Fund of HK.
Abstract (Originalsprache)
Object detection serves as one of most fundamental computer vision tasks. Existing works on object detection heavily rely on dense object candidates, such as k anchor boxes pre-defined on all grids of an image feature map of size H×W. In this paper, we present Sparse R-CNN, a very simple and sparse method for object detection in images. In our method, a fixed sparse set of learned object proposals ( N in total) are provided to the object recognition head to perform classification and localization. By replacing HWk (up to hundreds of thousands) hand-designed object candidates with N (e.g., 100) learnable proposals, Sparse R-CNN makes all efforts related to object candidates design and one-to-many label assignment completely obsolete. More importantly, Sparse R-CNN directly outputs predictions without the non-maximum suppression (NMS) post-processing procedure. Thus, it establishes an end-to-end object detection framework. Sparse R-CNN demonstrates highly competitive accuracy, run-time and training convergence performance with the well-established detector baselines on the challenging COCO dataset and CrowdHuman dataset. We hope that our work can inspire re-thinking the convention of dense prior in object detectors and designing new high-performance detectors.
Förderung
- General Research Fund of HK
Zitieren
APA
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Yuan, Z., & Luo, P. (2023). Sparse R-CNN: An End-to-End Framework for Object Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(12), 15650-15664. https://doi.org/10.1109/tpami.2023.3292030
Vancouver
Sun P, Zhang R, Jiang Y, Kong T, Xu C, Zhan W, et al. Sparse R-CNN: An End-to-End Framework for Object Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(12):15650-15664. doi:10.1109/tpami.2023.3292030
BibTeX
@article{Sun2023,
author = {Sun, Peize and Zhang, Rufeng and Jiang, Yi and Kong, Tao and Xu, Chenfeng and Zhan, Wei and Tomizuka, Masayoshi and Yuan, Zehuan and Luo, Ping},
title = {Sparse R-CNN: An End-to-End Framework for Object Detection},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {12},
pages = {15650--15664},
doi = {10.1109/tpami.2023.3292030}
}
EUVIMED