XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026 · 1-18
DOI: 10.1109/tpami.2026.3741044 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026. Verfasst von Jiahao Guo und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Small object detection and tracking in videos remain critical yet underexplored challenges in computer vision, particularly for applications such as public safety, aerial surveillance, and autonomous driving. Existing benchmarks offer limited support due to limited numbers of small objects, constrained category diversity, and narrow scene coverage. To address these limitations, we introduce XS-VID, a large-scale video benchmark comprising 223K frames and 1.4M annotated bounding boxes across 374 video sequences spanning diverse scene types. XS-VID provides extensive coverage of small-object scales, particularly for extremely small (0 ∼ 122 pixels) and small (122 ∼ 202 pixels) objects, which collectively constitute over 55% of all annotations. For systematic evaluation, we establish three dedicated tracks: Detection, multiple object tracking (MOT), and single object tracking (SOT), and extensively test the existing state-of-the-art methods on each. The experimental results indicate that existing methods face significant challenges with XS-VID, mainly stemming from insufficient modeling of spatiotemporal features at small scales. To tackle these challenges, we propose a lightweight, high-precision detection framework dubbed YOLOFT. It enhances small-object feature representation and spatiotemporal integration while preserving high detection speed,thereby achieving improved accuracy and robustness onboth the XS-VID and VisDrone benchmarks.
Zitieren
APA
Guo, J., Xu, Z., Wu, L., Gao, F., Liu, W., & Wang, X. (2026). XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1-18. https://doi.org/10.1109/tpami.2026.3741044
Vancouver
Guo J, Xu Z, Wu L, Gao F, Liu W, Wang X. XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026:1-18. doi:10.1109/tpami.2026.3741044
BibTeX
@article{Guo2026,
author = {Guo, Jiahao and Xu, Ziyang and Wu, Lianjun and Gao, Fei and Liu, Wenyu and Wang, Xinggang},
title = {XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
pages = {1--18},
doi = {10.1109/tpami.2026.3741044}
}
EUVIMED