Pareto Refocusing for Drone-View Object Detection
IEEE Transactions on Circuits and Systems for Video Technology · 2023-03 · 33 (3) · 1320-1334
DOI: 10.1109/tcsvt.2022.3210207 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-03. Verfasst von Jiaxu Leng und 5 weiteren Autor:innen. Die Arbeit wurde bisher 95-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Research Program of Chongqing Municipal Education Commission, Chongqing Excellent Scientist Project.
Abstract (Originalsprache)
Drone-view Object Detection (DOD) is a meaningful but challenging task. It hits a bottleneck due to two main reasons: (1) The high proportion of difficult objects (e.g., small objects, occluded objects, etc.) makes the detection performance unsatisfactory. (2) The unevenly distributed objects make detection inefficient. These two factors also lead to a phenomenon, obeying the Pareto principle, that some challenging regions occupying a low area proportion of the image have a significant impact on the final detection while the vanilla regions occupying the major area have a negligible impact due to the limited room for performance improvement. Motivated by the human visual system that naturally attempts to invest unequal energies in things of hierarchical difficulty for recognizing objects effectively, this paper presents a novel Pareto Refocusing Detection (PRDet) network that distinguishes the challenging regions from the vanilla regions under reverse-attention guidance and refocuses the challenging regions with the assistance of the region-specific context. Specifically, we first propose a Reverse-attention Exploration Module (REM) that excavates the potential position of difficult objects by suppressing the features which are salient to the commonly used detector. Then, we propose a Region-specific Context Learning Module (RCLM) that learns to generate specific contexts for strengthening the understanding of challenging regions. It is noteworthy that the specific context is not shared globally but unique for each challenging region with the exploration of spatial and appearance cues. Extensive experiments and comprehensive evaluations on the VisDrone2021-DET and UAVDT datasets demonstrate that the proposed PRDet can effectively improve the detection performance, especially for those difficult objects, outperforming state-of-the-art detectors. Furthermore, our method also achieves significant performance improvements on the DTU-Drone dataset for power inspection.
Förderung
- National Natural Science Foundation of China
- Science and Technology Research Program of Chongqing Municipal Education Commission
- Chongqing Excellent Scientist Project
- Special Project on Technological Innovation and Application Development
Zitieren
APA
Leng, J., Mo, M., Zhou, Y., Gao, C., Li, W., & Gao, X. (2023). Pareto Refocusing for Drone-View Object Detection. IEEE Transactions on Circuits and Systems for Video Technology, 33(3), 1320-1334. https://doi.org/10.1109/tcsvt.2022.3210207
Vancouver
Leng J, Mo M, Zhou Y, Gao C, Li W, Gao X. Pareto Refocusing for Drone-View Object Detection. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(3):1320-1334. doi:10.1109/tcsvt.2022.3210207
BibTeX
@article{Leng2023,
author = {Leng, Jiaxu and Mo, Mengjingcheng and Zhou, Yinghua and Gao, Chenqiang and Li, Weisheng and Gao, Xinbo},
title = {Pareto Refocusing for Drone-View Object Detection},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2023},
volume = {33},
number = {3},
pages = {1320--1334},
doi = {10.1109/tcsvt.2022.3210207}
}
EUVIMED