Towards Unified Transformer for UAV‐Based Multi‐Task Oriented Object Detection
IET Image Processing · 2026-01 · 20 (1)
DOI: 10.1049/ipr2.70343 ↗At a glance
Journal article in IET Image Processing, published online on 2026-04-15. Written by Jiazhi Sun and 4 co-authors. Cited 6 times so far (Crossref); 44 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
UAV‐based visible‐thermal object detection is crucial for all‐weather aerial perception. However, prevailing methods that train separate models for visible, thermal, and fusion tasks incur significant computational redundancy. Moreover, under the typical UAV perspective, objects often appear with arbitrary orientations, making oriented bounding boxes more suitable than horizontal ones for accurate localization. To address both the efficiency challenge and the need for precise orientation‐aware detection, we propose TUMODet, a unified multi‐task oriented detection framework. Built upon the spatial transform decoupling (STD) detector, TUMODet incorporates task‐token prompt embedding and static weighted fusion, enabling a single model to dynamically handle three detection tasks (visible, thermal, and fused modalities). Comprehensive experiments on the DroneVehicle dataset demonstrate that our unified framework significantly improves parameter efficiency and resource utilization while achieving competitive performance across all tasks, particularly in the challenging fusion scenario. The results validate TUMODet as an efficient and practical solution for unified multimodal detection on resource‐constrained UAV platforms.
Cite
APA
Sun, J., Li, D., Kuai, Y., Belotserkovsky, A., & Lukashevich, P. (2026). Towards Unified Transformer for UAV‐Based Multi‐Task Oriented Object Detection. IET Image Processing, 20(1). https://doi.org/10.1049/ipr2.70343
Vancouver
Sun J, Li D, Kuai Y, Belotserkovsky A, Lukashevich P. Towards Unified Transformer for UAV‐Based Multi‐Task Oriented Object Detection. IET Image Processing. 2026;20(1). doi:10.1049/ipr2.70343
BibTeX
@article{Sun2026,
author = {Sun, Jiazhi and Li, Dongdong and Kuai, Yangliu and Belotserkovsky, Alexei and Lukashevich, Pavel},
title = {Towards Unified Transformer for UAV‐Based Multi‐Task Oriented Object Detection},
journal = {IET Image Processing},
year = {2026},
volume = {20},
number = {1},
doi = {10.1049/ipr2.70343}
}
EUVIMED