HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery
Sensors · 03.07.2026 · 26 (13) · 4232
DOI: 10.3390/s26134232 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 03.07.2026. Verfasst von Meng Li und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Geography and Environment, Xianyang Normal University, Xianyang 712000, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Object detection in unmanned aerial vehicle (UAV) imagery suffers from severe scale variation, dense object packing, and prohibitive computational cost when conventional detectors exhaustively evaluate high-resolution frames. Reinforcement learning (RL)-based sequential detectors offer a promising alternative by formulating localization as an active search process, yet existing methods are limited by discrete-time state transitions, sparse reward signals, and premature policy collapse. In this paper, we propose HRL-Det, a hierarchical reinforcement learning framework that addresses these challenges through two tightly coupled innovations. First, a Neural ODE-driven Continuous-Time Bellman State Evolution module models the agent’s state dynamics as a stochastic differential equation governed by the Hamilton–Jacobi–Bellman equation, enabling fine-grained temporal reasoning with memory-efficient adjoint-based backpropagation. Second, a Lyapunov-Guided Entropy-Regularized Reward Shaping mechanism constructs convergence-promoting dense rewards informed by Lyapunov stability analysis while maintaining exploration diversity through maximum entropy optimization. Extensive experiments on VisDrone2019, DroneVehicle, and MS COCO 2017 show that HRL-Det achieves mAP@0.5 of 0.412, 0.812, and 0.735, respectively, outperforming existing RL-based detectors and achieving competitive accuracy relative to representative non-RL detectors under the same COCO metric, while requiring only 17.3 M parameters and an average of 6.3 search steps per object.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Geography and Environment, Xianyang Normal University, Xianyang 712000, China.
- School of Computer Science, National University of Defense Technology (NUDT), Changsha 410073, China.
ORCID-Profile: Yaowen Hu
Zitieren
APA
Li, M., & Hu, Y. (2026). HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery. Sensors, 26(13), 4232. https://doi.org/10.3390/s26134232
Vancouver
Li M, Hu Y. HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery. Sensors. 2026;26(13):4232. doi:10.3390/s26134232
BibTeX
@article{Li2026,
author = {Li, Meng and Hu, Yaowen},
title = {HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery},
journal = {Sensors},
year = {2026},
volume = {26},
number = {13},
pages = {4232},
doi = {10.3390/s26134232}
}
EUVIMED