EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery

Meng Li, Yaowen Hu iD

Sensors · 03.07.2026 · 26 (13) · 4232

DOI: 10.3390/s26134232 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 03.07.2026. Verfasst von Meng Li und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Geography and Environment, Xianyang Normal University, Xianyang 712000, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object detection in unmanned aerial vehicle (UAV) imagery suffers from severe scale variation, dense object packing, and prohibitive computational cost when conventional detectors exhaustively evaluate high-resolution frames. Reinforcement learning (RL)-based sequential detectors offer a promising alternative by formulating localization as an active search process, yet existing methods are limited by discrete-time state transitions, sparse reward signals, and premature policy collapse. In this paper, we propose HRL-Det, a hierarchical reinforcement learning framework that addresses these challenges through two tightly coupled innovations. First, a Neural ODE-driven Continuous-Time Bellman State Evolution module models the agent’s state dynamics as a stochastic differential equation governed by the Hamilton–Jacobi–Bellman equation, enabling fine-grained temporal reasoning with memory-efficient adjoint-based backpropagation. Second, a Lyapunov-Guided Entropy-Regularized Reward Shaping mechanism constructs convergence-promoting dense rewards informed by Lyapunov stability analysis while maintaining exploration diversity through maximum entropy optimization. Extensive experiments on VisDrone2019, DroneVehicle, and MS COCO 2017 show that HRL-Det achieves mAP@0.5 of 0.412, 0.812, and 0.735, respectively, outperforming existing RL-based detectors and achieving competitive accuracy relative to representative non-RL detectors under the same COCO metric, while requiring only 17.3 M parameters and an average of 6.3 search steps per object.

Schlagwörter

Stichwörter der Autor:innen

Lyapunov stabilitydeep Q-networkhierarchical reinforcement learningneural ordinary differential equationobject detectionreinforcement learningreward shapingunmanned aerial vehicle

Autor:innen und Institutionen

  • College of Geography and Environment, Xianyang Normal University, Xianyang 712000, China.
  • School of Computer Science, National University of Defense Technology (NUDT), Changsha 410073, China.

ORCID-Profile: Yaowen Hu

Zitieren

APA

Li, M., & Hu, Y. (2026). HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery. Sensors, 26(13), 4232. https://doi.org/10.3390/s26134232

Vancouver

Li M, Hu Y. HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery. Sensors. 2026;26(13):4232. doi:10.3390/s26134232

BibTeX
@article{Li2026,
  author = {Li, Meng and Hu, Yaowen},
  title = {HRL-Det: Hierarchical Reinforcement Learning for Sequential Object Detection in Aerial Imagery},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {13},
  pages = {4232},
  doi = {10.3390/s26134232}
}
Kostenlos starten →