EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Adaptive Scheduling Algorithm Integrating Hierarchical Reinforcement Learning and Semi-Markov Decision Processes

Feng Wang, Bingwei Ding, Fangchao Tian, Zhaohua Guo, Wenshuo Ma

Applied Sciences · 01.07.2026 · 16 (13) · 6570

DOI: 10.3390/app16136570 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.07.2026. Verfasst von Feng Wang und 4 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Research and Development Program of Henan Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Coordinating multiple unmanned aerial vehicle (UAV) systems under strict energy and temporal constraints remains a complex scheduling problem. Existing reinforcement learning methods typically rely on fixed-time-step modeling, which struggles to accommodate flight actions of varying durations and often leads to temporal mismatches between task planning and physical execution. To address this limitation, we propose an Adaptive Hierarchical Semi-Markov Decision Process (AH-SMDP) framework. This architecture decouples task allocation from execution by modeling variable-length actions via an SMDP. An event-driven synchronization mechanism is introduced to align the swarm’s decision-making rhythm with actual task completion times. Additionally, a state-aware reward formulation and a dynamic action space pruning strategy are designed to help UAVs balance energy efficiency with deadline compliance. Simulation results in multi-constraint environments demonstrate that the AH-SMDP framework effectively improves scheduling performance compared to standard MAPPO and PPO algorithms. Under the evaluated experimental settings, the proposed method yields improvements of approximately 30% in average task completion rate, 40% in energy reduction, and 60% in convergence stability. Ablation studies further suggest that this integrated framework offers a viable and effective approach for multi-UAV scheduling.

Förderung

  • Key Research and Development Program of Henan Province

Zitieren

APA

Wang, F., Ding, B., Tian, F., Guo, Z., & Ma, W. (2026). An Adaptive Scheduling Algorithm Integrating Hierarchical Reinforcement Learning and Semi-Markov Decision Processes. Applied Sciences, 16(13), 6570. https://doi.org/10.3390/app16136570

Vancouver

Wang F, Ding B, Tian F, Guo Z, Ma W. An Adaptive Scheduling Algorithm Integrating Hierarchical Reinforcement Learning and Semi-Markov Decision Processes. Applied Sciences. 2026;16(13):6570. doi:10.3390/app16136570

BibTeX
@article{Wang2026,
  author = {Wang, Feng and Ding, Bingwei and Tian, Fangchao and Guo, Zhaohua and Ma, Wenshuo},
  title = {An Adaptive Scheduling Algorithm Integrating Hierarchical Reinforcement Learning and Semi-Markov Decision Processes},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {13},
  pages = {6570},
  doi = {10.3390/app16136570}
}
Kostenlos starten →