Optimizing priority scheduling in hadoop for resource utilization using quantum particle swarm optimization technique
International Journal of Advances in Intelligent Informatics · 31.08.2026 · 12 (3) · 726
DOI: 10.26555/ijain.v12i3.2302 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Advances in Intelligent Informatics, online erschienen am 31.08.2026. Verfasst von Bhavana Potli und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Efficient resource scheduling in Hadoop remains a challenging problem due to the presence of diverse workloads and varying priority requirements in cluster environments. Traditional YARN schedulers such as FIFO, Fair, and Capacity often struggle to simultaneously balance data locality, responsiveness, fairness, and priority handling, which can lead to increased waiting times and inefficient resource utilization. To address these limitations, this study proposes a Quantum-Inspired Priority Scheduler (QIPS) that integrates a Quantum-behaved Particle Swarm Optimization (QPSO) mechanism within the YARN Resource Manager to enhance job–node assignment decisions. The proposed scheduler considers multiple performance criteria, including latency, resource utilization, data locality, and priority awareness, enabling more adaptive and balanced scheduling under dynamic workload conditions. A hybrid implementation combining Java and Python is developed, where YARN handles job execution while the QPSO module performs optimization. Experimental evaluation on a multi-node Hadoop 3.3.4 cluster using synthetic workloads shows that QIPS effectively reduces deadline penalties and improves data locality, while maintaining competitive performance across other scheduling metrics. These findings indicate that quantum-inspired optimization offers a promising direction for achieving efficient and balanced resource scheduling in distributed systems.
Zitieren
APA
Potli, B., & Revanna, S. D. (2026). Optimizing priority scheduling in hadoop for resource utilization using quantum particle swarm optimization technique. International Journal of Advances in Intelligent Informatics, 12(3), 726. https://doi.org/10.26555/ijain.v12i3.2302
Vancouver
Potli B, Revanna SD. Optimizing priority scheduling in hadoop for resource utilization using quantum particle swarm optimization technique. International Journal of Advances in Intelligent Informatics. 2026;12(3):726. doi:10.26555/ijain.v12i3.2302
BibTeX
@article{Potli2026,
author = {Potli, Bhavana and Revanna, Shashikumar Dandinashivara},
title = {Optimizing priority scheduling in hadoop for resource utilization using quantum particle swarm optimization technique},
journal = {International Journal of Advances in Intelligent Informatics},
year = {2026},
volume = {12},
number = {3},
pages = {726},
doi = {10.26555/ijain.v12i3.2302}
}
EUVIMED