HEEEM: A Hybrid Ensemble Effort Estimation Model for Agile and DevOps Development
IEEE Access · 2026 · 14 · 79253-79283
DOI: 10.1109/access.2026.3693745 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Sadaquat Ali Ruk und 5 weiteren Autor:innen. Die Arbeit nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: United Arab Emirates University (UAEU) under the Start-Up Research.
Abstract (Originalsprache)
Accurate effort estimation in Agile and DevOps software projects remains a persistent challenge, as traditional models fail to account for the iterative, continuous delivery nature of modern development environments. Existing single-technique estimation approaches, whether algorithmic, expert-based, or machine learning-based, each capture only a partial view of project complexity, leading to systematic underestimation in Agile DevOps contexts. This study proposes the Hybrid Ensemble Effort Estimation Model (HEEEM), which integrates Use Case Points (UCP) as an algorithmic anchor, the Delphi method as an expert-based judgment layer, and Extra Trees as a data-driven machine learning component. A two-stage framework is adopted: candidate machine learning models are first benchmarked across eight public datasets, spanning 945 projects, providing external validation of the data-driven component and confirming Extra Trees as the most consistent performer (MAE: 0.288, RMSE: 0.398, R2: 0.815), before being embedded into the hybrid ensemble. Empirical evaluation is conducted through case studies on five industrial Agile DevOps projects using standard performance metrics including Mean Absolute Error (MAE), Root Mean Square Error (RMSE), Mean Magnitude of Relative Error (MMRE) and R2.The findings show that HEEEM significantly improved effort estimation accuracy, achieving an in-sample MAE of 21.60, RMSE of 25.32, MMRE of 0.0053, and an in-sample R2 of 0.9983, representing reductions of 69% in MAE, 71.9% in RMSE, and 72% in MMRE compared to individual baseline methods;under Leave-One-Out Cross-Validation, the corresponding out-of-sample metrics are MAE = 72.88, RMSE = 100.42, MMRE = 0.0192, and $R^{2}$ = 0.9731, representing 45–52% reductions in MAE compared to the algorithmic and expert-based individual baselines. Statistical validation through the Friedman test confirmed these improvements are statistically significant ( $p = 0.0136$ ). The proposed model offers actionable guidance for project managers and development teams regarding sprint planning, resource allocation, and risk management, and is particularly suited for continuous delivery environments where estimates require regular updating.
Förderung
- United Arab Emirates University (UAEU) under the Start-Up Research
Zitieren
APA
Ruk, S. A., Mahmood, Y., Azmi, A., Azmi, N. F. M., Bouktif, S., & Gul, S. (2026). HEEEM: A Hybrid Ensemble Effort Estimation Model for Agile and DevOps Development. IEEE Access, 14, 79253-79283. https://doi.org/10.1109/access.2026.3693745
Vancouver
Ruk SA, Mahmood Y, Azmi A, Azmi NFM, Bouktif S, Gul S. HEEEM: A Hybrid Ensemble Effort Estimation Model for Agile and DevOps Development. IEEE Access. 2026;14:79253-79283. doi:10.1109/access.2026.3693745
BibTeX
@article{Ruk2026,
author = {Ruk, Sadaquat Ali and Mahmood, Yasir and Azmi, Azri and Azmi, Nurulhuda Firdaus Mohd and Bouktif, Salah and Gul, Sehar},
title = {HEEEM: A Hybrid Ensemble Effort Estimation Model for Agile and DevOps Development},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {79253--79283},
doi = {10.1109/access.2026.3693745}
}
EUVIMED