Metaheuristic-Based Hyperparameter Optimization Analysis of Deep Neural Network for Cross-Project Defect Prediction in Mobile Applications
Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics · 17.05.2026 · 8 (2) · 248-261
DOI: 10.35882/ijeeemi.v8i2.340 ↗Kurz gefasst
Fachartikel in der Zeitschrift Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics, online erschienen am 17.05.2026. Verfasst von Maulana Abdul Rahman und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Software Defect Prediction (SDP) plays a strategic role in identifying software defects during the early stages of development, thereby enabling more efficient allocation of testing resources, particularly in the rapidly evolving mobile application domain characterized by fast release cycles. The commonly used Within-Project Defect Prediction (WPDP) approach is often constrained by the limited availability of historical data, especially in projects at early stages of development. As an alternative, Cross-Project Defect Prediction (CPDP) leverages historical data from other projects as training sources. Moreover, the performance of the Deep Neural Network (DNN) used in SDP is highly dependent on accurate hyperparameter configurations, where manual tuning requires substantial time and computational resources without guaranteeing optimal results. To address this issue, this study analyzes and compares the effectiveness of three metaheuristic algorithms, namely Particle Swarm Optimization (PSO), Genetic Algorithm (GA), and Grey Wolf Optimizer (GWO), in optimizing DNN hyperparameters within a CPDP framework. This study utilizes 14 open-source Android mobile application projects and employs the Leave-One-Out Cross-Validation technique. The performance of each combination is evaluated using ROC-AUC as the primary metric. The Wilcoxon Signed-Rank Test with a Bonferroni correction is used to assess the statistical significance of the observed performance differences. The experimental results demonstrate that GWO-DNN achieves the best performance, with an average ROC-AUC of 0.721, and is the only combination that remains statistically significant after Bonferroni correction, with a small effect size based on Cliff’s delta. Overall, the findings of this study indicate that metaheuristic-based hyperparameter tuning is a sufficiently effective approach for improving the capability of DNN in cross-project software defect prediction within the mobile application domain, although the observed improvements remain moderate.
Zitieren
APA
Rahman, M. A., Herteno, R., Nugroho, R. A., Abadi, F., & Saputro, S. W. (2026). Metaheuristic-Based Hyperparameter Optimization Analysis of Deep Neural Network for Cross-Project Defect Prediction in Mobile Applications. Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics, 8(2), 248-261. https://doi.org/10.35882/ijeeemi.v8i2.340
Vancouver
Rahman MA, Herteno R, Nugroho RA, Abadi F, Saputro SW. Metaheuristic-Based Hyperparameter Optimization Analysis of Deep Neural Network for Cross-Project Defect Prediction in Mobile Applications. Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics. 2026;8(2):248-261. doi:10.35882/ijeeemi.v8i2.340
BibTeX
@article{Rahman2026,
author = {Rahman, Maulana Abdul and Herteno, Rudy and Nugroho, Radityo Adi and Abadi, Friska and Saputro, Setyo Wahyu},
title = {Metaheuristic-Based Hyperparameter Optimization Analysis of Deep Neural Network for Cross-Project Defect Prediction in Mobile Applications},
journal = {Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics},
year = {2026},
volume = {8},
number = {2},
pages = {248--261},
doi = {10.35882/ijeeemi.v8i2.340}
}
EUVIMED