Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models
International Journal of Creative and Open Research in Engineering and Management · 02.05.2026 · 02 (05) · 1-6
DOI: 10.55041/ijcope.v2i4.995 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Creative and Open Research in Engineering and Management, online erschienen am 02.05.2026. Verfasst von Hema M S Hema M S und 4 weiteren Autor:innen.
Abstract (Originalsprache)
This paper proposes a hybrid anomaly detection framework for Distributed File System (DFS) log analysis, combining statistical machine learning with deep learning sequence models. Rather than relying on a single classifier, the system integrates Random Forest, Linear Support Vector Machine (SVM), Bidirectional Long Short-Term Memory (BiLSTM), and DeepLog within a weighted soft-voting ensemble. Class imbalance is addressed through the Synthetic Minority Over-sampling Technique (SMOTE), applied to classical learners prior to training. Precision-Recall Area Under the Curve (PR-AUC) is adopted as the primary evaluation metric, given its suitability for imbalanced classification tasks. The dual-modality design captures both event-frequency patterns via Bag-of-Words representations and temporal ordering dependencies via sequential models. Experiments on the public HDFS LogHub dataset show the ensemble achieves a PR-AUC of 0.767 and perfect precision, while Random Forest attains the highest F1-score and a ROC-AUC of 0.953. The framework provides a reliable and interpretable approach to log-based anomaly detection in large-scale distributed systems. Keywords—System log file Analysis; Anomaly Detection; Hybrid Machine Learning; Deep Learning; Log-based Monitoring; Random Forest; BiLSTM(Ensemble); DeepLog(Ensemble); SMOTE (Class Imbalance); Precision-Recall AUC (PR-AUC).
Zitieren
APA
S, H. M. S. H. M., Ringnodwala, A. A. R. A. A., S, C. J. S. C. J., Kumar, C. A. K. C. A., & Mishra, D. M. D. (2026). Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models. International Journal of Creative and Open Research in Engineering and Management, 02(05), 1-6. https://doi.org/10.55041/ijcope.v2i4.995
Vancouver
S HMSHM, Ringnodwala AARAA, S CJSCJ, Kumar CAKCA, Mishra DMD. Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models. International Journal of Creative and Open Research in Engineering and Management. 2026;02(05):1-6. doi:10.55041/ijcope.v2i4.995
BibTeX
@article{S2026,
author = {S, Hema M S Hema M and Ringnodwala, Aliasgar Abbas Ringnodwala Aliasgar Abbas and S, Chatura J S Chatura J and Kumar, Chirag Ananda Kumar Chirag Ananda and Mishra, Dhruv Mishra Dhruv},
title = {Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models},
journal = {International Journal of Creative and Open Research in Engineering and Management},
year = {2026},
volume = {02},
number = {05},
pages = {1--6},
doi = {10.55041/ijcope.v2i4.995}
}
EUVIMED