EUVIMEDEUVIMED entdecken
Crossref

Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models

Hema M S Hema M S, Aliasgar Abbas Ringnodwala Aliasgar Abbas Ringnodwala, Chatura J S Chatura J S, Chirag Ananda Kumar Chirag Ananda Kumar, Dhruv Mishra Dhruv Mishra

International Journal of Creative and Open Research in Engineering and Management · 02.05.2026 · 02 (05) · 1-6

DOI: 10.55041/ijcope.v2i4.995 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Creative and Open Research in Engineering and Management, online erschienen am 02.05.2026. Verfasst von Hema M S Hema M S und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper proposes a hybrid anomaly detection framework for Distributed File System (DFS) log analysis, combining statistical machine learning with deep learning sequence models. Rather than relying on a single classifier, the system integrates Random Forest, Linear Support Vector Machine (SVM), Bidirectional Long Short-Term Memory (BiLSTM), and DeepLog within a weighted soft-voting ensemble. Class imbalance is addressed through the Synthetic Minority Over-sampling Technique (SMOTE), applied to classical learners prior to training. Precision-Recall Area Under the Curve (PR-AUC) is adopted as the primary evaluation metric, given its suitability for imbalanced classification tasks. The dual-modality design captures both event-frequency patterns via Bag-of-Words representations and temporal ordering dependencies via sequential models. Experiments on the public HDFS LogHub dataset show the ensemble achieves a PR-AUC of 0.767 and perfect precision, while Random Forest attains the highest F1-score and a ROC-AUC of 0.953. The framework provides a reliable and interpretable approach to log-based anomaly detection in large-scale distributed systems. Keywords—System log file Analysis; Anomaly Detection; Hybrid Machine Learning; Deep Learning; Log-based Monitoring; Random Forest; BiLSTM(Ensemble); DeepLog(Ensemble); SMOTE (Class Imbalance); Precision-Recall AUC (PR-AUC).

Zitieren

APA

S, H. M. S. H. M., Ringnodwala, A. A. R. A. A., S, C. J. S. C. J., Kumar, C. A. K. C. A., & Mishra, D. M. D. (2026). Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models. International Journal of Creative and Open Research in Engineering and Management, 02(05), 1-6. https://doi.org/10.55041/ijcope.v2i4.995

Vancouver

S HMSHM, Ringnodwala AARAA, S CJSCJ, Kumar CAKCA, Mishra DMD. Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models. International Journal of Creative and Open Research in Engineering and Management. 2026;02(05):1-6. doi:10.55041/ijcope.v2i4.995

BibTeX
@article{S2026,
  author = {S, Hema M S Hema M and Ringnodwala, Aliasgar Abbas Ringnodwala Aliasgar Abbas and S, Chatura J S Chatura J and Kumar, Chirag Ananda Kumar Chirag Ananda and Mishra, Dhruv Mishra Dhruv},
  title = {Anomaly Detection in Distributed File System Logs Using Hybrid Machine Learning and Deep Learning Models},
  journal = {International Journal of Creative and Open Research in Engineering and Management},
  year = {2026},
  volume = {02},
  number = {05},
  pages = {1--6},
  doi = {10.55041/ijcope.v2i4.995}
}
Kostenlos starten →