EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation

Zhongjiang Yu, Shaoping Yang, Zhongtai Li, Ligang Li, Hui Luo, Fan Yang

Frontiers in Physics · 22.04.2024 · 12

DOI: 10.3389/fphy.2024.1401857 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Physics, online erschienen am 22.04.2024. Verfasst von Zhongjiang Yu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Log anomaly detection is essential for monitoring and maintaining the normal operation of systems. With the rapid development and maturation of deep learning technologies, deep learning-based log anomaly detection has become a prominent research area. However, existing methods primarily concentrate on directly detecting log data in a single stage using specific anomaly information, such as log sequential information or log semantic information. This leads to a limited understanding of log data, resulting in low detection accuracy and poor model robustness.

Methods

To tackle this challenge, we propose LogMS, a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation. Before anomaly detection, the logs undergo parsing and vectorization to capture semantic information. Subsequently, we propose a multi-source information fusion-based long short-term memory (MSIF-LSTM) network for the initial stage of anomaly log detection. By fusing semantic information, sequential information, and quantitative information, MSIF-LSTM enhances the anomaly detection capability. Furthermore, we introduce a probability label estimation-based gate recurrent unit (PLE-GRU) network, which leverages easily obtainable normal log labels to construct pseudo-labeled data and train a GRU for further detection. PLE-GRU enhances the detection capability from the perspective of label information. To ensure the overall efficiency of the LogMS, the second-stage will only be activated when anomalies are not detected in the first stage. Results and Discussion: Experimental results demonstrate that LogMS outperforms baseline models across various log anomaly detection datasets, exhibiting superior performance in robustness testing.

Zitieren

APA

Yu, Z., Yang, S., Li, Z., Li, L., Luo, H., & Yang, F. (2024). LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation. Frontiers in Physics, 12. https://doi.org/10.3389/fphy.2024.1401857

Vancouver

Yu Z, Yang S, Li Z, Li L, Luo H, Yang F. LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation. Frontiers in Physics. 2024;12. doi:10.3389/fphy.2024.1401857

BibTeX
@article{Yu2024,
  author = {Yu, Zhongjiang and Yang, Shaoping and Li, Zhongtai and Li, Ligang and Luo, Hui and Yang, Fan},
  title = {LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation},
  journal = {Frontiers in Physics},
  year = {2024},
  volume = {12},
  doi = {10.3389/fphy.2024.1401857}
}
Kostenlos starten →