LogGraph: Log Event Graph Learning Aided Robust Fine-Grained Anomaly Diagnosis
IEEE Transactions on Dependable and Secure Computing · 2024-07 · 21 (4) · 1876-1889
DOI: 10.1109/tdsc.2023.3293111 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Dependable and Secure Computing, 2024-07. Verfasst von Jiangming Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref). Gefördert von: Key Science and Technology Project of Anhui, National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Anomaly diagnosis relying on system logs to record runtime events is essential for improving the service quality of distributed systems and reducing economic losses. However, most existing log-based anomaly detection approaches depend on the assumption of the fixed quantitative or sequential patterns of a normal log event sequence. This assumption is challenged in the context of practical distributed and parallel systems due to the dynamic pattern of the log sequence, log data noise as well as concurrency of multiple anomalies. Against these challenges, this paper aims to perform the robust log-based anomaly diagnosis by capturing the event context information of the log event graph, called LogGraph, instead of straightforwardly employing the fixed quantitative or sequential patterns of the log records, thus reducing its sensitivity to the log flaws and the concurrency of multiple anomalies. Specifically, in order to handle multiple anomalies concurrency, LogGraph invokes the association rule to decouple log sequences. It further reinterprets a log record sequence into a log event graph modeled by event semantic embedding and event adjacency matrix. An attention-based Gated Graph Neural Network (GGNN) model is developed to capture the semantic information of the log graph, which enables the fine-grained and robust anomaly identification of the proposed scheme. We use real log data sets collected from Hadoop systems and network switches to verify the effectiveness of the proposed LogGraph in log data scenarios that contain noise and multiple anomalies concurrency problems. The experimental results show that the proposed LogGraph achieves high performance and strong robustness in anomaly diagnosis.
Förderung
- Key Science and Technology Project of Anhui
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Li, J., He, H., Chen, S., Jin, D., & Yang, J. (2024). LogGraph: Log Event Graph Learning Aided Robust Fine-Grained Anomaly Diagnosis. IEEE Transactions on Dependable and Secure Computing, 21(4), 1876-1889. https://doi.org/10.1109/tdsc.2023.3293111
Vancouver
Li J, He H, Chen S, Jin D, Yang J. LogGraph: Log Event Graph Learning Aided Robust Fine-Grained Anomaly Diagnosis. IEEE Transactions on Dependable and Secure Computing. 2024;21(4):1876-1889. doi:10.1109/tdsc.2023.3293111
BibTeX
@article{Li2024,
author = {Li, Jiangming and He, Huasen and Chen, Shuangwu and Jin, Dong and Yang, Jian},
title = {LogGraph: Log Event Graph Learning Aided Robust Fine-Grained Anomaly Diagnosis},
journal = {IEEE Transactions on Dependable and Secure Computing},
year = {2024},
volume = {21},
number = {4},
pages = {1876--1889},
doi = {10.1109/tdsc.2023.3293111}
}
EUVIMED