EUVIMEDEUVIMED entdecken
Crossref

Brain: Log Parsing With Bidirectional Parallel Tree

Siyu Yu, Pinjia He, Ningjiang Chen, Yifan Wu

IEEE Transactions on Services Computing · 2023-09 · 16 (5) · 3224-3237

DOI: 10.1109/tsc.2023.3270566 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Services Computing, 2023-09. Verfasst von Siyu Yu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 101-mal zitiert (Crossref) und nennt 31 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated log analysis can facilitate failure diagnosis for developers and operators using a large volume of logs. Log parsing is a prerequisite step for automated log analysis, which parses semi-structured logs into structured logs. However, existing parsers are difficult to apply to software-intensive systems, due to their unstable parsing accuracy on various software. Although neural network-based approaches are stable, their inefficiency makes it challenging to keep up with the speed of log production. In this work, we found that the longest common pattern among logs is likely to be part of the log template. Inspired by this key insight, we propose a new stable log parsing approach, called Brain, which creates initial groups according to the longest common pattern. Then a bidirectional tree is used to hierarchically complement the constant words to the longest common pattern to form the complete log template efficiently. Experimental results on 16 benchmark datasets show that our approach outperforms the state-of-the-art parsers on two widely-used parsing accuracy metrics, and it only takes around 46 seconds to process one million lines of logs.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Yu, S., He, P., Chen, N., & Wu, Y. (2023). Brain: Log Parsing With Bidirectional Parallel Tree. IEEE Transactions on Services Computing, 16(5), 3224-3237. https://doi.org/10.1109/tsc.2023.3270566

Vancouver

Yu S, He P, Chen N, Wu Y. Brain: Log Parsing With Bidirectional Parallel Tree. IEEE Transactions on Services Computing. 2023;16(5):3224-3237. doi:10.1109/tsc.2023.3270566

BibTeX
@article{Yu2023,
  author = {Yu, Siyu and He, Pinjia and Chen, Ningjiang and Wu, Yifan},
  title = {Brain: Log Parsing With Bidirectional Parallel Tree},
  journal = {IEEE Transactions on Services Computing},
  year = {2023},
  volume = {16},
  number = {5},
  pages = {3224--3237},
  doi = {10.1109/tsc.2023.3270566}
}
Kostenlos starten →