Cost-Aware LLM-Style Routing for AIOps Log Analysis: Log Parsing, Anomaly Detection, Fault Diagnosis, and Incident Summarization on LogEval Task Files
Journal of Technology Informatics and Engineering · 22.06.2026 · 5 (2) · 91-103
DOI: 10.51903/jtie.v5i2.538 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Technology Informatics and Engineering, online erschienen am 22.06.2026. Verfasst von Chenyu Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
This study investigates a local and cost-aware routing framework for AIOps log analysis using the LogEval benchmark. The evaluation covers four tasks: log parsing, anomaly detection, fault diagnosis, and incident summarization. Instead of relying on external large language model APIs, the experiment implements deterministic local policies that simulate zero-shot and few-shot LLM-style inference under controlled token-cost and latency assumptions. Six approaches were compared: regex normalization, TF-IDF with machine learning, a local character-based classifier, zero-shot policy, few-shot retrieval policy, and a routing cascade. At a risk threshold of 0.20, the router directed only 12.9% of queries to the few-shot retrieval policy while achieving parsing accuracy of 0.991, anomaly F1-score of 1.000, diagnosis accuracy of 1.000, ROUGE-L of 0.743, and BLEU-1 of 0.814. The routing strategy reduced simulated token cost by 80.1% compared with always using few-shot retrieval. Additional unseen-template evaluation revealed limited generalization for closed-label classifiers and retrieval methods when encountering unseen patterns. The findings indicate that routing can effectively reduce AIOps inference costs, while further validation with real LLMs and stronger generalization testing are required before production deployment.
Zitieren
APA
Li, C., Liu, G., & Zhao, Z. (2026). Cost-Aware LLM-Style Routing for AIOps Log Analysis: Log Parsing, Anomaly Detection, Fault Diagnosis, and Incident Summarization on LogEval Task Files. Journal of Technology Informatics and Engineering, 5(2), 91-103. https://doi.org/10.51903/jtie.v5i2.538
Vancouver
Li C, Liu G, Zhao Z. Cost-Aware LLM-Style Routing for AIOps Log Analysis: Log Parsing, Anomaly Detection, Fault Diagnosis, and Incident Summarization on LogEval Task Files. Journal of Technology Informatics and Engineering. 2026;5(2):91-103. doi:10.51903/jtie.v5i2.538
BibTeX
@article{Li2026,
author = {Li, Chenyu and Liu, Ge and Zhao, Zoe},
title = {Cost-Aware LLM-Style Routing for AIOps Log Analysis: Log Parsing, Anomaly Detection, Fault Diagnosis, and Incident Summarization on LogEval Task Files},
journal = {Journal of Technology Informatics and Engineering},
year = {2026},
volume = {5},
number = {2},
pages = {91--103},
doi = {10.51903/jtie.v5i2.538}
}
EUVIMED