EUVIMEDEUVIMED entdecken
Crossref

Janus: A Dual-Mask Attention Transformer for Log-based Anomaly Detection in Cellular Networks

Umakant Kulkarni, Sonia Fahmy

Proceedings of the ACM on Measurement and Analysis of Computing Systems · 26.03.2026 · 10 (1) · 1-36

DOI: 10.1145/3788096 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Measurement and Analysis of Computing Systems, online erschienen am 26.03.2026. Verfasst von Umakant Kulkarni und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern cellular networks, such as 5G, generate complex operational logs that challenge traditional anomaly detection techniques. Existing deep learning approaches, including standard transformer models, treat logs as monolithic text streams and lack the specialization to reason about procedural correctness and semantic integrity, a key requirement for telecommunications software. We tackle this problem in our system Janus, a log-based anomaly detection system featuring a novel Single-Pass Dual-Mask (SPDM) attention mechanism. Janus introduces a domain-specific inductive bias by partitioning attention heads into two groups. Global heads learn the valid temporal grammar of 5G procedures using a causal mask, and local heads perform fine-grained audits on the consistency of critical data fields using a tag-based semantic mask. A multi-stage curriculum learning framework progressively adapts Janus from domain pre-training to discriminative fine-tuning and learns to detect complex, real-world software failures. Experimental evaluation with several 5G log datasets demonstrates that Janus consistently outperforms prior systems, achieving on average a 3× performance improvement over a DNN-based baseline and an 80% gain over a transformer-based system.

Förderung

  • National Science Foundation

Zitieren

APA

Kulkarni, U., & Fahmy, S. (2026). Janus: A Dual-Mask Attention Transformer for Log-based Anomaly Detection in Cellular Networks. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 10(1), 1-36. https://doi.org/10.1145/3788096

Vancouver

Kulkarni U, Fahmy S. Janus: A Dual-Mask Attention Transformer for Log-based Anomaly Detection in Cellular Networks. Proceedings of the ACM on Measurement and Analysis of Computing Systems. 2026;10(1):1-36. doi:10.1145/3788096

BibTeX
@article{Kulkarni2026,
  author = {Kulkarni, Umakant and Fahmy, Sonia},
  title = {Janus: A Dual-Mask Attention Transformer for Log-based Anomaly Detection in Cellular Networks},
  journal = {Proceedings of the ACM on Measurement and Analysis of Computing Systems},
  year = {2026},
  volume = {10},
  number = {1},
  pages = {1--36},
  doi = {10.1145/3788096}
}
Kostenlos starten →