Temporal Decay Loss for Adaptive Log Anomaly Detection in Cloud Environments
Sensors · 22.04.2025 · 25 (9) · 2649
DOI: 10.3390/s25092649 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 22.04.2025. Verfasst von Lelisa Adeba Jilcha und 2 weiteren Autor:innen. Beteiligte Einrichtung: ISAA Laboratory, Department of AI Convergence Network, Ajou University, Suwon 16499, Republic of Korea. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT), and Institute of Information & Communications Technology Planning & Ev…, the National Research Foundation of Korea (NRF) grant, the Institute of Information & Communications Technology Planning & Evaluation (IITP) grant.
Abstract (Originalsprache)
Log anomaly detection in cloud computing environments is essential for maintaining system reliability and security. While sequence modeling architectures such as LSTMs and Transformers have been widely employed to capture temporal dependencies in log messages, their effectiveness deteriorates in zero-shot transfer scenarios due to distributional shifts in log structures, terminology, and event frequencies, as well as minimal token overlap across datasets. To address these challenges, we propose an effective detection approach integrating a domain-specific pre-trained language model (PLM) fine-tuned on cybersecurity-adjacent data with a novel loss function, Loss with Decaying Factor (LDF). LDF introduces an exponential time decay mechanism into the training objective, ensuring a dynamic balance between historical context and real-time relevance. Unlike traditional sequence models that often overemphasize outdated information and impose high computational overhead, LDF constrains the training process by dynamically weighing log messages based on their temporal proximity, thereby aligning with the rapidly evolving nature of cloud computing environments. Additionally, the domain-specific PLM mitigates semantic discrepancies by improving the representation of log data across heterogeneous datasets. Extensive empirical evaluations on two supercomputing log datasets demonstrate that this approach substantially enhances cross-dataset anomaly detection performance. The main contributions of this study include: (1) the introduction of a Loss with Decaying Factor (LDF) to dynamically balance historical context with real-time relevance; and (2) the integration of a domain-specific PLM for enhancing generalization in zero-shot log anomaly detection across heterogeneous cloud environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- ISAA Laboratory, Department of AI Convergence Network, Ajou University, Suwon 16499, Republic of Korea.
- ISAA Laboratory, Institute for Computing and Informatics Research, Ajou University, Suwon 16499, Republic of Korea.
- Department of Cyber Security, Ajou University, Suwon 16499, Republic of Korea.
ORCID-Profile: Lelisa Adeba Jilcha, Deuk-Hun Kim, Jin Kwak
Förderung
- National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT), and Institute of Information & Communications Technology Planning & Ev…
- the National Research Foundation of Korea (NRF) grant
- the Institute of Information & Communications Technology Planning & Evaluation (IITP) grant
Zitieren
APA
Jilcha, L. A., Kim, D. H., & Kwak, J. (2025). Temporal Decay Loss for Adaptive Log Anomaly Detection in Cloud Environments. Sensors, 25(9), 2649. https://doi.org/10.3390/s25092649
Vancouver
Jilcha LA, Kim DH, Kwak J. Temporal Decay Loss for Adaptive Log Anomaly Detection in Cloud Environments. Sensors. 2025;25(9):2649. doi:10.3390/s25092649
BibTeX
@article{Jilcha2025,
author = {Jilcha, Lelisa Adeba and Kim, Deuk-Hun and Kwak, Jin},
title = {Temporal Decay Loss for Adaptive Log Anomaly Detection in Cloud Environments},
journal = {Sensors},
year = {2025},
volume = {25},
number = {9},
pages = {2649},
doi = {10.3390/s25092649}
}
EUVIMED