EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A Fine-Tuned BERT-Based Model for Individual Log Anomaly Detection in Operational Monitoring at Paranal Observatory

Andrés H. Catalán, Rodrigo A. Carrasco, Gonzalo A. Ruz, Juan P. Gil

IEEE Access · 2025 · 13 · 117464-117478

DOI: 10.1109/access.2025.3586586 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Andrés H. Catalán und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Agencia Nacional de Investigaci?n y Desarrollo, Centro de Modelamiento Matem?tico.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In operational environments such as astronomical observatories, continuous monitoring of system logs is critical yet challenging due to the vast volume of data generated. Manual inspection of these logs is impractical, needing automated methods capable of accurate and scalable anomaly detection. This paper proposes a novel sentiment-aware anomaly detection framework, leveraging Bidirectional Encoder Representations from Transformers with In-Task Pre-Training and Fine-Tuning (BERT-ITPT-FiT), to classify textual logs based on their inherent sentiment polarity. Specifically tailored for the Paranal Observatory, our approach incorporates a computationally efficient, character-based preprocessing strategy that retains essential semantic elements, such as acronyms and technical terms, thereby eliminating the need for traditional parsing. This method efficiently processes a substantial dataset comprising 7,359,506 log entries from three VLTI instruments in an average runtime of only 114.23 seconds. Extensive experiments utilizing real operational data demonstrate that our architecture achieves an effective throughput of approximately 3,958 logs per second during the combined embedding generation and model training phases while consistently delivering an excellent classification performance. Besides, it significantly outperforms existing deep learning methods combined with conventional embeddings in both in- and cross-instrument scenarios, achieving F1-Scores exceeding 99.99% and 99.96%, respectively. This work emphasizes a critical balance between computational efficiency and classification performance, providing a robust and scalable solution for anomaly detection in high-stakes observatory operations.

Förderung

  • Agencia Nacional de Investigaci?n y Desarrollo
  • Centro de Modelamiento Matem?tico

Zitieren

APA

Catalán, A. H., Carrasco, R. A., Ruz, G. A., & Gil, J. P. (2025). A Fine-Tuned BERT-Based Model for Individual Log Anomaly Detection in Operational Monitoring at Paranal Observatory. IEEE Access, 13, 117464-117478. https://doi.org/10.1109/access.2025.3586586

Vancouver

Catalán AH, Carrasco RA, Ruz GA, Gil JP. A Fine-Tuned BERT-Based Model for Individual Log Anomaly Detection in Operational Monitoring at Paranal Observatory. IEEE Access. 2025;13:117464-117478. doi:10.1109/access.2025.3586586

BibTeX
@article{Cataln2025,
  author = {Catalán, Andrés H. and Carrasco, Rodrigo A. and Ruz, Gonzalo A. and Gil, Juan P.},
  title = {A Fine-Tuned BERT-Based Model for Individual Log Anomaly Detection in Operational Monitoring at Paranal Observatory},
  journal = {IEEE Access},
  year = {2025},
  volume = {13},
  pages = {117464--117478},
  doi = {10.1109/access.2025.3586586}
}
Kostenlos starten →