EUVIMEDEUVIMED entdecken
Crossref

A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems

Zilong He, Pengfei Chen, Xiaoyun Li, Yongfeng Wang, Guangba Yu, Cailin Chen, Xinrui Li, Zibin Zheng

IEEE Transactions on Neural Networks and Learning Systems · 2023-04 · 34 (4) · 1705-1719

DOI: 10.1109/tnnls.2020.3027736 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Neural Networks and Learning Systems, 2023-04. Verfasst von Zilong He und 7 weiteren Autor:innen. Die Arbeit wurde bisher 127-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Research Development Plan of Key Areas in Guangdong Province, Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Anomaly detection is a critical task for maintaining the performance of a cloud system. Using data-driven methods to address this issue is the mainstream in recent years. However, due to the lack of labeled data for training in practice, it is necessary to enable an anomaly detection model trained on contaminated data in an unsupervised way. Besides, with the increasing complexity of cloud systems, effectively organizing data collected from a wide range of components of a system and modeling spatiotemporal dependence among them become a challenge. In this article, we propose TopoMAD, a stochastic seq2seq model which can robustly model spatial and temporal dependence among contaminated data. We include system topological information to organize metrics from different components and apply sliding windows over metrics collected continuously to capture the temporal dependence. We extract spatial features with the help of graph neural networks and temporal features with long short-term memory networks. Moreover, we develop our model based on variational auto-encoder, enabling it to work well robustly even when trained on contaminated data. Our approach is validated on the run-time performance data collected from two representative cloud systems, namely, a big data batch processing system and a microservice-based transaction processing system. The experimental results show that TopoMAD outperforms some state-of-the-art methods on these two data sets.

Förderung

  • National Key Research and Development Program of China
  • Research Development Plan of Key Areas in Guangdong Province
  • Natural Science Foundation of China
  • Basic and Applied Basic Research of Guangzhou
  • Natural Science Foundation of Guangdong Province

Zitieren

APA

He, Z., Chen, P., Li, X., Wang, Y., Yu, G., Chen, C., Li, X., & Zheng, Z. (2023). A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. IEEE Transactions on Neural Networks and Learning Systems, 34(4), 1705-1719. https://doi.org/10.1109/tnnls.2020.3027736

Vancouver

He Z, Chen P, Li X, Wang Y, Yu G, Chen C, et al. A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. IEEE Transactions on Neural Networks and Learning Systems. 2023;34(4):1705-1719. doi:10.1109/tnnls.2020.3027736

BibTeX
@article{He2023,
  author = {He, Zilong and Chen, Pengfei and Li, Xiaoyun and Wang, Yongfeng and Yu, Guangba and Chen, Cailin and Li, Xinrui and Zheng, Zibin},
  title = {A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2023},
  volume = {34},
  number = {4},
  pages = {1705--1719},
  doi = {10.1109/tnnls.2020.3027736}
}
Kostenlos starten →