A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems
IEEE Transactions on Neural Networks and Learning Systems · 2023-04 · 34 (4) · 1705-1719
DOI: 10.1109/tnnls.2020.3027736 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Neural Networks and Learning Systems, 2023-04. Verfasst von Zilong He und 7 weiteren Autor:innen. Die Arbeit wurde bisher 127-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Research Development Plan of Key Areas in Guangdong Province, Natural Science Foundation of China.
Abstract (Originalsprache)
Anomaly detection is a critical task for maintaining the performance of a cloud system. Using data-driven methods to address this issue is the mainstream in recent years. However, due to the lack of labeled data for training in practice, it is necessary to enable an anomaly detection model trained on contaminated data in an unsupervised way. Besides, with the increasing complexity of cloud systems, effectively organizing data collected from a wide range of components of a system and modeling spatiotemporal dependence among them become a challenge. In this article, we propose TopoMAD, a stochastic seq2seq model which can robustly model spatial and temporal dependence among contaminated data. We include system topological information to organize metrics from different components and apply sliding windows over metrics collected continuously to capture the temporal dependence. We extract spatial features with the help of graph neural networks and temporal features with long short-term memory networks. Moreover, we develop our model based on variational auto-encoder, enabling it to work well robustly even when trained on contaminated data. Our approach is validated on the run-time performance data collected from two representative cloud systems, namely, a big data batch processing system and a microservice-based transaction processing system. The experimental results show that TopoMAD outperforms some state-of-the-art methods on these two data sets.
Förderung
- National Key Research and Development Program of China
- Research Development Plan of Key Areas in Guangdong Province
- Natural Science Foundation of China
- Basic and Applied Basic Research of Guangzhou
- Natural Science Foundation of Guangdong Province
Zitieren
APA
He, Z., Chen, P., Li, X., Wang, Y., Yu, G., Chen, C., Li, X., & Zheng, Z. (2023). A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. IEEE Transactions on Neural Networks and Learning Systems, 34(4), 1705-1719. https://doi.org/10.1109/tnnls.2020.3027736
Vancouver
He Z, Chen P, Li X, Wang Y, Yu G, Chen C, et al. A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. IEEE Transactions on Neural Networks and Learning Systems. 2023;34(4):1705-1719. doi:10.1109/tnnls.2020.3027736
BibTeX
@article{He2023,
author = {He, Zilong and Chen, Pengfei and Li, Xiaoyun and Wang, Yongfeng and Yu, Guangba and Chen, Cailin and Li, Xinrui and Zheng, Zibin},
title = {A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems},
journal = {IEEE Transactions on Neural Networks and Learning Systems},
year = {2023},
volume = {34},
number = {4},
pages = {1705--1719},
doi = {10.1109/tnnls.2020.3027736}
}
EUVIMED