Assessing the Performance of Transformer for Time Series Anomaly Detection
PHM Society Asia-Pacific Conference · 04.09.2023 · 4 (1)
DOI: 10.36001/phmap.2023.v4i1.3773 ↗Kurz gefasst
Fachartikel in der Zeitschrift PHM Society Asia-Pacific Conference, online erschienen am 04.09.2023. Verfasst von Takuto Nakashima und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 3.0).
Abstract (Originalsprache)
This study aims to assess the effectiveness of the Transformer-based reconstruction approach for detecting anomalies in time series data. The reconstruction error-based anomaly detection method was applied to both multivariate time series from NASA SMAP/MSL and univariate time series from UCR. Four deep learning models, including Transformer, Dilated CNN, LSTM, and MLP, were compared in terms of their ability to reconstruct input data. Dilated CNN outperformed the other models in almost all experimental results, achieving a 25% higher score than Transformer on the UCR dataset when trained with random masking, and a 60% higher score when trained with middle masking. These results suggest that the Transformer did not perform as well as expected for anomaly detection based on time series reconstruction errors, and its inferiority to Dilated CNN may be attributed to the characteristics of the time series and the limited training data. Future research should focus on developing Transformer models that can better capture the properties of time series data and investigate the relationship between the model’s performance, data volume, and model complexity.
Zitieren
APA
Nakashima, T., & Yairi, T. (2023). Assessing the Performance of Transformer for Time Series Anomaly Detection. PHM Society Asia-Pacific Conference, 4(1). https://doi.org/10.36001/phmap.2023.v4i1.3773
Vancouver
Nakashima T, Yairi T. Assessing the Performance of Transformer for Time Series Anomaly Detection. PHM Society Asia-Pacific Conference. 2023;4(1). doi:10.36001/phmap.2023.v4i1.3773
BibTeX
@article{Nakashima2023,
author = {Nakashima, Takuto and Yairi, Takehisa},
title = {Assessing the Performance of Transformer for Time Series Anomaly Detection},
journal = {PHM Society Asia-Pacific Conference},
year = {2023},
volume = {4},
number = {1},
doi = {10.36001/phmap.2023.v4i1.3773}
}
EUVIMED