Scalable Industrial Visual Anomaly Detection With Partial Semantics Aggregation Vision Transformer
IEEE Transactions on Instrumentation and Measurement · 2024 · 73 · 1-17
DOI: 10.1109/tim.2023.3343832 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Instrumentation and Measurement, 2024. Verfasst von Haiming Yao und 6 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
In recent years, the field of industrial visual anomaly detection (VAD) has attracted significant attention in the context of advanced smart manufacturing systems. However, several limitations remain unresolved in existing approaches. While these methods can achieve satisfactory performance when training separate models for different categories, their scalability and performance suffer when faced with the challenge of simultaneous training for multiple categories. Reconstruction-based methods generally suffer from the identical mapping problem. To address these limitations, this study introduces the partial semantic aggregation vision transformer (PSA-VT), a scalable framework for industrial visual anomaly detection (VAD) that enables simultaneous multicategory anomaly detection using a single model. Our proposed PSA-VT framework adopts a hybrid design strategy. First, a pretrained convolutional neural network (CNN) is employed to extract multiscale discriminative local representation. Subsequently, the PSA-VT is introduced to perform representation reconstruction through long-range global semantic aggregation. Finally, the anomalous properties can be estimated by evaluating the reconstruction error of the representations. We conducted extensive experiments using the Mvtec AD industrial anomaly detection dataset, as well as the semantic anomaly detection datasets. The experimental results demonstrate that our method achieves state-of-the-art (SOTA) performance by capturing high-level semantics. Notably, PSA-VT surpasses other methods for the one-model-15-category anomaly detection tasks on the Mvtec AD dataset. Furthermore, we applied incremental learning techniques to enable the rapid deployment of PSA-VT in a real industrial scenario.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Yao, H., Luo, W., Lou, J., Yu, W., Zhang, X., Qiang, Z., & Shi, H. (2024). Scalable Industrial Visual Anomaly Detection With Partial Semantics Aggregation Vision Transformer. IEEE Transactions on Instrumentation and Measurement, 73, 1-17. https://doi.org/10.1109/tim.2023.3343832
Vancouver
Yao H, Luo W, Lou J, Yu W, Zhang X, Qiang Z, et al. Scalable Industrial Visual Anomaly Detection With Partial Semantics Aggregation Vision Transformer. IEEE Transactions on Instrumentation and Measurement. 2024;73:1-17. doi:10.1109/tim.2023.3343832
BibTeX
@article{Yao2024,
author = {Yao, Haiming and Luo, Wei and Lou, Jianan and Yu, Wenyong and Zhang, Xiaotian and Qiang, Zhenfeng and Shi, Hui},
title = {Scalable Industrial Visual Anomaly Detection With Partial Semantics Aggregation Vision Transformer},
journal = {IEEE Transactions on Instrumentation and Measurement},
year = {2024},
volume = {73},
pages = {1--17},
doi = {10.1109/tim.2023.3343832}
}
EUVIMED