Self-Supervised Autoencoders for Visual Anomaly Detection
Mathematics · 18.12.2024 · 12 (24) · 3988
DOI: 10.3390/math12243988 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 18.12.2024. Verfasst von Alexander Bauer und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 111 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: German Federal Ministry of Education and Research (BMBF) for BIFOLD, Institute of Information & communications Technology Planning & Evaluation (IITP) grants funded by the Korea government (MSIT), Artificial Intelligence Graduate School Program, Korea University.
Abstract (Originalsprache)
We focus on detecting anomalies in images where the data distribution is supported by a lower-dimensional embedded manifold. Approaches based on autoencoders have aimed to control their capacity either by reducing the size of the bottleneck layer or by imposing sparsity constraints on their activations. However, none of these techniques explicitly penalize the reconstruction of anomalous regions, often resulting in poor detection. We tackle this problem by adapting a self-supervised learning regime that essentially implements a denoising autoencoder with structured non-i.i.d. noise. Informally, our objective is to regularize the model to produce locally consistent reconstructions while replacing irregularities by acting as a filter that removes anomalous patterns. Formally, we show that the resulting model resembles a nonlinear orthogonal projection of partially corrupted images onto the submanifold of uncorrupted examples. Furthermore, we identify the orthogonal projection as an optimal solution for a specific regularized autoencoder related to contractive and denoising variants. In addition, orthogonal projection provides a conservation effect by largely preserving the original content of its arguments. Together, these properties facilitate an accurate detection and localization of anomalous regions by means of the reconstruction error. We support our theoretical analysis by achieving state-of-the-art results (image/pixel-level AUROC of 99.8/99.2%) on the MVTec AD dataset—a challenging benchmark for anomaly detection in the manufacturing domain.
Förderung
- German Federal Ministry of Education and Research (BMBF) for BIFOLD
- Institute of Information & communications Technology Planning & Evaluation (IITP) grants funded by the Korea government (MSIT)
- Artificial Intelligence Graduate School Program, Korea University
- AI Research Hub Project
- German Federal Ministry for Education and Research (BMBF)
Zitieren
APA
Bauer, A., Nakajima, S., & Müller, K. (2024). Self-Supervised Autoencoders for Visual Anomaly Detection. Mathematics, 12(24), 3988. https://doi.org/10.3390/math12243988
Vancouver
Bauer A, Nakajima S, Müller K. Self-Supervised Autoencoders for Visual Anomaly Detection. Mathematics. 2024;12(24):3988. doi:10.3390/math12243988
BibTeX
@article{Bauer2024,
author = {Bauer, Alexander and Nakajima, Shinichi and Müller, Klaus-Robert},
title = {Self-Supervised Autoencoders for Visual Anomaly Detection},
journal = {Mathematics},
year = {2024},
volume = {12},
number = {24},
pages = {3988},
doi = {10.3390/math12243988}
}
EUVIMED