Dual-Teacher Guided Denoising Distillation for Anomaly Detection
IEEE Access · 2025 · 13 · 174910-174921
DOI: 10.1109/access.2025.3616789 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Ning Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Development Fund of Macao.
Abstract (Originalsprache)
Recently, knowledge distillation-based approaches have demonstrated efficacy in unsupervised anomaly detection. These methods typically compute pointwise feature discrepancies between teacher and student (T–S) to localize anomalies. However, this paradigm suffers from two issues that degrade performance: 1) some normal regions exhibit large feature differences between T-S networks (leading to false detections), while 2) certain anomalous regions produce small differences (causing missed detections). To address this, we propose a Dual-Teacher Guided Denoising (DTGD) distillation framework that reformulates anomaly detection as a noise-removal task, where anomalies are treated as noise. Specifically, the DTGD framework includes a normal teacher, an anomaly teacher, and a denoising encoder-decoder student. The normal teacher encodes pristine normal data, and the anomaly teacher captures potential anomaly features from synthetic anomalies, guiding the student network to retain normal features and expel noise. After each encoder block of the student, our teacher-guided noise removal (TNR) module injects knowledge from the anomaly teacher, explicitly teaching the student which features to preserve. Furthermore, consistency loss and dissimilarity loss functions enforce consistency with the normal teacher in both encoder/decoder outputs and increase dissimilarity of anomaly-related features from the anomaly teacher via pixel-wise supervision. Experiments on anomaly detection datasets demonstrate that DTGD achieves advanced localization accuracy and produces sharper anomaly maps, reducing both false positives and false negatives.
Förderung
- Science and Technology Development Fund of Macao
Zitieren
APA
Li, N., Liu, A., Jiang, C., Tang, S., Li, Y., & Liang, Y. (2025). Dual-Teacher Guided Denoising Distillation for Anomaly Detection. IEEE Access, 13, 174910-174921. https://doi.org/10.1109/access.2025.3616789
Vancouver
Li N, Liu A, Jiang C, Tang S, Li Y, Liang Y. Dual-Teacher Guided Denoising Distillation for Anomaly Detection. IEEE Access. 2025;13:174910-174921. doi:10.1109/access.2025.3616789
BibTeX
@article{Li2025,
author = {Li, Ning and Liu, Ajian and Jiang, Chaohao and Tang, Suigu and Li, Yongze and Liang, Yanyan},
title = {Dual-Teacher Guided Denoising Distillation for Anomaly Detection},
journal = {IEEE Access},
year = {2025},
volume = {13},
pages = {174910--174921},
doi = {10.1109/access.2025.3616789}
}
EUVIMED