Conditional vector quantized variational autoencoders for machine sound anomaly detection under domain shift
The Journal of the Acoustical Society of America · 01.06.2026 · 159 (6) · 5221-5237
DOI: 10.1121/10.0044140 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, online erschienen am 09.06.2026. Verfasst von Shengbing Chen und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Artificial Intelligence and Big Data, HeFei University, HeFei 230601, China. Die Arbeit nennt 34 Literaturangaben. Gefördert von: European Union's Horizon Europe Research and Innovation Programme under agreement, Hefei Municipal Natural Science Foundation.
Abstract (Originalsprache)
In industrial production, monitoring abnormal machine sounds is crucial for early fault detection, reducing accidents, and improving efficiency. However, domain shift—caused by variations in operating states and environments—poses significant challenges to model generalization. To address this, this paper proposes an unsupervised anomaly detection method that integrates a Vector Quantized Conditional Variational Autoencoder (VQ-CVAE) with the autoregressive model PixelSNAIL. A lightweight audio–text contrastive pre-trained model extracts textual features describing equipment physical attributes (e.g., type, parameters, operating time) and employs them as conditional inputs to the VQ-CVAE, thereby constructing fused audio–text multimodal representations. Anomaly scoring is jointly performed in time–frequency and latent spaces. In the time–frequency space, the VQ-CVAE codebook mitigates excessive feature shifts, while an attention- and gate-enhanced residual module strengthens feature extraction and noise robustness. In the latent space, PixelSNAIL predicts the discrete code matrix produced by the VQ-VAE, and the prediction loss is used to further refine anomaly detection results. Experiments on the DCASE2024 Task 2 dataset demonstrate superior performance across multiple machine types, confirming the method's effectiveness and robustness for machine sound anomaly detection in complex industrial scenarios.
Autor:innen und Institutionen
- Department of Artificial Intelligence and Big Data, HeFei University, HeFei 230601, China.
Förderung
- European Union's Horizon Europe Research and Innovation Programme under agreement
- Hefei Municipal Natural Science Foundation
Zitieren
APA
Chen, S., Pang, B., Ding, J., Zhu, X., Sun, Y., & Liu, M. (2026). Conditional vector quantized variational autoencoders for machine sound anomaly detection under domain shift. The Journal of the Acoustical Society of America, 159(6), 5221-5237. https://doi.org/10.1121/10.0044140
Vancouver
Chen S, Pang B, Ding J, Zhu X, Sun Y, Liu M. Conditional vector quantized variational autoencoders for machine sound anomaly detection under domain shift. The Journal of the Acoustical Society of America. 2026;159(6):5221-5237. doi:10.1121/10.0044140
BibTeX
@article{Chen2026,
author = {Chen, Shengbing and Pang, Bo and Ding, Junkai and Zhu, Xingcheng and Sun, Yong and Liu, Mengyuan},
title = {Conditional vector quantized variational autoencoders for machine sound anomaly detection under domain shift},
journal = {The Journal of the Acoustical Society of America},
year = {2026},
volume = {159},
number = {6},
pages = {5221--5237},
doi = {10.1121/10.0044140}
}
EUVIMED