DeepDet: YAMNet with BottleNeck Attention Module (BAM) for TTS synthesis detection
EURASIP Journal on Audio, Speech, and Music Processing · 01.04.2024 · 2024 (1)
DOI: 10.1186/s13636-024-00335-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift EURASIP Journal on Audio, Speech, and Music Processing, online erschienen am 01.04.2024. Verfasst von Rabbia Mahum und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Spoofed speeches are becoming a big threat to society due to advancements in artificial intelligence techniques. Therefore, there must be an automated spoofing detector that can be integrated into automatic speaker verification (ASV) systems. In this study, we recommend a novel and robust model, named DeepDet , based on deep-layered architecture, to categorize speech into two classes: spoofed and bonafide. DeepDet is an improved model based on Yet Another Mobile Network (YAMNet) employing a customized MobileNet combined with a bottleneck attention module (BAM). First, we convert audio into mel-spectrograms that consist of time–frequency representations on mel-scale. Second, we trained our deep layered model using the extracted mel-spectrograms on a Logical Access (LA) set, including synthesized speeches and voice conversions of the ASVspoof-2019 dataset. In the end, we classified the audios, utilizing our trained binary classifier. More precisely, we utilized the power of layered architecture and guided attention that can discern the spoofed speech from bonafide samples. Our proposed improved model employs depth-wise linearly separate convolutions, which makes our model lighter weight than existing techniques. Furthermore, we implemented extensive experiments to assess the performance of the suggested model using the ASVspoof 2019 corpus. We attained an equal error rate (EER) of 0.042% on Logical Access (LA), whereas 0.43% on Physical Access (PA) attacks. Therefore, the performance of the proposed model is significant on the ASVspoof 2019 dataset and indicates the effectiveness of the DeepDet over existing spoofing detectors. Additionally, our proposed model is robust enough that can identify the unseen spoofed audios and classifies the several attacks accurately.
Zitieren
APA
Mahum, R., Irtaza, A., Javed, A., Mahmoud, H. A., & Hassan, H. (2024). DeepDet: YAMNet with BottleNeck Attention Module (BAM) for TTS synthesis detection. EURASIP Journal on Audio, Speech, and Music Processing, 2024(1). https://doi.org/10.1186/s13636-024-00335-9
Vancouver
Mahum R, Irtaza A, Javed A, Mahmoud HA, Hassan H. DeepDet: YAMNet with BottleNeck Attention Module (BAM) for TTS synthesis detection. EURASIP Journal on Audio, Speech, and Music Processing. 2024;2024(1). doi:10.1186/s13636-024-00335-9
BibTeX
@article{Mahum2024,
author = {Mahum, Rabbia and Irtaza, Aun and Javed, Ali and Mahmoud, Haitham A. and Hassan, Haseeb},
title = {DeepDet: YAMNet with BottleNeck Attention Module (BAM) for TTS synthesis detection},
journal = {EURASIP Journal on Audio, Speech, and Music Processing},
year = {2024},
volume = {2024},
number = {1},
doi = {10.1186/s13636-024-00335-9}
}
EUVIMED