EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A blended framework for audio spoof detection with sequential models and bags of auditory bites

Misaj Sharafudeen, Vinod Chandra S S, Andrew J, Yuichi Sei

Scientific Reports · 30.08.2024 · 14 (1)

DOI: 10.1038/s41598-024-71026-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift Scientific Reports, online erschienen am 30.08.2024. Verfasst von Misaj Sharafudeen und 3 weiteren Autor:innen. Beteiligte Einrichtung: Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Thiruvananthapuram, Kerala, India. Hauptthemen laut MEDLINE: Algorithms. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University Grants Commission, Japan Society for the Promotion of Science, Manipal Academy of Higher Education, Manipal.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

An automated speaker verification system uses the process of speech recognition to verify the identity of a user and block illicit access. Logical access attacks are efforts to obtain access to a system by tampering with its algorithms or data, or by circumventing security mechanisms. DeepFake attacks are a form of logical access threats that employs artificial intelligence to produce highly realistic audio clips of human voice, that may be used to circumvent vocal authentication systems. This paper presents a framework for the detection of Logical Access and DeepFake audio spoofings by integrating audio file components and time-frequency representation spectrograms into a lower-dimensional space using sequential prediction models. Bidirectional-LSTM trained on the bonafide class generates significant one-dimensional features for both classes. The feature set is then standardized to a fixed set using a novel Bags of Auditory Bites (BoAB) feature standardizing algorithm. The Extreme Learning Machine maps the feature space to predictions that differentiate between genuine and spoofed speeches. The framework is evaluated using the ASVspoof 2021 dataset, a comprehensive collection of audio recordings designed for evaluating the strength of speaker verification systems against spoofing attacks. It achieves favorable results on synthesized DeepFake attacks with an Equal Error Rate (EER) of 1.18% in the most optimal setting. Logical Access attacks were more challenging to detect at an EER of 12.22%. Compared to the state-of-the-arts in the ASVspoof2021 dataset, the proposed method notably improves EER for DeepFake attacks by an improvement rate of 95.16%.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsHumansSpeech Recognition SoftwareComputer SecurityVoiceSpeechArtificial Intelligence

Autor:innen und Institutionen

  • Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Thiruvananthapuram, Kerala, India.
  • Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Thiruvananthapuram, Kerala, India. vinod@keralauniversity.ac.in.
  • Department of Computer Science and Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, Karnataka, India. andrew.j@manipal.edu.
  • Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan.

Förderung

  • University Grants Commission
  • Japan Society for the Promotion of Science
  • Manipal Academy of Higher Education, Manipal

Zitieren

APA

Sharafudeen, M., S S, V. C., J, A., & Sei, Y. (2024). A blended framework for audio spoof detection with sequential models and bags of auditory bites. Scientific Reports, 14(1). https://doi.org/10.1038/s41598-024-71026-w

Vancouver

Sharafudeen M, S S VC, J A, Sei Y. A blended framework for audio spoof detection with sequential models and bags of auditory bites. Scientific Reports. 2024;14(1). doi:10.1038/s41598-024-71026-w

BibTeX
@article{Sharafudeen2024,
  author = {Sharafudeen, Misaj and S S, Vinod Chandra and J, Andrew and Sei, Yuichi},
  title = {A blended framework for audio spoof detection with sequential models and bags of auditory bites},
  journal = {Scientific Reports},
  year = {2024},
  volume = {14},
  number = {1},
  doi = {10.1038/s41598-024-71026-w}
}
Kostenlos starten →