EUVIMEDEUVIMED entdecken
Crossref

Multi-Attack Audio-Visual Spoof Detection for Secure Hearing-Assistive Systems Using Transformer Fusion

Aysha Munawwara, Kia Dashtipour, Nasir Saleem, Mandar Gogate, Adeel Hussain, Amir Hussain

ICCK Transactions on Information Security and Cryptography · 28.04.2026 · 2 (2) · 101-108

DOI: 10.62762/tisc.2026.221187 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ICCK Transactions on Information Security and Cryptography, online erschienen am 28.04.2026. Verfasst von Aysha Munawwara und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Audio-visual spoofing attacks have emerged as a serious threat to modern hearing-assistive systems due to rapid advances in text-to-speech synthesis, neural vocoders, and lip-sync deepfake generation. Advanced hearing aids and cochlear implants increasingly incorporate AI-based speech enhancement and multimodal perception modules, which makes them vulnerable to manipulated or synthetic inputs. Traditional spoof detection approaches are often limited to binary classification between bonafide and spoofed speech, failing to capture the diversity of emerging multi-modal attack types.In this paper, we propose a multi-attack audio-visual spoof detection framework designed that explicitly models four spoof categories: real speech, text-to-speech (TTS) spoofing, vocoder-based spoofing, and lip-sync manipulation attacks. A multi-attack protocol is introduced to enable fine-grained supervision across both audio and video modalities. The proposed system employs convolutional feature extractors for each stream, followed by multimodal fusion for robust classification. Experimental results demonstrate reliable performance under in-dataset evaluation settings. Confusion matrix analysis further highlights the effectiveness of audio-visual fusion, particularly in detecting visually driven spoofing attacks. Overall, this work provides a strong foundation for next-generation secure hearing-assistive systems operating in real-world acoustic environments.

Zitieren

APA

Munawwara, A., Dashtipour, K., Saleem, N., Gogate, M., Hussain, A., & Hussain, A. (2026). Multi-Attack Audio-Visual Spoof Detection for Secure Hearing-Assistive Systems Using Transformer Fusion. ICCK Transactions on Information Security and Cryptography, 2(2), 101-108. https://doi.org/10.62762/tisc.2026.221187

Vancouver

Munawwara A, Dashtipour K, Saleem N, Gogate M, Hussain A, Hussain A. Multi-Attack Audio-Visual Spoof Detection for Secure Hearing-Assistive Systems Using Transformer Fusion. ICCK Transactions on Information Security and Cryptography. 2026;2(2):101-108. doi:10.62762/tisc.2026.221187

BibTeX
@article{Munawwara2026,
  author = {Munawwara, Aysha and Dashtipour, Kia and Saleem, Nasir and Gogate, Mandar and Hussain, Adeel and Hussain, Amir},
  title = {Multi-Attack Audio-Visual Spoof Detection for Secure Hearing-Assistive Systems Using Transformer Fusion},
  journal = {ICCK Transactions on Information Security and Cryptography},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {101--108},
  doi = {10.62762/tisc.2026.221187}
}
Kostenlos starten →