EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

An Adaptive Attention-Based Multimodal Deep Fusion Network for Robust Biometric User Authentication

Nurdin, Indo Intan, St. Aminah Dinayati Gani, Nur Salman, Erni Marlina

Journal of Vocational, Informatics and Computer Education · 01.06.2026 · 43-56

DOI: 10.66053/voice.v4i2.448 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Vocational, Informatics and Computer Education, online erschienen am 01.06.2026. Verfasst von Nurdin und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose - The global rise in identity fraud and credential-based breaches, with average costs reaching USD 4.88 million, highlights the limitations of unimodal biometric authentication systems, which are vulnerable to spoofing attacks and environmental degradation. Existing multimodal approaches also rely on static weighting strategies that lack adaptability to adversarial conditions or degraded data quality.This study proposes a Multimodal Deep Fusion Network (MDFN), an end-to-end deep learning architecture that integrates three biometric modalities: facial (visual), voice (audio), and keystroke dynamics (behavioral). The MDFN employs three independent feature extraction streams—ResNet-18 for visual data, 1D CNN for audio data, and Bi-LSTM for behavioral data—fused through an Attention-based Adaptive Weighted Fusion mechanism that dynamically adjusts to data quality. Methods - The evaluation was conducted using the VGGFace2, VoxCeleb1, and CMU Keystroke datasets under both normal and spoofing attack scenarios, using metrics such as EER, FAR, FRR, AUC, and APCER. Findings - The results show that the MDFN achieves an EER of 1.12% and an FAR of 1.12%, significantly outperforming the unimodal baselines (best EER: 4.15%) and static fusion models (EER: 1.95%). The system also demonstrated strong robustness against spoofing, achieving an APCER as low as 0.8%. Research Implications - MDFN is an effective authentication solution for high-security environments. Originality - Its key contribution lies in the attention-based adaptive fusion mechanism, which dynamically adjusts the modality weights based on a real-time quality assessment.

Zitieren

APA

Nurdin, Intan, I., Gani, S. A. D., Salman, N., & Marlina, E. (2026). An Adaptive Attention-Based Multimodal Deep Fusion Network for Robust Biometric User Authentication. Journal of Vocational, Informatics and Computer Education, 43-56. https://doi.org/10.66053/voice.v4i2.448

Vancouver

Nurdin, Intan I, Gani SAD, Salman N, Marlina E. An Adaptive Attention-Based Multimodal Deep Fusion Network for Robust Biometric User Authentication. Journal of Vocational, Informatics and Computer Education. 2026:43-56. doi:10.66053/voice.v4i2.448

BibTeX
@article{Nurdin2026,
  author = {Nurdin and Intan, Indo and Gani, St. Aminah Dinayati and Salman, Nur and Marlina, Erni},
  title = {An Adaptive Attention-Based Multimodal Deep Fusion Network for Robust Biometric User Authentication},
  journal = {Journal of Vocational, Informatics and Computer Education},
  year = {2026},
  pages = {43--56},
  doi = {10.66053/voice.v4i2.448}
}
Kostenlos starten →