Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models
Journal of Computer Technology and Applied Mathematics · 2025
DOI: 10.70393/6a6374616d.323637 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computer Technology and Applied Mathematics, 2025. Verfasst von Weikun Lin. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
As video conferencing becomes increasingly integral to modern communication, the need for high-quality synchronization between speech and visual elements is paramount. Speech Activity Detection (VAD) and lip synchronization technologies play crucial roles in ensuring accurate, real-time communication by distinguishing speech signals from noise and aligning lip movements with audio. This paper proposes a novel multimodal fusion approach based on deep learning models that significantly improves the accuracy of speech activity detection and the real-time performance of lip synchronization. Using open datasets such as AVSpeech and LRW, this study showcases the effectiveness of the proposed models in various real-world scenarios, such as multi-party conferences, noisy environments, and cross-lingual settings. Experimental results demonstrate that the LSTM-based VAD model achieves an accuracy of 92%, outperforming traditional methods, while the lip synchronization module ensures seamless audio-visual alignment with minimal delay.
Zitieren
APA
Lin, W. (2025). Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models. Journal of Computer Technology and Applied Mathematics. https://doi.org/10.70393/6a6374616d.323637
Vancouver
Lin W. Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models. Journal of Computer Technology and Applied Mathematics. 2025. doi:10.70393/6a6374616d.323637
BibTeX
@article{Lin2025,
author = {Lin, Weikun},
title = {Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models},
journal = {Journal of Computer Technology and Applied Mathematics},
year = {2025},
doi = {10.70393/6a6374616d.323637}
}
EUVIMED