EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models

Weikun Lin

Journal of Computer Technology and Applied Mathematics · 2025

DOI: 10.70393/6a6374616d.323637 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computer Technology and Applied Mathematics, 2025. Verfasst von Weikun Lin. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As video conferencing becomes increasingly integral to modern communication, the need for high-quality synchronization between speech and visual elements is paramount. Speech Activity Detection (VAD) and lip synchronization technologies play crucial roles in ensuring accurate, real-time communication by distinguishing speech signals from noise and aligning lip movements with audio. This paper proposes a novel multimodal fusion approach based on deep learning models that significantly improves the accuracy of speech activity detection and the real-time performance of lip synchronization. Using open datasets such as AVSpeech and LRW, this study showcases the effectiveness of the proposed models in various real-world scenarios, such as multi-party conferences, noisy environments, and cross-lingual settings. Experimental results demonstrate that the LSTM-based VAD model achieves an accuracy of 92%, outperforming traditional methods, while the lip synchronization module ensures seamless audio-visual alignment with minimal delay.

Zitieren

APA

Lin, W. (2025). Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models. Journal of Computer Technology and Applied Mathematics. https://doi.org/10.70393/6a6374616d.323637

Vancouver

Lin W. Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models. Journal of Computer Technology and Applied Mathematics. 2025. doi:10.70393/6a6374616d.323637

BibTeX
@article{Lin2025,
  author = {Lin, Weikun},
  title = {Enhancing Video Conferencing Experience through Speech Activity Detection and Lip Synchronization with Deep Learning Models},
  journal = {Journal of Computer Technology and Applied Mathematics},
  year = {2025},
  doi = {10.70393/6a6374616d.323637}
}
Kostenlos starten →