VoiceBridge: AN AI-POWERED FRAMEWORK FOR LOW-COST MULTILINGUAL VIDEO DUBBING INTO INDIAN REGIONAL LANGUAGES
Advances in Computer Science and Engineering · 2025
DOI: 10.17654/0973699926001 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advances in Computer Science and Engineering, 2025. Verfasst von M. V. Madhusudhan und 3 weiteren Autor:innen.
Abstract (Originalsprache)
VoiceBridge is an AI-powered, low-cost multilingual dubbing framework specifically built to make English video content available in various Indian regional languages, specifically South Indian languages: Kannada, Tamil, Telugu, and Malayalam. VoiceBridge combines bleeding- edge open-source technologies such as Whisper for Automatic Speech Recognition (ASR), IndicTrans2 for Text Translation (TT), and Coqui or Indic-TTS for Text-to-Speech (TTS), to create an end-to-end pipeline of transcription, translation, speech synthesis, and video dubbing that is affordable, culturally relevant, and easily scalable. The framework features a simplified interface that allows users to upload videos, translate speech, and produce dubbed outputs without having to have any background knowledge of the processes or technologies being used. Evaluation of performance gave promising results, arriving at a Word Error Rate (WER) of 11.9% and Character Error Rate (CER) of 11.09%, showing significant levels of recognition and translation accuracy despite minor differences in pronunciation and a 90millisecond audio-video delay. VoiceBridge utilizes open-source models and adapts those for low-resource languages to serve as abridge towards mitigating the digital languages gap, and as a means to provide access to educational and informational content in video format to various linguistic communities.
Zitieren
APA
Madhusudhan, M. V., Jojo, A., Mehreen, D. A., & Agampreeth, H. S. (2025). VoiceBridge: AN AI-POWERED FRAMEWORK FOR LOW-COST MULTILINGUAL VIDEO DUBBING INTO INDIAN REGIONAL LANGUAGES. Advances in Computer Science and Engineering. https://doi.org/10.17654/0973699926001
Vancouver
Madhusudhan MV, Jojo A, Mehreen DA, Agampreeth HS. VoiceBridge: AN AI-POWERED FRAMEWORK FOR LOW-COST MULTILINGUAL VIDEO DUBBING INTO INDIAN REGIONAL LANGUAGES. Advances in Computer Science and Engineering. 2025. doi:10.17654/0973699926001
BibTeX
@article{Madhusudhan2025,
author = {Madhusudhan, M. V. and Jojo, Annmary and Mehreen, D. Aqsa and Agampreeth, H. S.},
title = {VoiceBridge: AN AI-POWERED FRAMEWORK FOR LOW-COST MULTILINGUAL VIDEO DUBBING INTO INDIAN REGIONAL LANGUAGES},
journal = {Advances in Computer Science and Engineering},
year = {2025},
doi = {10.17654/0973699926001}
}
EUVIMED