EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing english oral translation through cross-modal learning and synchronous optimization

Yan Wang iD

PLOS One · 2025

DOI: 10.1371/journal.pone.0329381 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Yan Wang. Beteiligte Einrichtung: Anhui Wenda University of Information Engineering, Hefei, Anhui, China. Hauptthemen laut MEDLINE: Language, Translating. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Construction of the evaluation system of ideological and political teaching in College English courses under CIPP model.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Oral translation in English serves as a critical conduit for international communication and cultural exchange. However, the prevalent variations in pronunciation and the rapid pace of spoken language currently impede the efficacy of synchronous translation methods. To improve the quality and efficiency of synchronous oral translation, this paper explores the integration of cross-modal semantic understanding and synchronous enhancement specifically for English oral translation. This exploration commences with the implementation of a cross-modal translation scenario. Subsequently, the text sequence derived from this process is amalgamated with the original speech features via Bidirectional Encoder Representations from Transformers (BERT). The cross-information between modalities is explored, and linear transformation optimization is performed on the self-attention mechanism in Transformer to achieve context-awareness and understanding of oral-transcribed text. In conclusion, the integration of dynamic time warping (DTW) enhances real-time synchronization between speech and text, thereby improving translation fluency. Experimental results reveal that, when compared to the existing bilingual attention neural machine translation (NMT) model and the context-aware NMT model, the model proposed in this study yields an average bilingual evaluation understudy (BLEU) score that is 9.3% and 26.9% higher, respectively. Furthermore, its synchronization speed surpasses that of the other two models by 17.9% and 16.8%, respectively. These findings suggest that the fusion model, which incorporates context-awareness and an attention mechanism in cross-modal translation, can significantly elevate the quality and efficiency of English oral translation, offering a novel approach to the synchronous translation of spoken English.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LanguageTranslatingHumansMultilingualismSpeechSemantics

Autor:innen und Institutionen

  • Anhui Wenda University of Information Engineering, Hefei, Anhui, China.

ORCID-Profile: Yan Wang

Förderung

  • Construction of the evaluation system of ideological and political teaching in College English courses under CIPP model

Zitieren

APA

Wang, Y. (2025). Enhancing english oral translation through cross-modal learning and synchronous optimization. PLOS One. https://doi.org/10.1371/journal.pone.0329381

Vancouver

Wang Y. Enhancing english oral translation through cross-modal learning and synchronous optimization. PLOS One. 2025. doi:10.1371/journal.pone.0329381

BibTeX
@article{Wang2025,
  author = {Wang, Yan},
  title = {Enhancing english oral translation through cross-modal learning and synchronous optimization},
  journal = {PLOS One},
  year = {2025},
  doi = {10.1371/journal.pone.0329381}
}
Kostenlos starten →