EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Improving End-to-End Speech Translation for the Low Resource Language Fongbe to French

D. Fortuné Kponou, Fréjus A. A. Laleye, Eugène C. Ezin, Yannick Estève

ACM Transactions on Asian and Low-Resource Language Information Processing · 31.07.2026 · 25 (7) · 1-13

DOI: 10.1145/3806836 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Asian and Low-Resource Language Information Processing, online erschienen am 22.06.2026. Verfasst von D. Fortuné Kponou und 3 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Partnership for Skills in Applied Sciences, Engineering, and Technology, Regional Scholarship and Innovation Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study addresses the challenges of end-to-end (E2E) Speech-to-Text Translation (STT) for the low-resource Fongbe-to-French language pair using a transfer learning approach. We first establish robust baselines by integrating state-of-the-art pretrained speech encoders (HuBERT-147, AfriHuBERT, XLS-R, Whisper) with powerful text decoders (mBART, NLLB). This initial phase identified the AfriHuBERT–NLLB and XLS-R–NLLB combinations as the most competitive E2E configurations. To further enhance performance, we propose and evaluate three hybrid feature fusion strategies, the Bidirectional Co-Attention (BCOAT), the Feature-wise Linear Modulation (FiLM), and the Feature Sum (SUM). These methods are designed to strategically fuse intermediate representations extracted from two distinct and powerful encoders, AfriHuBERT and XLS-R, within the E2E architecture. The fusion process aims to enrich the linguistic and tonal information critical for accurate translation of the tonal Fongbe language. Experimental results demonstrate significant performance gains over the baselines. The BLEU score improved from 26.32 to a peak of 27.78 for the AfriHuBERT–NLLB configuration (using FiLM), and from 26.27 to a maximum of 28.05 for the XLS-R–NLLB configuration (using SUM). These findings confirm that translation quality for tonal languages like Fongbe can be substantially improved by extracting and combining high-quality, complementary features through advanced encoder fusion. Our hybrid feature fusion methods present a substantial advance in speech translation quality within resource-scarce linguistic environments.

Förderung

  • Partnership for Skills in Applied Sciences, Engineering, and Technology
  • Regional Scholarship and Innovation Fund

Zitieren

APA

Kponou, D. F., Laleye, F. A. A., Ezin, E. C., & Estève, Y. (2026). Improving End-to-End Speech Translation for the Low Resource Language Fongbe to French. ACM Transactions on Asian and Low-Resource Language Information Processing, 25(7), 1-13. https://doi.org/10.1145/3806836

Vancouver

Kponou DF, Laleye FAA, Ezin EC, Estève Y. Improving End-to-End Speech Translation for the Low Resource Language Fongbe to French. ACM Transactions on Asian and Low-Resource Language Information Processing. 2026;25(7):1-13. doi:10.1145/3806836

BibTeX
@article{Kponou2026,
  author = {Kponou, D. Fortuné and Laleye, Fréjus A. A. and Ezin, Eugène C. and Estève, Yannick},
  title = {Improving End-to-End Speech Translation for the Low Resource Language Fongbe to French},
  journal = {ACM Transactions on Asian and Low-Resource Language Information Processing},
  year = {2026},
  volume = {25},
  number = {7},
  pages = {1--13},
  doi = {10.1145/3806836}
}
Kostenlos starten →