EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Mixture-of-Languages Routing for Multilingual Dialogues

Jiahuan Pei, Guojun Yan, Maarten De Rijke, Pengjie Ren

ACM Transactions on Information Systems · 2024-11-30 · 42 (6) · 1-33

DOI: 10.1145/3676956 ↗

At a glance

Journal article in ACM Transactions on Information Systems, published online on 2024-10-22. Written by Jiahuan Pei and 3 co-authors. Cited 7 times so far (Crossref); 129 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

We consider multilingual dialogue systems and ask how the performance of a dialogue system can be improved by using information that is available in other languages than the language in which a conversation is being conducted. We adopt a collaborative chair-experts framework, where each expert agent can be either monolingual or cross-lingual, and a chair agent follows a mixture-of-experts procedure for globally optimizing multilingual task-oriented dialogue systems. We propose a mixture-of-languages routing framework that includes four functional components, i.e., input embeddings of multilingual dialogues, language model, pairwise alignment between the representation of every two languages, and mixture-of-languages. We quantify language characteristics of unity and diversity using a number of similarity metrics, i.e., genetic similarity and word and sentence similarity based on embeddings. Our main finding is that the performance of multilingual task-oriented dialogue systems can be greatly impacted by three key aspects, i.e., data sufficiency, language characteristics, and model design in a mixture-of-languages routing framework.

Cite

APA

Pei, J., Yan, G., Rijke, M. D., & Ren, P. (2024). Mixture-of-Languages Routing for Multilingual Dialogues. ACM Transactions on Information Systems, 42(6), 1-33. https://doi.org/10.1145/3676956

Vancouver

Pei J, Yan G, Rijke MD, Ren P. Mixture-of-Languages Routing for Multilingual Dialogues. ACM Transactions on Information Systems. 2024;42(6):1-33. doi:10.1145/3676956

BibTeX
@article{Pei2024,
  author = {Pei, Jiahuan and Yan, Guojun and Rijke, Maarten De and Ren, Pengjie},
  title = {Mixture-of-Languages Routing for Multilingual Dialogues},
  journal = {ACM Transactions on Information Systems},
  year = {2024},
  volume = {42},
  number = {6},
  pages = {1--33},
  doi = {10.1145/3676956}
}
Start for free →