EUVIMEDEUVIMED entdecken
Crossref

A Primer on Pretrained Multilingual Language Models

Sumanth Doddapaneni, Gowtham Ramesh, Mitesh Khapra, Anoop Kunchukuttan, Pratyush Kumar

ACM Computing Surveys · 30.09.2025 · 57 (9) · 1-39

DOI: 10.1145/3727339 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 06.05.2025. Verfasst von Sumanth Doddapaneni und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 184 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multilingual Language Models (MLLMs) such as mBERT, XLM, XLM-R, and the like, have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero-shot transfer learning, there has emerged a large body of work in (i) building bigger MLLMs covering a large number of languages, (ii) creating exhaustive benchmarks covering a wider variety of tasks and languages for evaluating MLLMs, (iii) analysing the performance of MLLMs on monolingual, zero-shot cross-lingual and bilingual tasks, (iv) understanding the universal language patterns (if any) learnt by MLLMs, and (v) augmenting the (often) limited capacity of MLLMs to improve their performance on seen or even unseen languages. In this survey, we review the existing literature covering the above broad areas of research pertaining to MLLMs. Based on our survey, we recommend some promising directions of future research.

Zitieren

APA

Doddapaneni, S., Ramesh, G., Khapra, M., Kunchukuttan, A., & Kumar, P. (2025). A Primer on Pretrained Multilingual Language Models. ACM Computing Surveys, 57(9), 1-39. https://doi.org/10.1145/3727339

Vancouver

Doddapaneni S, Ramesh G, Khapra M, Kunchukuttan A, Kumar P. A Primer on Pretrained Multilingual Language Models. ACM Computing Surveys. 2025;57(9):1-39. doi:10.1145/3727339

BibTeX
@article{Doddapaneni2025,
  author = {Doddapaneni, Sumanth and Ramesh, Gowtham and Khapra, Mitesh and Kunchukuttan, Anoop and Kumar, Pratyush},
  title = {A Primer on Pretrained Multilingual Language Models},
  journal = {ACM Computing Surveys},
  year = {2025},
  volume = {57},
  number = {9},
  pages = {1--39},
  doi = {10.1145/3727339}
}
Kostenlos starten →