Language Models Are Polyglots: Language Similarity Predicts Cross-Lingual Transfer Learning Performance
Machine Learning and Knowledge Extraction · 2026-03-07 · 8 (3) · 65
DOI: 10.3390/make8030065 ↗At a glance
Journal article in Machine Learning and Knowledge Extraction, published online on 2026-03-07. Written by Juuso Eronen and 7 co-authors. Cited 1 times so far (Crossref); 122 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
Selecting a source language for zero-shot cross-lingual transfer is typically done by intuition or by defaulting to English, despite large performance differences across language pairs. We study whether linguistic similarity can predict transfer performance and support principled source-language selection. We introduce quantified WALS (qWALS), a typology-based similarity metric derived from features in the World Atlas of Language Structures, and evaluate it against existing similarity baselines. Validation uses three complementary signals: computational similarity scores, zero-shot transfer performance of multilingual transformers (mBERT and XLM-R) on four NLP tasks (dependency parsing, named entity recognition, sentiment analysis, and abusive language identification) across eight languages, and an expert-linguist similarity survey. Across tasks and models, higher linguistic similarity is associated with better transfer, and the survey provides independent support for the computational metrics.
Cite
APA
Eronen, J., Ptaszynski, M., Wicherkiewicz, T., Borges, R., Janic, K., Liu, Z., Mahmud, T., & Masui, F. (2026). Language Models Are Polyglots: Language Similarity Predicts Cross-Lingual Transfer Learning Performance. Machine Learning and Knowledge Extraction, 8(3), 65. https://doi.org/10.3390/make8030065
Vancouver
Eronen J, Ptaszynski M, Wicherkiewicz T, Borges R, Janic K, Liu Z, et al. Language Models Are Polyglots: Language Similarity Predicts Cross-Lingual Transfer Learning Performance. Machine Learning and Knowledge Extraction. 2026;8(3):65. doi:10.3390/make8030065
BibTeX
@article{Eronen2026,
author = {Eronen, Juuso and Ptaszynski, Michal and Wicherkiewicz, Tomasz and Borges, Robert and Janic, Katarzyna and Liu, Zhenzhen and Mahmud, Tanjim and Masui, Fumito},
title = {Language Models Are Polyglots: Language Similarity Predicts Cross-Lingual Transfer Learning Performance},
journal = {Machine Learning and Knowledge Extraction},
year = {2026},
volume = {8},
number = {3},
pages = {65},
doi = {10.3390/make8030065}
}
EUVIMED