Investigating the Structural Properties of Linguistic Biases in Multilingual Language Models
Information · 18.05.2026 · 17 (5) · 498
DOI: 10.3390/info17050498 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 18.05.2026. Verfasst von Raghav Mantri und 3 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
As large language models (LLMs) scale to cover more languages, their potential to support low-resource settings becomes increasingly promising. However, the mechanisms underlying cross-lingual transfer and the factors that facilitate it remain insufficiently understood. Prior work has highlighted the role of linguistic similarity—particularly syntactic structure—in enabling transfer across languages. In this study, we present a broad empirical analysis of how multilingual LLMs encode and relate structural information across languages with varying typological properties. We combine multiple complementary methods, including hidden-state similarity analysis, typological correlation, probing for syntactic features, and attention-based structural comparisons, across four multilingual models and thirteen languages. Our findings show consistent correlations between representational similarity and syntactic relatedness, suggesting that structural properties of language influence how information is organized and shared across languages. We further observe that attention-derived structures exhibit partial alignment with gold-standard syntax, though this alignment should be interpreted as heuristic rather than direct evidence of syntactic encoding. Overall, our results provide a comparative empirical perspective on cross-lingual structural bias in multilingual LLMs and highlight the importance of careful methodological interpretation when linking representation geometry to linguistic structure.
Zitieren
APA
Mantri, R., Chen, S., Wang, Y., & Ataman, D. (2026). Investigating the Structural Properties of Linguistic Biases in Multilingual Language Models. Information, 17(5), 498. https://doi.org/10.3390/info17050498
Vancouver
Mantri R, Chen S, Wang Y, Ataman D. Investigating the Structural Properties of Linguistic Biases in Multilingual Language Models. Information. 2026;17(5):498. doi:10.3390/info17050498
BibTeX
@article{Mantri2026,
author = {Mantri, Raghav and Chen, Saun and Wang, Yixuan and Ataman, Duygu},
title = {Investigating the Structural Properties of Linguistic Biases in Multilingual Language Models},
journal = {Information},
year = {2026},
volume = {17},
number = {5},
pages = {498},
doi = {10.3390/info17050498}
}
EUVIMED