Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP
DMPedia Lecture Notes in Multidisciplinary Research · 13.03.2026 · 430-436
DOI: 10.65890/dmp.lnmr.impact26.80 ↗Kurz gefasst
Fachartikel in der Zeitschrift DMPedia Lecture Notes in Multidisciplinary Research, online erschienen am 13.03.2026. Verfasst von Daniel Soubam und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This paper looks at improving multilingual language models for Nepali, which is a language with limited resources. We take a two-step approach: first, we train the model using Masked Language Modeling (MLM) on Nepali-only text, then we continue training with Translation Language Modeling (TLM) using English-Nepali parallel texts. Our experiments show that adapting the XLM-R Base model this way helps reduce Nepali perplexity and boosts performance on tasks like machine translation, sentiment analysis, and question answering. We also share our methods and results to support future research on underrepresented South Asian languages.
Zitieren
APA
Soubam, D., Gupta, V., & Sivaraj, A. (2026). Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP. DMPedia Lecture Notes in Multidisciplinary Research, 430-436. https://doi.org/10.65890/dmp.lnmr.impact26.80
Vancouver
Soubam D, Gupta V, Sivaraj A. Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP. DMPedia Lecture Notes in Multidisciplinary Research. 2026:430-436. doi:10.65890/dmp.lnmr.impact26.80
BibTeX
@article{Soubam2026,
author = {Soubam, Daniel and Gupta, Vivek and Sivaraj, Aparna},
title = {Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP},
journal = {DMPedia Lecture Notes in Multidisciplinary Research},
year = {2026},
pages = {430--436},
doi = {10.65890/dmp.lnmr.impact26.80}
}
EUVIMED