EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP

Daniel Soubam, Vivek Gupta, Aparna Sivaraj

DMPedia Lecture Notes in Multidisciplinary Research · 13.03.2026 · 430-436

DOI: 10.65890/dmp.lnmr.impact26.80 ↗

Kurz gefasst

Fachartikel in der Zeitschrift DMPedia Lecture Notes in Multidisciplinary Research, online erschienen am 13.03.2026. Verfasst von Daniel Soubam und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper looks at improving multilingual language models for Nepali, which is a language with limited resources. We take a two-step approach: first, we train the model using Masked Language Modeling (MLM) on Nepali-only text, then we continue training with Translation Language Modeling (TLM) using English-Nepali parallel texts. Our experiments show that adapting the XLM-R Base model this way helps reduce Nepali perplexity and boosts performance on tasks like machine translation, sentiment analysis, and question answering. We also share our methods and results to support future research on underrepresented South Asian languages.

Zitieren

APA

Soubam, D., Gupta, V., & Sivaraj, A. (2026). Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP. DMPedia Lecture Notes in Multidisciplinary Research, 430-436. https://doi.org/10.65890/dmp.lnmr.impact26.80

Vancouver

Soubam D, Gupta V, Sivaraj A. Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP. DMPedia Lecture Notes in Multidisciplinary Research. 2026:430-436. doi:10.65890/dmp.lnmr.impact26.80

BibTeX
@article{Soubam2026,
  author = {Soubam, Daniel and Gupta, Vivek and Sivaraj, Aparna},
  title = {Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP},
  journal = {DMPedia Lecture Notes in Multidisciplinary Research},
  year = {2026},
  pages = {430--436},
  doi = {10.65890/dmp.lnmr.impact26.80}
}
Kostenlos starten →