EUVIMEDEUVIMED entdecken
Crossref

The application of monolingual and multilingual BERT-based models for text automation tasks in Ukrainian

Mykola Glybovets, Danylo Vanin

Bulletin of Taras Shevchenko National University of Kyiv. Series: Physics and Mathematics · 05.06.2026 · (1) · 195-205

DOI: 10.17721/1812-5409.2026/1.26 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bulletin of Taras Shevchenko National University of Kyiv. Series: Physics and Mathematics, online erschienen am 05.06.2026. Verfasst von Mykola Glybovets und 1 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The object of this study is mono- and multilingual models based on the BERT architecture. The research focuses on comparing their performance in natural language processing (NLP) tasks, with an emphasis on their application to the Ukrainian language. The methodological framework follows standard approaches to model training and evaluation, relying on publicly available information sources. Experiments were conducted solely on open-source or self-fine-tuned models and covered all existing Ukrainian benchmarks. Overall, the findings show that both monolingual and multilingual BERT models can be effective for NLP tasks, depending on the target language, specific task, and available resources. While monolingual models often outperform multilingual ones for tasks in their own language, multilingual models can prove advantageous when resources for training language-specific models are limited. The comparison demonstrates that models trained from scratch on Ukrainian texts–or further fine-tuned on them–generally achieve higher results on Ukrainian NLP tasks than multilingual counterparts. This advantage was evident in named-entity recognition, text classification, and masked-token prediction. Multilingual models, however, achieve competitive or superior performance in "lighter" tasks such as word-sense disambiguation, especially when full training of a monolingual model is not feasible. These findings underscore the need to adapt or fully train Ukrainian-language models for specialized tasks while still allowing for the cost-effective use of multilingual systems in everyday scenarios. The practical significance of this work lies in providing a consolidated performance map of modern models and laying the groundwork for a full-scale Ukrainian GLUE-like benchmark, which will stimulate further research and improve the accuracy of Ukrainian NLP applications.

Zitieren

APA

Glybovets, M., & Vanin, D. (2026). The application of monolingual and multilingual BERT-based models for text automation tasks in Ukrainian. Bulletin of Taras Shevchenko National University of Kyiv. Series: Physics and Mathematics, 195-205. https://doi.org/10.17721/1812-5409.2026/1.26

Vancouver

Glybovets M, Vanin D. The application of monolingual and multilingual BERT-based models for text automation tasks in Ukrainian. Bulletin of Taras Shevchenko National University of Kyiv. Series: Physics and Mathematics. 2026:195-205. doi:10.17721/1812-5409.2026/1.26

BibTeX
@article{Glybovets2026,
  author = {Glybovets, Mykola and Vanin, Danylo},
  title = {The application of monolingual and multilingual BERT-based models for text automation tasks in Ukrainian},
  journal = {Bulletin of Taras Shevchenko National University of Kyiv. Series: Physics and Mathematics},
  year = {2026},
  number = {1},
  pages = {195--205},
  doi = {10.17721/1812-5409.2026/1.26}
}
Kostenlos starten →