Niektoré problémy pri tvorbe ukrajinského webového korpusu Araneum Ucrainicum
Naše řeč · 2026-06 · 109 (2) · 93-123
DOI: 10.58756/n21082602 ↗Kurz gefasst
Fachartikel in der Zeitschrift Naše řeč, 2026-06. Verfasst von Vladimír Benko.
Abstract (Originalsprache)
The Ukrainian corpus is being developed in the framework of the Aranea project, aiming to create web-crawled corpora for several (primarily) European languages. The data were downloaded from the Internet across multiple sessions between 2014 and 2026, so the texts also cover the discourse of the pandemic period and the Russo-Ukrainian war. In this paper, we describe the main specific challenges and language-motivated decisions related to the creation of this Ukrainian corpus; particularly the filtering, deduplication, and tokenization of the texts. We present the ensemble method for lemmatization and morphosyntactic annotation using four different tools, followed by aggregation, classification of individual corpus tokens using regular expressions, and the identification of the language of individual corpus sentences. Using a sample of 170 million tokens from the latest data download session, we demonstrate searching the corpus by means of the NoSketch Engine corpus manager and the calculation of subcorpus keywords using the A. Kilgarriffʼs method.
Zitieren
APA
Benko, V. (2026). Niektoré problémy pri tvorbe ukrajinského webového korpusu Araneum Ucrainicum. Naše řeč, 109(2), 93-123. https://doi.org/10.58756/n21082602
Vancouver
Benko V. Niektoré problémy pri tvorbe ukrajinského webového korpusu Araneum Ucrainicum. Naše řeč. 2026;109(2):93-123. doi:10.58756/n21082602
BibTeX
@article{Benko2026,
author = {Benko, Vladimír},
title = {Niektoré problémy pri tvorbe ukrajinského webového korpusu Araneum Ucrainicum},
journal = {Naše řeč},
year = {2026},
volume = {109},
number = {2},
pages = {93--123},
doi = {10.58756/n21082602}
}
EUVIMED