EUVIMEDEUVIMED entdecken
Crossref

UzNER: A Human-Reviewed Benchmark for Uzbek Named Entity Recognition With Gazetteer-Augmented Transformer Models

Bobur Saidov, Bobur Saidov, Vladimir Barakhnin, Vladimir Barakhnin, Zarnigor Fayzullaeva, Umid Ibragimov, Ulugbek Tursunov

Journal of Computer Science · 01.06.2026 · 22 (6) · 1894-1911

DOI: 10.3844/jcssp.2026.1894.1911 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computer Science, erschienen am 01.06.2026. Verfasst von Bobur Saidov und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

UzNER-100K is a large-scale human-reviewed benchmark for Uzbek named entity recognition with 100,000 training sentences, 18 fine-grained entity types and 200,083 entity mentions across 114,269 sentences in total. The corpus was constructed through an LLM-assisted, expert-reviewed annotation pipeline that achieved strong reliability on the main audit subset while substantially reducing corpus-construction effort. The benchmark includes a standard test split, a gold-audited subset and a hard subset designed to stress long, ambiguous and structurally complex cases. We evaluate 10 Uzbek NER systems spanning recurrent, monolingual Uzbek, multilingual transformer and hybrid architectures. The best model, XLM-R + Gazetteer + CRF, reaches 91.03 Micro-F1 on the standard test set, 89.67 on the gold-audited subset and 83.21 on the hard subset. Quality control included a dedicated inter-annotator agreement audit, achieving 91.3% span-level agreement, 93.7% entity-type agreement, and a Cohen’s Kappa of 0.914. In addition, a qualitative native-speaker assessment confirmed the linguistic naturalness of the model outputs while highlighting remaining challenges in legal, administrative, and event-related expressions.

Zitieren

APA

Saidov, B., Saidov, B., Barakhnin, V., Barakhnin, V., Fayzullaeva, Z., Ibragimov, U., & Tursunov, U. (2026). UzNER: A Human-Reviewed Benchmark for Uzbek Named Entity Recognition With Gazetteer-Augmented Transformer Models. Journal of Computer Science, 22(6), 1894-1911. https://doi.org/10.3844/jcssp.2026.1894.1911

Vancouver

Saidov B, Saidov B, Barakhnin V, Barakhnin V, Fayzullaeva Z, Ibragimov U, et al. UzNER: A Human-Reviewed Benchmark for Uzbek Named Entity Recognition With Gazetteer-Augmented Transformer Models. Journal of Computer Science. 2026;22(6):1894-1911. doi:10.3844/jcssp.2026.1894.1911

BibTeX
@article{Saidov2026,
  author = {Saidov, Bobur and Saidov, Bobur and Barakhnin, Vladimir and Barakhnin, Vladimir and Fayzullaeva, Zarnigor and Ibragimov, Umid and Tursunov, Ulugbek},
  title = {UzNER: A Human-Reviewed Benchmark for Uzbek Named Entity Recognition With Gazetteer-Augmented Transformer Models},
  journal = {Journal of Computer Science},
  year = {2026},
  volume = {22},
  number = {6},
  pages = {1894--1911},
  doi = {10.3844/jcssp.2026.1894.1911}
}
Kostenlos starten →