EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task

Evaldas Vaičiukynas, Paulius Danėnas, Linas Ablonskis, Algirdas Šukys, Edgaras Dambrauskas, Voldemaras Žitkus, Rita Butkienė, Rimantas Butleris

Applied Sciences · 20.05.2026 · 16 (10) · 5099

DOI: 10.3390/app16105099 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 20.05.2026. Verfasst von Evaldas Vaičiukynas und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Economic Revitalization and Resilience Enhancement Plan “New Generation Lithuania”.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Online hate speech and abusive language pose a growing challenge for content moderation, especially in multilingual settings and for low-resource languages such as Lithuanian. This paper investigates to what extent modern multilingual sentence embedding models can support accurate hate speech detection in Lithuanian, Russian, and English, and how their performance depends on downstream modeling choices and feature dimensionality. We introduce LtHate, a new Lithuanian hate speech corpus derived from news portals and social networks, and benchmark six modern multilingual encoders (gemma, qwen, bge, snow, jina, and e5) on LtHate, RuToxic, and EnSuperset using a unified Python pipeline. For each embedding type, we train both a one-class histogram-based anomaly detector (HBOS) and a two-class gradient-boosted tree ensemble (CatBoost), with and without Principal Component Analysis (PCA) compression to 32-dimensional feature vectors. Across all datasets, two-class supervised models consistently and substantially outperform one-class anomaly detection, with the best configurations achieving up to 78.8% accuracy (Kappa 0.58, AUC ROC 0.87) in Lithuanian (jina), 92.2% accuracy (Kappa 0.77, AUC ROC 0.97) in Russian (e5), and 76.9% accuracy (Kappa 0.48, AUC ROC 0.86) in English (e5). PCA compression deteriorates the discriminative power of CatBoost only slightly, with much more negative impact for the HBOS model. These results demonstrate how modern multilingual sentence embeddings combined with gradient-boosted decision trees provides robust machine learning solutions for multilingual hate speech detection applications.

Förderung

  • Economic Revitalization and Resilience Enhancement Plan “New Generation Lithuania”

Zitieren

APA

Vaičiukynas, E., Danėnas, P., Ablonskis, L., Šukys, A., Dambrauskas, E., Žitkus, V., Butkienė, R., & Butleris, R. (2026). Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task. Applied Sciences, 16(10), 5099. https://doi.org/10.3390/app16105099

Vancouver

Vaičiukynas E, Danėnas P, Ablonskis L, Šukys A, Dambrauskas E, Žitkus V, et al. Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task. Applied Sciences. 2026;16(10):5099. doi:10.3390/app16105099

BibTeX
@article{Vaiiukynas2026,
  author = {Vaičiukynas, Evaldas and Danėnas, Paulius and Ablonskis, Linas and Šukys, Algirdas and Dambrauskas, Edgaras and Žitkus, Voldemaras and Butkienė, Rita and Butleris, Rimantas},
  title = {Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {10},
  pages = {5099},
  doi = {10.3390/app16105099}
}
Kostenlos starten →