A Multi-Level Annotation Model for Fake News Detection: Implementing Kazakh-Russian Corpus via Label Studio
Big Data and Cognitive Computing · 20.08.2025 · 9 (8) · 215
DOI: 10.3390/bdcc9080215 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 20.08.2025. Verfasst von Madina Sambetbayeva und 6 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan.
Abstract (Originalsprache)
This paper presents a multi-level annotation model for detecting fake news in Kazakh and Russian languages, aiming to enhance understanding of disinformation strategies in multilingual digital media environments. Unlike traditional binary models, our approach captures the complexity of disinformation by accounting for both linguistic and cultural factors. To support this, a corpus of over 5000 news texts was manually annotated using the Label Studio platform. The annotation scheme consists of seven interrelated categories: CLAIM, SOURCE, EVIDENCE, DISINFORMATION_TECHNIQUE, AUTHOR_INTENT, TARGET_AUDIENCE, and TIMESTAMP. Inter-annotator agreement, evaluated using Cohen’s Kappa, ranged from 0.72 to 0.81, indicating substantial consistency. The annotated data reveals recurring patterns of disinformation, such as emotional manipulation, targeting of vulnerable individuals, and the strategic concealment of intent. Semantic relations between entities, such as CLAIM → EVIDENCE and CLAIM → AUTHOR_INTENT were formalized to represent disinformation narratives as knowledge graphs. This study contributes the first linguistically and culturally adapted annotation model for Kazakh and Russian languages, providing a robust and empirical resource for building interpretable and context-aware fake news detection systems. The resulting annotated corpus and its semantic structure offer valuable empirical material for further research in natural language processing, computational linguistics, and media studies in low-resource language environments.
Förderung
- Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan
Zitieren
APA
Sambetbayeva, M., Nekessova, A., Yerimbetova, A., Bayangali, A., Kaldarova, M., Telman, D., & Smailov, N. (2025). A Multi-Level Annotation Model for Fake News Detection: Implementing Kazakh-Russian Corpus via Label Studio. Big Data and Cognitive Computing, 9(8), 215. https://doi.org/10.3390/bdcc9080215
Vancouver
Sambetbayeva M, Nekessova A, Yerimbetova A, Bayangali A, Kaldarova M, Telman D, et al. A Multi-Level Annotation Model for Fake News Detection: Implementing Kazakh-Russian Corpus via Label Studio. Big Data and Cognitive Computing. 2025;9(8):215. doi:10.3390/bdcc9080215
BibTeX
@article{Sambetbayeva2025,
author = {Sambetbayeva, Madina and Nekessova, Anargul and Yerimbetova, Aigerim and Bayangali, Abdygalym and Kaldarova, Mira and Telman, Duman and Smailov, Nurzhigit},
title = {A Multi-Level Annotation Model for Fake News Detection: Implementing Kazakh-Russian Corpus via Label Studio},
journal = {Big Data and Cognitive Computing},
year = {2025},
volume = {9},
number = {8},
pages = {215},
doi = {10.3390/bdcc9080215}
}
EUVIMED