Automatic Detection of the Bulgarian Evidential Renarrative
Computational Linguistics in Bulgaria · 2025
DOI: 10.47810/jclib.1.2025.04 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Linguistics in Bulgaria, 2025. Verfasst von Irina Temnikova und 6 weiteren Autor:innen.
Abstract (Originalsprache)
Manual and automatic verification of the trustworthiness of information is an important task. Knowing whether the author of a statement was an eyewitness to the reported event(s) is a useful clue. In linguistics, such information is expressed through “evidentiality”. Evidentials are especially important in Bulgarian, as Bulgarian journalists often use a specific type of evidential (“renarrative”) to report events that they did not directly observe, nor verify. Unfortunately, there are no automatic tools to detect Bulgarian renarrative. This article presents the first two automatic solutions for this task. Specifically – a fine-tuned BERT classifier (renarrative BERT detector, BGRenBERT), achieving 0.98 Accuracy on the test split, and a renarrative rule-based detector (BGRenRules), created with regular expressions, matching a parser’s output. Both solutions detect Bulgarian texts containing the most frequently encountered forms of renarrative. Additionally, we compare the results of the two detectors with the manual annotation of subsets of two Bulgarian fake text datasets. BGRenRules obtains substantially higher results than BGRenBERT. The error analysis shows that the errors from BGRenRules most frequently correspond to cases in which humans also have doubts. The training dataset (BgRenData), the annotated dataset subsets, and the two detectors are made publicly accessible on Zenodo, GitHub, and HuggingFace. We expect that these new resources will be of invaluable assistance to 1) Bulgarian-language researchers, 2) researchers of other languages with similar phenomena, especially those working on verifying information.
Zitieren
APA
Temnikova, I., Margova, R., Minkov, S., Stefanova, T., Grigorova, N., Gargova, S., & Kovatchev, V. (2025). Automatic Detection of the Bulgarian Evidential Renarrative. Computational Linguistics in Bulgaria. https://doi.org/10.47810/jclib.1.2025.04
Vancouver
Temnikova I, Margova R, Minkov S, Stefanova T, Grigorova N, Gargova S, et al. Automatic Detection of the Bulgarian Evidential Renarrative. Computational Linguistics in Bulgaria. 2025. doi:10.47810/jclib.1.2025.04
BibTeX
@article{Temnikova2025,
author = {Temnikova, Irina and Margova, Ruslana and Minkov, Stefan and Stefanova, Tsvetelina and Grigorova, Nevena and Gargova, Silvia and Kovatchev, Venelin},
title = {Automatic Detection of the Bulgarian Evidential Renarrative},
journal = {Computational Linguistics in Bulgaria},
year = {2025},
doi = {10.47810/jclib.1.2025.04}
}
EUVIMED