EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Factual2: Extending a Romanian Fact-Checking Corpus with Speaker Credibility Histories for Leak-Aware Veracity Classification

Marian Bucos, Bogdan Drăgulescu

Electronics · 2026-11-12 · 15 (22) · 5248

DOI: 10.3390/electronics15225248 ↗

At a glance

Journal article in Electronics, published online on 2026-11-12. Written by Marian Bucos and 1 co-authors. 28 references. The full text is freely available (open access, CC BY 4.0). Funded by: Politehnica University Timisoara.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Credibility history, the per-speaker count of past verdicts, is an important metadata feature in fact-checking benchmarks. This feature can be misused: including credibility history for all examples in the corpus embeds the truthfulness label in the feature vector. We present Factual2, a Romanian fact-checking corpus of 1958 political statements by 417 speakers from factual.ro, annotated with five veracity classes. To our knowledge, Factual2 is the first Romanian corpus to deal with credibility history in a controlled leakage setting. The count vectors are created using Leak-Free Aggregation (LFA), with self-exclusion, cold-start policy, and a stricter causal variant (LFA-temporal). Two leaky approaches are presented for diagnostic purposes; four label schemes and three segmentation protocols are available. The key results are: (i) Pre-Split Aggregation (PSA) overestimates the classification performance of LFA counts by 0.20 macro-F1 in the 5-class setting (0.484 vs. 0.285). (ii) In the hard binary setup, the leaky classifier achieves a macro-F1 of 0.798 in the speaker-disjoint setting, while the honest classifier achieves 0.393, which implies that the gap is due to leakage. (iii) Using the temporal protocol, the honest counts achieve 0.784 macro-F1, equal to the speaker-identity baseline; the maximum gain of the honest approach across the grid is 0.051.

Funding

  • Politehnica University Timisoara

Cite

APA

Bucos, M., & Drăgulescu, B. (2026). Factual2: Extending a Romanian Fact-Checking Corpus with Speaker Credibility Histories for Leak-Aware Veracity Classification. Electronics, 15(22), 5248. https://doi.org/10.3390/electronics15225248

Vancouver

Bucos M, Drăgulescu B. Factual2: Extending a Romanian Fact-Checking Corpus with Speaker Credibility Histories for Leak-Aware Veracity Classification. Electronics. 2026;15(22):5248. doi:10.3390/electronics15225248

BibTeX
@article{Bucos2026,
  author = {Bucos, Marian and Drăgulescu, Bogdan},
  title = {Factual2: Extending a Romanian Fact-Checking Corpus with Speaker Credibility Histories for Leak-Aware Veracity Classification},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {22},
  pages = {5248},
  doi = {10.3390/electronics15225248}
}
Start for free →