EUVIMEDEUVIMED entdecken
Crossref

Toward Automated Factchecking

Lev Konstantinovskiy, Oliver Price, Mevan Babakar, Arkaitz Zubiaga

Digital Threats: Research and Practice · 30.06.2021 · 2 (2) · 1-16

DOI: 10.1145/3412869 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Digital Threats: Research and Practice, online erschienen am 15.04.2021. Verfasst von Lev Konstantinovskiy und 3 weiteren Autor:innen. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: Open Society Foundation, Omidyar Network.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim. It consists of identifying the set of sentences, out of a long text, deemed capable of being factchecked. This article is a collaborative work between Full Fact, an independent factchecking charity, and academic partners. Leveraging the expertise of professional factcheckers, we develop an annotation schema and a benchmark for automated claim detection that is more consistent across time, topics, and annotators than are previous approaches. Our annotation schema has been used to crowdsource the annotation of a dataset with sentences from UK political TV shows. We introduce an approach based on universal sentence representations to perform the classification, achieving an F1 score of 0.83, with over 5% relative improvement over the state-of-the-art methods ClaimBuster and ClaimRank. The system was deployed in production and received positive user feedback.

Förderung

  • Open Society Foundation
  • Omidyar Network

Zitieren

APA

Konstantinovskiy, L., Price, O., Babakar, M., & Zubiaga, A. (2021). Toward Automated Factchecking. Digital Threats: Research and Practice, 2(2), 1-16. https://doi.org/10.1145/3412869

Vancouver

Konstantinovskiy L, Price O, Babakar M, Zubiaga A. Toward Automated Factchecking. Digital Threats: Research and Practice. 2021;2(2):1-16. doi:10.1145/3412869

BibTeX
@article{Konstantinovskiy2021,
  author = {Konstantinovskiy, Lev and Price, Oliver and Babakar, Mevan and Zubiaga, Arkaitz},
  title = {Toward Automated Factchecking},
  journal = {Digital Threats: Research and Practice},
  year = {2021},
  volume = {2},
  number = {2},
  pages = {1--16},
  doi = {10.1145/3412869}
}
Kostenlos starten →