A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models
ACM Transactions on Intelligent Systems and Technology · 30.04.2026 · 17 (2) · 1-80
DOI: 10.1145/3770077 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, erschienen am 30.04.2026. Verfasst von Ivan Srba und 12 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 373 Literaturangaben. Gefördert von: European Union under the Horizon Europe projects: vera.ai, AI-CODE, AI4TRUST.
Abstract (Originalsprache)
In the age of social media and generative AI, the ability to automatically assess the credibility of online content has become increasingly critical, complementing traditional approaches to false information detection. Credibility assessment relies on aggregating diverse credibility signals—small units of information, such as content subjectivity, bias or a presence of persuasion techniques—into a final credibility label/score. However, current research in automatic credibility assessment and credibility signals detection remains highly fragmented, with many signals studied in isolation and lacking integration. Notably, there is a scarcity of approaches that detect and aggregate multiple credibility signals simultaneously. These challenges are further exacerbated by the absence of a comprehensive and up-to-date overview of research works that connects these research efforts under a common framework and identifies shared trends, challenges and open problems. In this survey, we address this gap by presenting a systematic and comprehensive literature review of 175 research papers, focusing on textual credibility signals within the field of Natural Language Processing (NLP), which undergoes a rapid transformation due to advancements in Large Language Models (LLMs). While positioning the NLP research into the broader multidisciplinary landscape, we examine both automatic credibility assessment methods as well as the detection of nine categories of credibility signals. We provide an in-depth analysis of three key categories: (1) factuality, subjectivity and bias, (2) persuasion techniques and logical fallacies and (3) check-worthy and fact-checked claims. In addition to summarising existing methods, datasets and tools, we outline future research direction and emerging opportunities, with particular attention to evolving challenges posed by generative AI.
Förderung
- European Union under the Horizon Europe projects: vera.ai
- AI-CODE
- AI4TRUST
- UK’s innovation agency
- EU NextGenerationEU through the Recovery and Resilience Plan for Slovakia
Zitieren
APA
Srba, I., Razuvayevskaya, O., Leite, J. A., Moro, R., Schlicht, I. B., Tonelli, S., García, F. M., Lottmann, S. B., Teyssou, D., Porcellini, V., Scarton, C., Bontcheva, K., & Bielikova, M. (2026). A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models. ACM Transactions on Intelligent Systems and Technology. https://doi.org/10.1145/3770077
Vancouver
Srba I, Razuvayevskaya O, Leite JA, Moro R, Schlicht IB, Tonelli S, et al. A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models. ACM Transactions on Intelligent Systems and Technology. 2026. doi:10.1145/3770077
BibTeX
@article{Srba2026,
author = {Srba, Ivan and Razuvayevskaya, Olesya and Leite, João A. and Moro, Robert and Schlicht, Ipek Baris and Tonelli, Sara and García, Francisco Moreno and Lottmann, Santiago Barrio and Teyssou, Denis and Porcellini, Valentin and Scarton, Carolina and Bontcheva, Kalina and Bielikova, Maria},
title = {A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models},
journal = {ACM Transactions on Intelligent Systems and Technology},
year = {2026},
doi = {10.1145/3770077}
}
EUVIMED