EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Beyond standardization: a comprehensive review of topic modeling validation methods for computational social science research

Jana Bernhard-Harrer, Randa Ashour, Jakob-Moritz Eberl, Petro Tolochko, Hajo Boomgaarden

Political Science Research and Methods · 2026-07 · 14 (3) · 833-851

DOI: 10.1017/psrm.2025.10008 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Political Science Research and Methods, online erschienen am 30.06.2025. Verfasst von Jana Bernhard-Harrer und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As the use of computational text analysis in the social sciences has increased, topic modeling has emerged as a popular method for identifying latent themes in textual data. Nevertheless, concerns have been raised regarding the validity of the results produced by this method, given that it is largely automated and inductive in nature, and the lack of clear guidelines for validating topic models has been identified by scholars as an area of concern. In response, we conducted a comprehensive systematic review of 789 studies that employ topic modeling. Our goal is to investigate whether the field is moving toward a common framework for validating these models. The findings of our review indicate a notable absence of standardized validation practices and a lack of convergence toward specific methods of validation. This gap may be attributed to the inherent incompatibility between the inductive, qualitative approach of topic modeling and the deductive, quantitative tradition that favors standardized validation. To address this, we advocate for incorporating qualitative validation approaches, emphasizing transparency and detailed reporting to improve the credibility of findings in computational social science research when using topic modeling.

Zitieren

APA

Bernhard-Harrer, J., Ashour, R., Eberl, J., Tolochko, P., & Boomgaarden, H. (2026). Beyond standardization: a comprehensive review of topic modeling validation methods for computational social science research. Political Science Research and Methods, 14(3), 833-851. https://doi.org/10.1017/psrm.2025.10008

Vancouver

Bernhard-Harrer J, Ashour R, Eberl J, Tolochko P, Boomgaarden H. Beyond standardization: a comprehensive review of topic modeling validation methods for computational social science research. Political Science Research and Methods. 2026;14(3):833-851. doi:10.1017/psrm.2025.10008

BibTeX
@article{BernhardHarrer2026,
  author = {Bernhard-Harrer, Jana and Ashour, Randa and Eberl, Jakob-Moritz and Tolochko, Petro and Boomgaarden, Hajo},
  title = {Beyond standardization: a comprehensive review of topic modeling validation methods for computational social science research},
  journal = {Political Science Research and Methods},
  year = {2026},
  volume = {14},
  number = {3},
  pages = {833--851},
  doi = {10.1017/psrm.2025.10008}
}
Kostenlos starten →