Short text classification with machine learning in the social sciences: The case of climate change on Twitter
PLOS ONE · 2023
DOI: 10.1371/journal.pone.0290762 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2023. Verfasst von Karina Shyrokykh und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Economic History and International Relations, Stockholm University, Stockholm, Sweden. Hauptthemen laut MEDLINE: Climate Change, Social Media. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Svenska Forskningsrådet Formas.
Abstract (Originalsprache)
To analyse large numbers of texts, social science researchers are increasingly confronting the challenge of text classification. When manual labeling is not possible and researchers have to find automatized ways to classify texts, computer science provides a useful toolbox of machine-learning methods whose performance remains understudied in the social sciences. In this article, we compare the performance of the most widely used text classifiers by applying them to a typical research scenario in social science research: a relatively small labeled dataset with infrequent occurrence of categories of interest, which is a part of a large unlabeled dataset. As an example case, we look at Twitter communication regarding climate change, a topic of increasing scholarly interest in interdisciplinary social science research. Using a novel dataset including 5,750 tweets from various international organizations regarding the highly ambiguous concept of climate change, we evaluate the performance of methods in automatically classifying tweets based on whether they are about climate change or not. In this context, we highlight two main findings. First, supervised machine-learning methods perform better than state-of-the-art lexicons, in particular as class balance increases. Second, traditional machine-learning methods, such as logistic regression and random forest, perform similarly to sophisticated deep-learning methods, whilst requiring much less training time and computational resources. The results have important implications for the analysis of short texts in social science research.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Economic History and International Relations, Stockholm University, Stockholm, Sweden.
ORCID-Profile: Karina Shyrokykh, Lisa Dellmuth
Förderung
- Svenska Forskningsrådet Formas
Zitieren
APA
Shyrokykh, K., Girnyk, M., & Dellmuth, L. (2023). Short text classification with machine learning in the social sciences: The case of climate change on Twitter. PLOS ONE. https://doi.org/10.1371/journal.pone.0290762
Vancouver
Shyrokykh K, Girnyk M, Dellmuth L. Short text classification with machine learning in the social sciences: The case of climate change on Twitter. PLOS ONE. 2023. doi:10.1371/journal.pone.0290762
BibTeX
@article{Shyrokykh2023,
author = {Shyrokykh, Karina and Girnyk, Max and Dellmuth, Lisa},
title = {Short text classification with machine learning in the social sciences: The case of climate change on Twitter},
journal = {PLOS ONE},
year = {2023},
doi = {10.1371/journal.pone.0290762}
}
EUVIMED