EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Short text classification with machine learning in the social sciences: The case of climate change on Twitter

Karina Shyrokykh iD, Max Girnyk, Lisa Dellmuth iD

PLOS ONE · 2023

DOI: 10.1371/journal.pone.0290762 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2023. Verfasst von Karina Shyrokykh und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Economic History and International Relations, Stockholm University, Stockholm, Sweden. Hauptthemen laut MEDLINE: Climate Change, Social Media. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Svenska Forskningsrådet Formas.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To analyse large numbers of texts, social science researchers are increasingly confronting the challenge of text classification. When manual labeling is not possible and researchers have to find automatized ways to classify texts, computer science provides a useful toolbox of machine-learning methods whose performance remains understudied in the social sciences. In this article, we compare the performance of the most widely used text classifiers by applying them to a typical research scenario in social science research: a relatively small labeled dataset with infrequent occurrence of categories of interest, which is a part of a large unlabeled dataset. As an example case, we look at Twitter communication regarding climate change, a topic of increasing scholarly interest in interdisciplinary social science research. Using a novel dataset including 5,750 tweets from various international organizations regarding the highly ambiguous concept of climate change, we evaluate the performance of methods in automatically classifying tweets based on whether they are about climate change or not. In this context, we highlight two main findings. First, supervised machine-learning methods perform better than state-of-the-art lexicons, in particular as class balance increases. Second, traditional machine-learning methods, such as logistic regression and random forest, perform similarly to sophisticated deep-learning methods, whilst requiring much less training time and computational resources. The results have important implications for the analysis of short texts in social science research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Climate ChangeSocial MediaHumansCommunicationMachine LearningSupervised Machine Learning

Autor:innen und Institutionen

  • Department of Economic History and International Relations, Stockholm University, Stockholm, Sweden.

ORCID-Profile: Karina Shyrokykh, Lisa Dellmuth

Förderung

  • Svenska Forskningsrådet Formas

Zitieren

APA

Shyrokykh, K., Girnyk, M., & Dellmuth, L. (2023). Short text classification with machine learning in the social sciences: The case of climate change on Twitter. PLOS ONE. https://doi.org/10.1371/journal.pone.0290762

Vancouver

Shyrokykh K, Girnyk M, Dellmuth L. Short text classification with machine learning in the social sciences: The case of climate change on Twitter. PLOS ONE. 2023. doi:10.1371/journal.pone.0290762

BibTeX
@article{Shyrokykh2023,
  author = {Shyrokykh, Karina and Girnyk, Max and Dellmuth, Lisa},
  title = {Short text classification with machine learning in the social sciences: The case of climate change on Twitter},
  journal = {PLOS ONE},
  year = {2023},
  doi = {10.1371/journal.pone.0290762}
}
Kostenlos starten →