EUVIMEDEUVIMED entdecken
Crossref

Introduction to Neural Transfer Learning With Transformers for Social Science Text Analysis

Sandra Wankmüller

Sociological Methods & Research · 2024-11 · 53 (4) · 1676-1752

DOI: 10.1177/00491241221134527 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sociological Methods & Research, online erschienen am 20.12.2022. Verfasst von Sandra Wankmüller. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 234 Literaturangaben. Gefördert von: Studienstiftung des Deutschen Volkes.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformer-based models for transfer learning have the potential to achieve high prediction accuracies on text-based supervised learning tasks with relatively few training data instances. These models are thus likely to benefit social scientists that seek to have as accurate as possible text-based measures, but only have limited resources for annotating training data. To enable social scientists to leverage these potential benefits for their research, this article explains how these methods work, why they might be advantageous, and what their limitations are. Additionally, three Transformer-based models for transfer learning, BERT, RoBERTa, and the Longformer, are compared to conventional machine learning algorithms on three applications. Across all evaluated tasks, textual styles, and training data set sizes, the conventional models are consistently outperformed by transfer learning with Transformers, thereby demonstrating the benefits these models can bring to text-based social science research.

Förderung

  • Studienstiftung des Deutschen Volkes

Zitieren

APA

Wankmüller, S. (2024). Introduction to Neural Transfer Learning With Transformers for Social Science Text Analysis. Sociological Methods & Research, 53(4), 1676-1752. https://doi.org/10.1177/00491241221134527

Vancouver

Wankmüller S. Introduction to Neural Transfer Learning With Transformers for Social Science Text Analysis. Sociological Methods & Research. 2024;53(4):1676-1752. doi:10.1177/00491241221134527

BibTeX
@article{Wankmller2024,
  author = {Wankmüller, Sandra},
  title = {Introduction to Neural Transfer Learning With Transformers for Social Science Text Analysis},
  journal = {Sociological Methods & Research},
  year = {2024},
  volume = {53},
  number = {4},
  pages = {1676--1752},
  doi = {10.1177/00491241221134527}
}
Kostenlos starten →