EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data

Jannis Klähn, Janos Borst-Graetz, Manuel Burghardt

Computational Humanities Research · 2025

DOI: 10.1017/chr.2025.10005 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Humanities Research, 2025. Verfasst von Jannis Klähn und 2 weiteren Autor:innen. Die Arbeit nennt 107 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this study, we perform a comprehensive evaluation of sentiment classification for German language data using three different approaches: (1) dictionary-based methods, (2) fine-tuned transformer models such as BERT and XLM-T and (3) various large language models (LLMs) with zero-shot capabilities, including natural language inference models, Siamese models and dialog-based models. The evaluation considers a variety of German language datasets, including contemporary social media texts, product reviews and humanities datasets. Our results confirm that dictionary-based methods, while computationally efficient and interpretable, fall short in classification accuracy. Fine-tuned models offer strong performance, but require significant training data and computational resources. LLMs with zero-shot capabilities, particularly dialog-based models, demonstrate competitive performance, often rivaling fine-tuned models, while eliminating the need for task-specific training. However, challenges remain regarding non-determinism, prompt sensitivity and the high resource requirements of large LLMs. The results suggest that for sentiment analysis in the computational humanities, where non-English and historical language data are common, LLM-based zero-shot classification is a viable alternative to fine-tuned models and dictionaries. Nevertheless, model selection remains highly context-dependent, requiring careful consideration of trade-offs between accuracy, resource efficiency and transparency.

Zitieren

APA

Klähn, J., Borst-Graetz, J., & Burghardt, M. (2025). From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data. Computational Humanities Research. https://doi.org/10.1017/chr.2025.10005

Vancouver

Klähn J, Borst-Graetz J, Burghardt M. From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data. Computational Humanities Research. 2025. doi:10.1017/chr.2025.10005

BibTeX
@article{Klhn2025,
  author = {Klähn, Jannis and Borst-Graetz, Janos and Burghardt, Manuel},
  title = {From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data},
  journal = {Computational Humanities Research},
  year = {2025},
  doi = {10.1017/chr.2025.10005}
}
Kostenlos starten →