From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data
Computational Humanities Research · 2025
DOI: 10.1017/chr.2025.10005 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Humanities Research, 2025. Verfasst von Jannis Klähn und 2 weiteren Autor:innen. Die Arbeit nennt 107 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In this study, we perform a comprehensive evaluation of sentiment classification for German language data using three different approaches: (1) dictionary-based methods, (2) fine-tuned transformer models such as BERT and XLM-T and (3) various large language models (LLMs) with zero-shot capabilities, including natural language inference models, Siamese models and dialog-based models. The evaluation considers a variety of German language datasets, including contemporary social media texts, product reviews and humanities datasets. Our results confirm that dictionary-based methods, while computationally efficient and interpretable, fall short in classification accuracy. Fine-tuned models offer strong performance, but require significant training data and computational resources. LLMs with zero-shot capabilities, particularly dialog-based models, demonstrate competitive performance, often rivaling fine-tuned models, while eliminating the need for task-specific training. However, challenges remain regarding non-determinism, prompt sensitivity and the high resource requirements of large LLMs. The results suggest that for sentiment analysis in the computational humanities, where non-English and historical language data are common, LLM-based zero-shot classification is a viable alternative to fine-tuned models and dictionaries. Nevertheless, model selection remains highly context-dependent, requiring careful consideration of trade-offs between accuracy, resource efficiency and transparency.
Zitieren
APA
Klähn, J., Borst-Graetz, J., & Burghardt, M. (2025). From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data. Computational Humanities Research. https://doi.org/10.1017/chr.2025.10005
Vancouver
Klähn J, Borst-Graetz J, Burghardt M. From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data. Computational Humanities Research. 2025. doi:10.1017/chr.2025.10005
BibTeX
@article{Klhn2025,
author = {Klähn, Jannis and Borst-Graetz, Janos and Burghardt, Manuel},
title = {From dictionaries to LLMs – an evaluation of sentiment analysis techniques for German language data},
journal = {Computational Humanities Research},
year = {2025},
doi = {10.1017/chr.2025.10005}
}
EUVIMED