EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Comparison of commercial decoder-only large language models for multilingual sentiment analysis of short text

John Burns, Tom Kelsey

Journal of Social Media Research · 04.12.2025 · 2 (4) · 319-331

DOI: 10.29329/jsomer.38 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Social Media Research, online erschienen am 04.12.2025. Verfasst von John Burns und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article explores multilingual sentiment analysis of short texts using three commercial decoder-only Large Language Models (“LLMs” ): OpenAI’s ChatGPT, Anthropic’s Claude, and Google’s Gemini. The training data for these models is approximately 90% English, and it remains an open question whether it is better to evaluate text data in its original language or translate it into English first. We build on previous research on sentiment analysis of multilingual short texts, such as those found on social media, using 1000 short text samples in seven languages (English, Spanish, French, Portuguese, Arabic, Japanese, and Korean) translated into English using Google Translate. We processed these samples with decoder-only LLMs and compared their results with those from other methods (encoder-only LLMs, RNNs, lexicons). We found that decoder-only LLMs achieved the highest accuracy across all sentiment analysis methods when working with the original language data. The only exception was with the French data, where an RNN was the most accurate. Among the three decoder-only LLMs, ChatGPT had the highest accuracy in four of the seven languages, Claude in two, and Gemini, which ranked second in six of the seven languages.

Zitieren

APA

Burns, J., & Kelsey, T. (2025). Comparison of commercial decoder-only large language models for multilingual sentiment analysis of short text. Journal of Social Media Research, 2(4), 319-331. https://doi.org/10.29329/jsomer.38

Vancouver

Burns J, Kelsey T. Comparison of commercial decoder-only large language models for multilingual sentiment analysis of short text. Journal of Social Media Research. 2025;2(4):319-331. doi:10.29329/jsomer.38

BibTeX
@article{Burns2025,
  author = {Burns, John and Kelsey, Tom},
  title = {Comparison of commercial decoder-only large language models for multilingual sentiment analysis of short text},
  journal = {Journal of Social Media Research},
  year = {2025},
  volume = {2},
  number = {4},
  pages = {319--331},
  doi = {10.29329/jsomer.38}
}
Kostenlos starten →