An evaluation of LLMs for generating movie reviews: GPT-4o, Gemini-2.0 and DeepSeek-V3
Neural Computing and Applications · 2026-07 · 38 (13)
DOI: 10.1007/s00521-026-12247-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Computing and Applications, online erschienen am 27.06.2026. Verfasst von Brendan Sands und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 100 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of New South Wales.
Abstract (Originalsprache)
Large language models (LLMs) have been prominent in various tasks, including text generation and summarisation. The applicability of LLMs to the generation of product reviews is gaining momentum, paving the way for the generation of movie reviews. In this study, we propose a framework that generates movie reviews using three LLMs (GPT-4o, DeepSeek-V3, and Gemini-2.0), and evaluate their performance by comparing the generated outputs with IMDb user reviews. We use movie subtitles and screenplays as input to the LLMs and investigate how they affect the quality of reviews generated. We review the LLM-based movie reviews in terms of vocabulary, sentiment polarity, similarity, and thematic consistency in comparison to IMDB user reviews. The results demonstrate that LLMs are capable of generating syntactically fluent and structurally complete movie reviews. Nevertheless, we find a noticeable gap in emotional richness and stylistic coherence between LLM-generated and IMDb reviews, suggesting that further refinement is needed to improve the overall quality of movie review generation. We finally conduct a survey-based human analysis, where participants distinguish between LLM and IMDb user reviews. The results show that LLM-generated reviews were generally difficult to distinguish from IMDB user reviews. We find that DeepSeek-V3 produced the most balanced reviews, closely matching IMDb reviews. GPT-4o overemphasised positive emotions, while Gemini-2.0 captured negative emotions better but showed excessive emotional intensity.
Förderung
- University of New South Wales
Zitieren
APA
Sands, B., Wang, Y., Xu, C., Zhou, Y., Wei, L., & Chandra, R. (2026). An evaluation of LLMs for generating movie reviews: GPT-4o, Gemini-2.0 and DeepSeek-V3. Neural Computing and Applications, 38(13). https://doi.org/10.1007/s00521-026-12247-0
Vancouver
Sands B, Wang Y, Xu C, Zhou Y, Wei L, Chandra R. An evaluation of LLMs for generating movie reviews: GPT-4o, Gemini-2.0 and DeepSeek-V3. Neural Computing and Applications. 2026;38(13). doi:10.1007/s00521-026-12247-0
BibTeX
@article{Sands2026,
author = {Sands, Brendan and Wang, Yining and Xu, Chenhao and Zhou, Yuxuan and Wei, Lai and Chandra, Rohitash},
title = {An evaluation of LLMs for generating movie reviews: GPT-4o, Gemini-2.0 and DeepSeek-V3},
journal = {Neural Computing and Applications},
year = {2026},
volume = {38},
number = {13},
doi = {10.1007/s00521-026-12247-0}
}
EUVIMED