EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

User Review Analysis: Psychological Impact of Duolingo Gamification Using Machine Learning

Septi Mulia Putri, Ken Ditha Tania

Journal of Applied Informatics and Computing · 23.04.2026 · 10 (2) · 1886-1896

DOI: 10.30871/jaic.v10i2.12476 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Applied Informatics and Computing, online erschienen am 23.04.2026. Verfasst von Septi Mulia Putri und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Gamification in Duolingo aims to enhance user motivation, yet its internal elements trigger diverse psychological responses. This study aims to analyze these responses through app reviews by comparing the effectiveness of four machine learning models, namely Naïve Bayes, Random Forest, Support Vector Machine (SVM), and Logistic Regression. The research design employs a quantitative comparative approach with review data classified into three labels, including Motivated, Frustrated, and Neutral. The methodology involves text preprocessing, label encoding, and addressing data imbalance using SMOTE and Class Weight techniques. The results indicate that all models achieved high accuracy, ranging from 92% to 93%. However, based on the Macro Average F1-Score metric, which measures the model’s performance balance across all classes including minority ones, the SVM and Logistic Regression models delivered the most optimal performance with a score of 0.44, outperforming Naïve Bayes and Random Forest, which scored 0.40. Feature analysis through Feature Importance reveals that the Penalty feature is the dominant factor triggering frustrated conditions, whereas the Daily Challenge feature serves as a strong predictor despite its low frequency. In conclusion, SVM and Logistic Regression are the most reliable models for mapping user emotional responses, where the findings regarding the Penalty feature provide a critical evaluation for the development of gamification mechanics.

Zitieren

APA

Putri, S. M., & Tania, K. D. (2026). User Review Analysis: Psychological Impact of Duolingo Gamification Using Machine Learning. Journal of Applied Informatics and Computing, 10(2), 1886-1896. https://doi.org/10.30871/jaic.v10i2.12476

Vancouver

Putri SM, Tania KD. User Review Analysis: Psychological Impact of Duolingo Gamification Using Machine Learning. Journal of Applied Informatics and Computing. 2026;10(2):1886-1896. doi:10.30871/jaic.v10i2.12476

BibTeX
@article{Putri2026,
  author = {Putri, Septi Mulia and Tania, Ken Ditha},
  title = {User Review Analysis: Psychological Impact of Duolingo Gamification Using Machine Learning},
  journal = {Journal of Applied Informatics and Computing},
  year = {2026},
  volume = {10},
  number = {2},
  pages = {1886--1896},
  doi = {10.30871/jaic.v10i2.12476}
}
Kostenlos starten →