EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automatic Sentiment Annotation Using Grok AI for Opinion Mining in a University Learning Management System

Indri Tri Julianto, Muhammad Affan Al Sidqi

Journal of Intelligent Systems Technology and Informatics · 2025

DOI: 10.64878/jistics.v1i3.42 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Intelligent Systems Technology and Informatics, 2025. Verfasst von Indri Tri Julianto und 1 weiteren Autor:innen. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sentiment analysis has become an essential tool in evaluating user feedback on digital learning platforms. Understanding student sentiments toward Learning Management Systems (LMS) in higher education can offer critical insights for system development and service improvement. This study aims to evaluate the effectiveness of AI-assisted sentiment labeling using Grok AI and ChatGPT compared to manual labeling for sentiment classification of student opinions on LMS at Institut Teknologi Garut. The research involved distributing an online questionnaire to 96 students across four academic levels, collecting open-ended responses regarding their LMS usage experiences. These responses were preprocessed through case folding, cleaning, tokenization, stopword removal, and stemming. The sentiment labels were assigned using Grok AI, ChatGPT, and manual annotation, and the resulting datasets were used to build classification models using the Naïve Bayes algorithm in Altair RapidMiner with 10-Fold Cross Validation. The performance evaluation shows that manual labeling yielded the highest accuracy (52.22%) and Cohen's Kappa (0.137), followed by ChatGPT (50.11%, 0.119) and Grok AI (48.00%, 0.087). Word cloud visualizations further revealed the dominant themes within each sentiment class, indicating that positive opinions emphasized helpfulness and ease of use, while negative ones focused on access issues and system lags. This research suggests that AI-assisted labeling methods can be viable alternatives, although manual labeling still offers slightly better accuracy.

Zitieren

APA

Julianto, I. T., & Sidqi, M. A. A. (2025). Automatic Sentiment Annotation Using Grok AI for Opinion Mining in a University Learning Management System. Journal of Intelligent Systems Technology and Informatics. https://doi.org/10.64878/jistics.v1i3.42

Vancouver

Julianto IT, Sidqi MAA. Automatic Sentiment Annotation Using Grok AI for Opinion Mining in a University Learning Management System. Journal of Intelligent Systems Technology and Informatics. 2025. doi:10.64878/jistics.v1i3.42

BibTeX
@article{Julianto2025,
  author = {Julianto, Indri Tri and Sidqi, Muhammad Affan Al},
  title = {Automatic Sentiment Annotation Using Grok AI for Opinion Mining in a University Learning Management System},
  journal = {Journal of Intelligent Systems Technology and Informatics},
  year = {2025},
  doi = {10.64878/jistics.v1i3.42}
}
Kostenlos starten →