Comparison of Convolutional Neural Network and Support Vector Machine for Student Question Classification in ChatGPT-based Learning Tools
Building of Informatics, Technology and Science (BITS) · 02.09.2025 · 7 (2) · 1049-1056
DOI: 10.47065/bits.v7i2.7841 ↗Kurz gefasst
Fachartikel in der Zeitschrift Building of Informatics, Technology and Science (BITS), online erschienen am 02.09.2025. Verfasst von Brilliant Jordan und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Artificial Intelligence (AI) has revolutionized educational tools by enabling systems that proactively understand and respond to student needs. ChatGPT, a widely used generative model for education in Indonesia. However, it struggles to classify student questions accurately due to ambiguous phrasing, overlapping sentence structures, and difficulty recognizing intent, which limits its effectiveness as a learning assistant. This study compares the performance of Convolutional Neural Networks (CNN), which extract locally important features from word sequences with Support Vector Machines (SVM) in classifying student questions known for handling high-dimensional data and efficiently finding the optimal hyperplane for text classification. A dataset of 2,797 Indonesian ChatGPT interactions (71% clear vs. 29% unclear) was preprocessed through case folding, stop-word removal, stemming, and tokenisation, followed by data augmentation based on synonyms, which was applied to the minority class to balance the dataset. The models were tuned through grid or random search with prediction testing of the best model using 5-fold cross-validation comparisons across three data splits (70:30, 80:20, and 90:10). Results showed that CNN achieved balanced accuracy, precision, recall, and F1-score of 0.90 on the 90:10 split, outperforming SVM, which plateaued at 0.85 accuracy and dropped to 0.76 in F1-score. The embedded filters of the CNN found generality from lexical variation through the process of augmentation, while the TF-IDF sparse vectors in the SVM failed to maintain this level of semantics. These findings underscore that CNN is more adaptive to diverse data and better suited for integration into ChatGPT-based educational tools, particularly in supporting reliable classification and personalised AI feedback in student learning contexts.
Zitieren
APA
Jordan, B., & Lhaksmana, K. M. (2025). Comparison of Convolutional Neural Network and Support Vector Machine for Student Question Classification in ChatGPT-based Learning Tools. Building of Informatics, Technology and Science (BITS), 7(2), 1049-1056. https://doi.org/10.47065/bits.v7i2.7841
Vancouver
Jordan B, Lhaksmana KM. Comparison of Convolutional Neural Network and Support Vector Machine for Student Question Classification in ChatGPT-based Learning Tools. Building of Informatics, Technology and Science (BITS). 2025;7(2):1049-1056. doi:10.47065/bits.v7i2.7841
BibTeX
@article{Jordan2025,
author = {Jordan, Brilliant and Lhaksmana, Kemas Muslim},
title = {Comparison of Convolutional Neural Network and Support Vector Machine for Student Question Classification in ChatGPT-based Learning Tools},
journal = {Building of Informatics, Technology and Science (BITS)},
year = {2025},
volume = {7},
number = {2},
pages = {1049--1056},
doi = {10.47065/bits.v7i2.7841}
}
EUVIMED