EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Machine Learning Models for Automatic Classification of Programming Tasks in Python

Ginna Viviana Leytón-Yela, Hector Mora, Jesus Insuasti, John Barco-Jimenez

IEEE Revista Iberoamericana de Tecnologias del Aprendizaje · 2026 · 21 · 446-455

DOI: 10.1109/rita.2026.3703006 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 2026. Verfasst von Ginna Viviana Leytón-Yela und 3 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: MinCiencias, within the framework of the Bicentennial Scholarships cohort 1, through the doctoral program at the Universidad del Valle.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article presents a comparative analysis of automatic error classification in Python programming tasks involving loops, with a focus on machine learning approaches for identifying error types. Three experiments were conducted: the first evaluated traditional machine learning algorithms; the second explored alternative kernel functions in SVM and MLP algorithms; and the third involved two multi-input deep learning models. Following the CRISP-DM methodology, we compiled a dataset of 3000 looped programming tasks, each including a problem description in English, a Python solution, and a classification based on state errors formulated by Gries theory (initial S, final E, state transformation T, and their combinations, totaling seven labels). In preprocessing, the code was partitioned using its AST to align it with Gries states, and both the problem descriptions and code snippets were embedded with Bert, Code-bert, and Graph-code-bert. Ablations were performed to approximate the optimal solutions for each algorithm as closely as possible. The results showed that traditional machine learning algorithms achieved up to 90% accuracy and an MCC of 83%, while alternative kernels marginally improved performance but did not surpass that of traditional algorithms. Deep learning models (ANN-GCB) achieved the best balance, with 94% accuracy and 91% MCC, respectively, demonstrating their superiority for this classification task. The model was validated with external sources from different repositories, yielding an 85% success rate, and with a group of 138 students, achieving a 96.7% correct or partially correct classification rate.

Förderung

  • MinCiencias, within the framework of the Bicentennial Scholarships cohort 1, through the doctoral program at the Universidad del Valle

Zitieren

APA

Leytón-Yela, G. V., Mora, H., Insuasti, J., & Barco-Jimenez, J. (2026). Machine Learning Models for Automatic Classification of Programming Tasks in Python. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 21, 446-455. https://doi.org/10.1109/rita.2026.3703006

Vancouver

Leytón-Yela GV, Mora H, Insuasti J, Barco-Jimenez J. Machine Learning Models for Automatic Classification of Programming Tasks in Python. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje. 2026;21:446-455. doi:10.1109/rita.2026.3703006

BibTeX
@article{LeytnYela2026,
  author = {Leytón-Yela, Ginna Viviana and Mora, Hector and Insuasti, Jesus and Barco-Jimenez, John},
  title = {Machine Learning Models for Automatic Classification of Programming Tasks in Python},
  journal = {IEEE Revista Iberoamericana de Tecnologias del Aprendizaje},
  year = {2026},
  volume = {21},
  pages = {446--455},
  doi = {10.1109/rita.2026.3703006}
}
Kostenlos starten →