Comparative Analysis of Direct Prompting and Retrieval- Augmented Generation for PL/SQL Educational Support
Proceedings of the International Conference on Business Excellence · 01.07.2026 · 20 (1) · 2366-2381
DOI: 10.2478/picbe-2026-0180 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the International Conference on Business Excellence, online erschienen am 15.07.2026. Verfasst von Denisa-Maria IORDACHE und 2 weiteren Autor:innen. Die Arbeit nennt 9 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Virtual assistants for students represent an important application of Large Language Models in education by offering academic support without program limitations. However, finding the model that works best as an assistant and measuring the effect that Retrieval-Augmented Generation has over direct prompting in technical courses are aspects that can still be explored. We configured, tested and compared six virtual student assistants for a PL/SQL Database Programming course. We selected three Large Language Models, including OpenAI GPT-5.2, Anthropic Claude Opus 4.6 and Google Gemini 3 Pro, for analysing two different scenarios. In the first one, the models received a system prompt to guide their behaviour and the response was based only on the models’ built-in knowledge. For the second scenario, beside system prompting, we used Retrieval-Augmented Generation, where answers were anchored in the official Oracle documentation. To evaluate the results, we used the RAGAs framework, which looks at faithfulness, answer relevancy, answer correctness, context precision. For the evaluator model in RAGAs framework, we selected GPT-4o. Standard natural language processing metrics, like ROUGE, BLEU, METEOR and BERT Score, were used to round out the evaluation. The results show that the access to official documentation improves faithfulness across all models. GPT-5.2 achieved the highest faithfulness score of 0.69. Answer correctness scores show a difference between the reference answers and the longer and more detailed model responses. The study offers a framework for evaluating multiple models and gives practical advice for institutions that want to integrate virtual student assistants in technical classes.
Zitieren
APA
IORDACHE, D., TUDOR, A., & OPREA, S. (2026). Comparative Analysis of Direct Prompting and Retrieval- Augmented Generation for PL/SQL Educational Support. Proceedings of the International Conference on Business Excellence, 20(1), 2366-2381. https://doi.org/10.2478/picbe-2026-0180
Vancouver
IORDACHE D, TUDOR A, OPREA S. Comparative Analysis of Direct Prompting and Retrieval- Augmented Generation for PL/SQL Educational Support. Proceedings of the International Conference on Business Excellence. 2026;20(1):2366-2381. doi:10.2478/picbe-2026-0180
BibTeX
@article{IORDACHE2026,
author = {IORDACHE, Denisa-Maria and TUDOR, Alexandru-Ștefan and OPREA, Simona-Vasilica},
title = {Comparative Analysis of Direct Prompting and Retrieval- Augmented Generation for PL/SQL Educational Support},
journal = {Proceedings of the International Conference on Business Excellence},
year = {2026},
volume = {20},
number = {1},
pages = {2366--2381},
doi = {10.2478/picbe-2026-0180}
}
EUVIMED