EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Artificial intelligence based personalized student feedback system -Sisu Athwala’ to enhance exam performance of medical undergraduates

Thilanka Seneviratne iD, Supun Manathunga, Wathsala Idirisingha, Kosala Somaratne, Kosala Marambe, Udaya Dangahadeniya

PLOS One · 04.12.2025 · 20 (12) · e0336154

DOI: 10.1371/journal.pone.0336154 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 04.12.2025. Verfasst von Thilanka Seneviratne und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pharmacology, Faculty of Medicine, University of Peradeniya, Peradeniya, Sri Lanka. Hauptthemen laut MEDLINE: Artificial Intelligence, Students, Medical, Education, Medical, Undergraduate, Educational Measurement. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In medical education, mentoring and feedback play crucial roles. Providing feedback on exam performance is a vital component as it allows students to improve. Feedback has to be tailor made and specific to the individual student. This needs lot of time and human resources, which are always not in abundance. Use of artificial intelligence (AI) is a promising proposition yet it comes with the integral problem of generating inaccurate responses by the Large language models (LLM). To alleviate and minimize this, we have developed our unique model ‘Sisu Athwala’ using retrieval augment generation (RAG) with custom LLM’s.

Objective

To design and implement an AI-based tool using RAG to provide customized feedback to medical students to enhance their exam performance, minimizing the risk of generating inaccurate responses by the LLM’s. To evaluate the AI tool by expert student mentors and by the end users.

Methods

The study was conducted at the Faculty of Medicine, University of Peradeniya, Sri Lanka. An AI based feedback tool was developed powered by Generative Pre-trained Transformers-4 (GPT-4) LLM using a RAG pipeline. Expert instruction sets were used to develop the data base through embedding model to minimize potential inaccuracies and biases. To generate user queries, students were provided with a self-evaluation form which was processed using Representative Vector Summarization (RVS). Hence most critical concerns of each student are distilled and captured accurately, minimizing noise or irrelevant details. The role of the AI tool was defined as a counsellor during Pre-processional alignment allowing professional manner throughout the interaction. User queries were processed using Open AI Application Programming Interface (API), utilizing GPT-4-turbo LLM. Students were invited to engage in conversations with the newly developed feedback tool. The AI tool was evaluated by the expert student mentors, as per its ability to give personalized feedback, use varied language expressions, and to introduce novel perspectives to students. End user perception on the use of AI tool was assessed using a questionnaire.

Results

Post implementation end user survey of the Sisu Athwala AI tool was largely positive. 92% mentioned the advices given by the tool on stress management were helpful. 60% believed that the study techniques suggested were useful. While further 60% thought they are comfortable using the tool. 52% find the advices on exam performances were helpful. In their open comments some suggested to have the tool as a mobile APP. 15 expert student mentors took part in evaluating the tool. 100% agreed that it effectively addressed key points of student strengths and identifies areas for improvements going by the Pendleton model. 90% agreed that Sisu- Athwala gives clear actionable plans.

Conclusion

Sisu Athwala AI tool provided comprehensive tailor made feedback and guidance to medical students which was well received by the end users. Expert student mentors evaluation of the material generated by the AI tool were quite positive. Though this is not a replacement for human mentors it supports mentoring to be delivered circumventing the human resource constraints.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceStudents, MedicalEducation, Medical, UndergraduateEducational MeasurementHumansFeedbackSri LankaFormative Feedback

Autor:innen und Institutionen

  • Department of Pharmacology, Faculty of Medicine, University of Peradeniya, Peradeniya, Sri Lanka.
  • Department of Surgery, District Base Hospital, Theldeniya, Sri Lanka.
  • Department of Medical Education, Faculty of Medicine, University of Peradeniya, Peradeniya, Sri Lanka.

ORCID-Profile: Thilanka Seneviratne

Zitieren

APA

Seneviratne, T., Manathunga, S., Idirisingha, W., Somaratne, K., Marambe, K., & Dangahadeniya, U. (2025). Artificial intelligence based personalized student feedback system -Sisu Athwala’ to enhance exam performance of medical undergraduates. PLOS One, 20(12), e0336154. https://doi.org/10.1371/journal.pone.0336154

Vancouver

Seneviratne T, Manathunga S, Idirisingha W, Somaratne K, Marambe K, Dangahadeniya U. Artificial intelligence based personalized student feedback system -Sisu Athwala’ to enhance exam performance of medical undergraduates. PLOS One. 2025;20(12):e0336154. doi:10.1371/journal.pone.0336154

BibTeX
@article{Seneviratne2025,
  author = {Seneviratne, Thilanka and Manathunga, Supun and Idirisingha, Wathsala and Somaratne, Kosala and Marambe, Kosala and Dangahadeniya, Udaya},
  title = {Artificial intelligence based personalized student feedback system -Sisu Athwala’ to enhance exam performance of medical undergraduates},
  journal = {PLOS One},
  year = {2025},
  volume = {20},
  number = {12},
  pages = {e0336154},
  doi = {10.1371/journal.pone.0336154}
}
Kostenlos starten →