Integrating Prediction and Generation: A Lightweight Large Language Model Framework With Parameter Fusion for Personalized Feedback
IEEE Access · 2026 · 14 · 124842-124858
DOI: 10.1109/access.2026.3722042 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Zijie Zhang und 1 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jiangsu Province Education Science Planning Project, National-Level University Student Innovation and Entrepreneurship Project of Jiangsu University of Science and Technology.
Abstract (Originalsprache)
Predicting student performance and generating personalized pedagogical feedback are critical yet computationally demanding tasks in educational artificial intelligence (AI). Although large language models (LLMs) excel at both numerical prediction and text generation, their deployment is often hindered by high inference costs and difficulty in integrating heterogeneous learning objectives. This study proposes a lightweight LLM-based framework designed for joint performance prediction and feedback generation. The framework consists of three key components: 1) a feature engineering scheme that maps 11 categories of Massive Open Online Course (MOOC) learning behaviors into structured semantic representations, 2) a post-training parameter fusion strategy that decouples task-specific optimization before parameter fusion, and 3) a Low-Rank Adaptation (LoRA)-based parameter-efficient fine-tuning mechanism. We evaluated the framework using a real-world dataset containing 1,527 students from a Java programming MOOC. The experimental results demonstrate that behavioral feature-guided prompting enables high-quality feedback generation (ROUGE-1 F $1=0.76$ ). For student performance prediction, the standalone prediction model achieved an R2 value of 0.9882. Compared with direct joint multi-task learning, the proposed parameter fusion strategy maintained a strong predictive performance (R ${}^{2} =0.9624$ ) while preserving feedback generation quality. Furthermore, LoRA reduced the number of trainable parameters by more than 99.9%. The LoRA-based adaptation substantially reduced total training time while maintaining robust cross-cohort generalization performance (R ${}^{2} =0.9064$ ). These results indicate that parameter fusion and parameter-efficient fine-tuning provide effective solutions for integrating prediction and feedback generation in educational environments.
Förderung
- Jiangsu Province Education Science Planning Project
- National-Level University Student Innovation and Entrepreneurship Project of Jiangsu University of Science and Technology
Zitieren
APA
Zhang, Z., & Lu, Y. (2026). Integrating Prediction and Generation: A Lightweight Large Language Model Framework With Parameter Fusion for Personalized Feedback. IEEE Access, 14, 124842-124858. https://doi.org/10.1109/access.2026.3722042
Vancouver
Zhang Z, Lu Y. Integrating Prediction and Generation: A Lightweight Large Language Model Framework With Parameter Fusion for Personalized Feedback. IEEE Access. 2026;14:124842-124858. doi:10.1109/access.2026.3722042
BibTeX
@article{Zhang2026,
author = {Zhang, Zijie and Lu, Ye},
title = {Integrating Prediction and Generation: A Lightweight Large Language Model Framework With Parameter Fusion for Personalized Feedback},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {124842--124858},
doi = {10.1109/access.2026.3722042}
}
EUVIMED