Research on an intelligent tutoring system based on automatic construction of multimodal knowledge graphs and retrieval-augmented generation
Frontiers in Computer Science · 25.02.2026 · 8
DOI: 10.3389/fcomp.2026.1777749 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 25.02.2026. Verfasst von Chao Deng und 1 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
As a key application of technology-enhanced learning, Intelligent Tutoring Systems have long been constrained by bottlenecks such as expert-dependent, costly manual knowledge base construction and difficulties in adapting to unstructured teaching resources. Concurrently, generative large language models face challenges in educational question-answering, including factual inaccuracies and insufficient logical reasoning capabilities. To address these issues, this study proposes a framework for an Intelligent Tutoring System based on the automatic construction of multimodal knowledge graphs and Retrieval-Augmented Generation (RAG). The system integrates technologies such as FFmpeg, Whisper, OCR, and layout analysis to establish a pipeline for the fully automatic extraction and construction of knowledge graphs not only from course videos, but also from textbook PDFs. This process enables the integration of auditory information from videos with visual and textual knowledge from textbooks, building on this foundation, the framework combines graph retrieval and vector retrieval strategies, leveraging the RAG mechanism to drive large language models in generating accurate and explainable question-answering content. Experimental results demonstrate that the proposed system achieves positive feedback in terms of knowledge graph construction, the average accuracy and relevance of intelligent Q&A responses, overall user satisfaction, and system performance. Beyond automation, its core innovation is a cross-modal fusion mechanism that aligns and integrates knowledge from auditory explanations and visual-textual textbook content, thereby creating a unified, instructionally-structured knowledge graph. Thus, this study provides a feasible and innovative path from multimodal resources to intelligent services for Intelligent Tutoring Systems, holding significant practical implications for advancing personalized learning.
Zitieren
APA
Deng, C., & Yuan, B. (2026). Research on an intelligent tutoring system based on automatic construction of multimodal knowledge graphs and retrieval-augmented generation. Frontiers in Computer Science, 8. https://doi.org/10.3389/fcomp.2026.1777749
Vancouver
Deng C, Yuan B. Research on an intelligent tutoring system based on automatic construction of multimodal knowledge graphs and retrieval-augmented generation. Frontiers in Computer Science. 2026;8. doi:10.3389/fcomp.2026.1777749
BibTeX
@article{Deng2026,
author = {Deng, Chao and Yuan, Bo},
title = {Research on an intelligent tutoring system based on automatic construction of multimodal knowledge graphs and retrieval-augmented generation},
journal = {Frontiers in Computer Science},
year = {2026},
volume = {8},
doi = {10.3389/fcomp.2026.1777749}
}
EUVIMED