EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MDKAG: Retrieval-Augmented Educational QA Powered by a Multimodal Disciplinary Knowledge Graph

Xu Zhao, Guozhong Wang, Yufei Lu

Applied Sciences · 18.08.2025 · 15 (16) · 9095

DOI: 10.3390/app15169095 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.08.2025. Verfasst von Xu Zhao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Education and Scientific Research Project of Shanghai China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the accelerated digital transformation in education, the efficient integration of massive multimodal instructional resources and the support for interactive question answering (QA) remains a prominent challenge. This study introduces Multimodal Disciplinary Knowledge-Augmented Generation (MDKAG), a framework integrating retrieval-augmented generation (RAG) with a multimodal disciplinary knowledge graph (MDKG). MDKAG first extracts high-precision entities from digital textbooks, lecture slides, and classroom videos by using the Enhanced Representation through Knowledge Integration 3.0 (ERNIE 3.0) model and then links them into a graph that supports fine-grained retrieval. At inference time, the framework retrieves graph-adjacent passages, integrates multimodal data, and feeds them into a large language model (LLM) to generate context-aligned answers. An answer-verification module checks semantic overlap and entity coverage to filter hallucinations and triggers incremental graph updates when new concepts appear. Experiments on three university courses show that MDKAG reduces hallucination rates by up to 23% and increases answer accuracy by 11% over text-only RAG and knowledge-augmented generation (KAG) baselines, demonstrating strong adaptability across subject domains. The results indicate that MDKAG offers an effective route for scalable knowledge organization and reliable interactive QA in education.

Förderung

  • Education and Scientific Research Project of Shanghai China

Zitieren

APA

Zhao, X., Wang, G., & Lu, Y. (2025). MDKAG: Retrieval-Augmented Educational QA Powered by a Multimodal Disciplinary Knowledge Graph. Applied Sciences, 15(16), 9095. https://doi.org/10.3390/app15169095

Vancouver

Zhao X, Wang G, Lu Y. MDKAG: Retrieval-Augmented Educational QA Powered by a Multimodal Disciplinary Knowledge Graph. Applied Sciences. 2025;15(16):9095. doi:10.3390/app15169095

BibTeX
@article{Zhao2025,
  author = {Zhao, Xu and Wang, Guozhong and Lu, Yufei},
  title = {MDKAG: Retrieval-Augmented Educational QA Powered by a Multimodal Disciplinary Knowledge Graph},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {16},
  pages = {9095},
  doi = {10.3390/app15169095}
}
Kostenlos starten →