Multimodal RAG for cultural heritage: a technical exploration based on Jino traditional knowledge
Digital Scholarship in the Humanities · 01.06.2026 · 41 (2) · 1138-1153
DOI: 10.1093/llc/fqag042 ↗Kurz gefasst
Fachartikel in der Zeitschrift Digital Scholarship in the Humanities, erschienen am 01.06.2026. Verfasst von Xiaoyu Zhou und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 17 Literaturangaben. Gefördert von: Chuxiong Normal University Research Fund.
Abstract (Originalsprache)
This article presents a Multimodal Retrieval-Augmented Generation (RAG) system for the digital preservation of traditional knowledge (TK) from the Jino ethnic group in China, a small indigenous community whose knowledge is primarily transmitted through oral narratives, ritual practices, and place-based ecological experience. The system integrates text, audio, and image data, using the m3e-base model for embedding generation and Facebook AI Similarity Search for semantic search. A Flask backend supports cross-modal queries, with OpenAI models handling keyword extraction and generation. Deployed via Docker and Cloudflare Tunnel, the system is embedded in a WordPress interface for public access. Beyond implementation, the study addresses challenges in data collection, intellectual property, and cultural authenticity. Results indicate that AI-driven multimodal retrieval can support sustainable TK transmission and inform future digital heritage infrastructures.
Förderung
- Chuxiong Normal University Research Fund
Zitieren
APA
Zhou, X., & Lin, J. (2026). Multimodal RAG for cultural heritage: a technical exploration based on Jino traditional knowledge. Digital Scholarship in the Humanities. https://doi.org/10.1093/llc/fqag042
Vancouver
Zhou X, Lin J. Multimodal RAG for cultural heritage: a technical exploration based on Jino traditional knowledge. Digital Scholarship in the Humanities. 2026. doi:10.1093/llc/fqag042
BibTeX
@article{Zhou2026,
author = {Zhou, Xiaoyu and Lin, Jing},
title = {Multimodal RAG for cultural heritage: a technical exploration based on Jino traditional knowledge},
journal = {Digital Scholarship in the Humanities},
year = {2026},
doi = {10.1093/llc/fqag042}
}
EUVIMED