EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Prompting Large Language Models with Partial Knowledge for Answering Questions with Unseen Entities

Zhichao Yan, Ru Li, Jiapu Wang, Jiaoyan Chen, Hongye Tan, Yanyan Wang, Xiaoli Li, Jiye Liang, Jeff Z. Pan

ACM Transactions on Information Systems · 30.11.2026 · 44 (8) · 1-31

DOI: 10.1145/3847674 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Information Systems, online erschienen am 13.11.2026. Verfasst von Zhichao Yan und 8 weiteren Autor:innen. Die Arbeit nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Program of Shanxi Province, EPSRC Project OntoEm.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Retrieval-Augmented Generation (RAG) systems are often constrained by the “relevance myopia,” primarily focusing on fully relevant external information to supply missing or outdated facts while overlooking the potential of partially relevant knowledge to activate the internal knowledge of Large Language Models (LLMs). We challenge this paradigm by proposing that partially relevant knowledge can “awaken” latent semantic information within LLMs. We provide a theoretical framework, grounded in information theory, that explains this awakening effect: partially relevant knowledge reduces the conditional entropy of the answer by increasing the mutual information between the context and the model’s parametric knowledge. We thoroughly investigate the influence of different types of partially relevant knowledge by leveraging the gold reasoning path from Knowledge Graphs (KGs). Furthermore, we introduce a new problem called Unseen Entity Knowledge Graph Question Answering (UE-KGQA), where the entity mentioned in a question does not have a corresponding entity in the KG. Specifically, UE-KGQA simulates the realistic RAG with incomplete KGs and evaluates the effectiveness of the partially relevant knowledge. Experiments conducted on three KGQA datasets reveal that prompting with partially relevant knowledge substantially outperforms traditional similarity-based RAG methods, often susceptible to noisy and irrelevant outcomes.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Program of Shanxi Province
  • EPSRC Project OntoEm

Zitieren

APA

Yan, Z., Li, R., Wang, J., Chen, J., Tan, H., Wang, Y., Li, X., Liang, J., & Pan, J. Z. (2026). Prompting Large Language Models with Partial Knowledge for Answering Questions with Unseen Entities. ACM Transactions on Information Systems, 44(8), 1-31. https://doi.org/10.1145/3847674

Vancouver

Yan Z, Li R, Wang J, Chen J, Tan H, Wang Y, et al. Prompting Large Language Models with Partial Knowledge for Answering Questions with Unseen Entities. ACM Transactions on Information Systems. 2026;44(8):1-31. doi:10.1145/3847674

BibTeX
@article{Yan2026,
  author = {Yan, Zhichao and Li, Ru and Wang, Jiapu and Chen, Jiaoyan and Tan, Hongye and Wang, Yanyan and Li, Xiaoli and Liang, Jiye and Pan, Jeff Z.},
  title = {Prompting Large Language Models with Partial Knowledge for Answering Questions with Unseen Entities},
  journal = {ACM Transactions on Information Systems},
  year = {2026},
  volume = {44},
  number = {8},
  pages = {1--31},
  doi = {10.1145/3847674}
}
Kostenlos starten →