EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Temporal-LLM-KGC: A Diagnostic Study of Temporal Evidence in Large Language Model Knowledge Graph Completion

Jiaxin Li, Chingkwun Lam, Lingfei Zhang, Rongyu Fan, Xinyi Dai, Dahang Ling, Haotian Lu, Kuo Zhao

Information · 11.11.2026 · 17 (11) · 1137

DOI: 10.3390/info17111137 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 11.11.2026. Verfasst von Jiaxin Li und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) have shown promise for temporal knowledge graph completion (temporal KGC), but accuracy alone does not reveal dependence on historical context. We evaluate Normal, No History, Anonymous, and Noisy evidence conditions on ICEWS14 and ICEWS18 with four instruction-tuned LLMs. We also test Temporal Evidence Filtering (TEF), a deterministic, training-free proof-of-concept selector combining relation compatibility, temporal recency, and entity-role consistency under a fixed ten-fact prompt budget. Removing or displacing history lowers accuracy; Anonymous improves it but simultaneously changes the constrained candidate vocabulary, precluding a single-mechanism explanation. TEF has positive descriptive differences in all 24 dataset–model–metric contrasts. Across eight dataset–model pairs, its equal-weight macro Hits@10 gain is +0.031375 (nominal paired-bootstrap 95% confidence interval: [+0.021875, +0.040875]); 10 of the 24 individual contrasts remain significant after Holm correction. Qwen3-4B selector baselines, component ablations, parameter sensitivity, and a disjoint second query sample qualify this result. TEF adds a mean 4.360 and 19.071 ms of CPU selection per query on ICEWS14 and ICEWS18, respectively; it does not compress the Normal prompt or establish an end-to-end speedup. Conclusions concern tail prediction with constrained generated lists on these two datasets, not exhaustive ranking or an identified internal reasoning mechanism.

Zitieren

APA

Li, J., Lam, C., Zhang, L., Fan, R., Dai, X., Ling, D., Lu, H., & Zhao, K. (2026). Temporal-LLM-KGC: A Diagnostic Study of Temporal Evidence in Large Language Model Knowledge Graph Completion. Information, 17(11), 1137. https://doi.org/10.3390/info17111137

Vancouver

Li J, Lam C, Zhang L, Fan R, Dai X, Ling D, et al. Temporal-LLM-KGC: A Diagnostic Study of Temporal Evidence in Large Language Model Knowledge Graph Completion. Information. 2026;17(11):1137. doi:10.3390/info17111137

BibTeX
@article{Li2026,
  author = {Li, Jiaxin and Lam, Chingkwun and Zhang, Lingfei and Fan, Rongyu and Dai, Xinyi and Ling, Dahang and Lu, Haotian and Zhao, Kuo},
  title = {Temporal-LLM-KGC: A Diagnostic Study of Temporal Evidence in Large Language Model Knowledge Graph Completion},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {11},
  pages = {1137},
  doi = {10.3390/info17111137}
}
Kostenlos starten →