EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reliable retrieval-augmented feature generation with large language model reasoning

Jinghan Zhang, Xinhao Zhang, Fengran Mo, Dakshak Keerthi Chandra, Yu-Zhong Chen, Fei Xie, Kunpeng Liu

Knowledge and Information Systems · 2026-12 · 68 (1)

DOI: 10.1007/s10115-026-02792-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Knowledge and Information Systems, online erschienen am 02.06.2026. Verfasst von Jinghan Zhang und 6 weiteren Autor:innen. Die Arbeit nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Feature generation can significantly enhance learning outcomes, particularly for tasks with limited data. An effective way to improve feature generation is to expand the current feature space using existing features and enriching the informational content. However, generating new, interpretable features usually requires domain-specific knowledge on top of the existing features. In this paper, we introduce a Retrieval-Augmented Feature Generation method, RAFG, to generate useful and explainable features specific to domain classification tasks. To increase the interpretability of the generated features, we conduct knowledge retrieval among the existing features in the domain to identify potential feature associations. These associations are expected to help generate useful features. Moreover, we develop a framework based on large language models (LLMs) for feature generation with reasoning to evaluate their semantic relevance, causal alignment, and expected utility for the downstream task. To mitigate the risk of overconfident or unsupported reasoning, we further introduce a counterfactual validation mechanism that compares reasoning-based predictions with observed performance changes. Experiments across several datasets in medical, economic, and geographic domains show that our RAFG method can produce high-quality, meaningful features and significantly improve classification performance compared with baseline methods.

Förderung

  • National Science Foundation

Zitieren

APA

Zhang, J., Zhang, X., Mo, F., Chandra, D. K., Chen, Y., Xie, F., & Liu, K. (2026). Reliable retrieval-augmented feature generation with large language model reasoning. Knowledge and Information Systems, 68(1). https://doi.org/10.1007/s10115-026-02792-4

Vancouver

Zhang J, Zhang X, Mo F, Chandra DK, Chen Y, Xie F, et al. Reliable retrieval-augmented feature generation with large language model reasoning. Knowledge and Information Systems. 2026;68(1). doi:10.1007/s10115-026-02792-4

BibTeX
@article{Zhang2026,
  author = {Zhang, Jinghan and Zhang, Xinhao and Mo, Fengran and Chandra, Dakshak Keerthi and Chen, Yu-Zhong and Xie, Fei and Liu, Kunpeng},
  title = {Reliable retrieval-augmented feature generation with large language model reasoning},
  journal = {Knowledge and Information Systems},
  year = {2026},
  volume = {68},
  number = {1},
  doi = {10.1007/s10115-026-02792-4}
}
Kostenlos starten →