EUVIMEDEUVIMED entdecken
Crossref

Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation

Nanxu Gong, Wangyang Ying, Dongjie Wang, Yanjie Fu

ACM Transactions on Intelligent Systems and Technology · 30.04.2025 · 16 (2) · 1-21

DOI: 10.1145/3709011 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 15.02.2025. Verfasst von Nanxu Gong und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 61 Literaturangaben. Gefördert von: National Science Foundation, National Academy of Engineering Grainger Foundation Frontiers of Engineering.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Feature selection aims to identify the optimal feature subset for enhancing downstream models. Effective feature selection can remove redundant features, save computational resources, accelerate the model learning process, and improve the model overall performance. However, existing works are often time-intensive to identify the effective feature subset within high-dimensional feature spaces. Meanwhile, these methods mainly utilize a single downstream task performance as the selection criterion, leading to the selected subsets that are not only redundant but also lack generalizability. To bridge these gaps, we reformulate feature selection through a neuro-symbolic lens and introduce a novel generative framework aimed at identifying short and effective feature subsets. More specifically, we found that feature ID tokens of the selected subset can be formulated as symbols to reflect the intricate correlations among features. Thus, in this framework, we first create a data collector to automatically collect numerous feature selection samples consisting of feature ID tokens, model performance, and the measurement of feature subset redundancy. Building on the collected data, an encoder-decoder-evaluator learning paradigm is developed to preserve the intelligence of feature selection into a continuous embedding space for efficient search. Within the learned embedding space, we leverage a multi-gradient search algorithm to find more robust and generalized embeddings with the objective of improving model performance and reducing feature subset redundancy. These embeddings are then utilized to reconstruct the feature ID tokens for executing the final feature selection. Ultimately, comprehensive experiments and case studies are conducted to validate the effectiveness of the proposed framework. The associated data and code are publicly available ( https://github.com/NanxuGong/feature-selection-via-autoregreesive-generation ).

Förderung

  • National Science Foundation
  • National Academy of Engineering Grainger Foundation Frontiers of Engineering

Zitieren

APA

Gong, N., Ying, W., Wang, D., & Fu, Y. (2025). Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation. ACM Transactions on Intelligent Systems and Technology, 16(2), 1-21. https://doi.org/10.1145/3709011

Vancouver

Gong N, Ying W, Wang D, Fu Y. Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation. ACM Transactions on Intelligent Systems and Technology. 2025;16(2):1-21. doi:10.1145/3709011

BibTeX
@article{Gong2025,
  author = {Gong, Nanxu and Ying, Wangyang and Wang, Dongjie and Fu, Yanjie},
  title = {Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation},
  journal = {ACM Transactions on Intelligent Systems and Technology},
  year = {2025},
  volume = {16},
  number = {2},
  pages = {1--21},
  doi = {10.1145/3709011}
}
Kostenlos starten →