Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (28) · 23945-23953
DOI: 10.1609/aaai.v40i28.39571 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yuzhou Liu und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Multi-view multi-label data offers richer perspectives for artificial intelligence, but simultaneously presents significant challenges for feature selection due to the inherent complexity of interrelations among features, views and labels. Attention mechanisms provide an effective way for analyzing these intricate relationships. They can compute importance weights for information by aggregating correlations between Query and Key matrices to focus on pertinent Values. However, existing attention-based feature selection methods predominantly focus on intra-view relationships, neglecting the complementarity of inter-view features and the critical feature-label correlations. Moreover, they often fail to account for feature redundancy, potentially leading to suboptimal feature subsets. To overcome these limitations, we propose a novel method based on Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection (RMAN-MMFS). Specifically, we employ each individual attention head to model intra-view feature relationships and use the cross-attention mechanisms between different heads to capture inter-view feature complementarity. Furthermore, we design static and dynamic feature redundancy terms: the static term mitigates redundancy within each view, while the dynamic term explicitly models redundancy between unselected and selected features across the entire selection process, thereby promoting feature compactness. Comprehensive evaluations on six real-world datasets, comparing against six multi-view multi-label feature selection methods, demonstrate the superior performance of the proposed method.
Zitieren
APA
Liu, Y., Liu, J., & Gao, W. (2026). Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection. Proceedings of the AAAI Conference on Artificial Intelligence, 40(28), 23945-23953. https://doi.org/10.1609/aaai.v40i28.39571
Vancouver
Liu Y, Liu J, Gao W. Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(28):23945-23953. doi:10.1609/aaai.v40i28.39571
BibTeX
@article{Liu2026,
author = {Liu, Yuzhou and Liu, Jiarui and Gao, Wanfu},
title = {Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {28},
pages = {23945--23953},
doi = {10.1609/aaai.v40i28.39571}
}
EUVIMED