A Feature-Weighted Support Vector Regression Machine Based on Hilbert–Schmidt Independence Criterion Least Absolute Shrinkage and Selection Operator
Information · 15.10.2024 · 15 (10) · 639
DOI: 10.3390/info15100639 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 15.10.2024. Verfasst von Xin Zhang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Jiangxi Province of China, Graduate Innovation Special Foundation of Jiangxi Province of China, Program of Academic Degree and Graduate Education and Teaching Reform in Jiangxi Province of China.
Abstract (Originalsprache)
Support vector regression (SVR) is a powerful kernel-based regression prediction algorithm that performs excellently in various application scenarios. However, for real-world data, the general SVR often fails to achieve good predictive performance due to its inability to assess feature contribution accurately. Feature weighting is a suitable solution to address this issue, applying correlation measurement methods to obtain reasonable weights for features based on their contributions to the output. In this paper, based on the idea of a Hilbert–Schmidt independence criterion least absolute shrinkage and selection operator (HSIC LASSO) for selecting features with minimal redundancy and maximum relevance, we propose a novel feature-weighted SVR that considers the importance of features to the output and the redundancy between features. In this approach, the HSIC is utilized to effectively measure the correlation between features as well as that between features and the output. The feature weights are obtained by solving a LASSO regression problem. Compared to other feature weighting methods, our method takes much more comprehensive consideration of weight calculation, and the obtained weighted kernel function can lead to more precise predictions for unknown data. Comprehensive experiments on real datasets from the University of California Irvine (UCI) machine learning repository demonstrate the effectiveness of the proposed method.
Förderung
- Natural Science Foundation of Jiangxi Province of China
- Graduate Innovation Special Foundation of Jiangxi Province of China
- Program of Academic Degree and Graduate Education and Teaching Reform in Jiangxi Province of China
Zitieren
APA
Zhang, X., Wang, T., & Lai, Z. (2024). A Feature-Weighted Support Vector Regression Machine Based on Hilbert–Schmidt Independence Criterion Least Absolute Shrinkage and Selection Operator. Information, 15(10), 639. https://doi.org/10.3390/info15100639
Vancouver
Zhang X, Wang T, Lai Z. A Feature-Weighted Support Vector Regression Machine Based on Hilbert–Schmidt Independence Criterion Least Absolute Shrinkage and Selection Operator. Information. 2024;15(10):639. doi:10.3390/info15100639
BibTeX
@article{Zhang2024,
author = {Zhang, Xin and Wang, Tinghua and Lai, Zhiyong},
title = {A Feature-Weighted Support Vector Regression Machine Based on Hilbert–Schmidt Independence Criterion Least Absolute Shrinkage and Selection Operator},
journal = {Information},
year = {2024},
volume = {15},
number = {10},
pages = {639},
doi = {10.3390/info15100639}
}
EUVIMED