EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Feature-Importance-Weighted Distance Metrics for Enhanced k-Nearest Neighbors Classification in Medical Diagnosis

Mohammed Addou, El Bekkaye Mermri, Mohammed Gabli

Human-Centric Intelligent Systems · 09.04.2026 · 6 (2) · 283-300

DOI: 10.1007/s44230-026-00147-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Human-Centric Intelligent Systems, online erschienen am 09.04.2026. Verfasst von Mohammed Addou und 2 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional k-Nearest Neighbors (KNN) classification assumes equal feature importance, which limits its effectiveness in domains where features exhibit inherently different levels of relevance. This study introduces a systematic feature importance weighted distance framework that integrates Random Forest derived importance scores into classical distance metrics. Ten distance measures, namely Euclidean, Manhattan, Cosine, Lorentzian, Canberra, Squared Chord, Chi Square, Whittaker’s Index of Association Distance, Motyka, and Hassanat, are adapted by embedding normalized feature importance weights, allowing informative features to contribute more strongly to similarity computation while reducing the influence of less relevant ones. Comprehensive evaluation across seven publicly available datasets, including five medical and two non-medical datasets, demonstrates consistent performance improvements. Using stratified 5 fold cross validation repeated over ten random seeds, the proposed weighted variants achieve an average accuracy gain of approximately 5.01 percentage points across all metrics, datasets, and values of k . Performance is improved or maintained in 91.1% of all tested configurations spanning five values of k ( $$k \in \{1,3,5,7,9\}$$ k ∈ { 1 , 3 , 5 , 7 , 9 } ). Wilcoxon signed rank tests confirm statistical significance ( $$p < 0.05$$ p < 0.05 ) in 78.0% of configurations, while sensitivity analysis indicates stable behavior across different Random Forest hyperparameter settings. Overall, the proposed framework provides an interpretable and effective mechanism for incorporating feature relevance into similarity based classification.

Zitieren

APA

Addou, M., Mermri, E. B., & Gabli, M. (2026). Feature-Importance-Weighted Distance Metrics for Enhanced k-Nearest Neighbors Classification in Medical Diagnosis. Human-Centric Intelligent Systems, 6(2), 283-300. https://doi.org/10.1007/s44230-026-00147-4

Vancouver

Addou M, Mermri EB, Gabli M. Feature-Importance-Weighted Distance Metrics for Enhanced k-Nearest Neighbors Classification in Medical Diagnosis. Human-Centric Intelligent Systems. 2026;6(2):283-300. doi:10.1007/s44230-026-00147-4

BibTeX
@article{Addou2026,
  author = {Addou, Mohammed and Mermri, El Bekkaye and Gabli, Mohammed},
  title = {Feature-Importance-Weighted Distance Metrics for Enhanced k-Nearest Neighbors Classification in Medical Diagnosis},
  journal = {Human-Centric Intelligent Systems},
  year = {2026},
  volume = {6},
  number = {2},
  pages = {283--300},
  doi = {10.1007/s44230-026-00147-4}
}
Kostenlos starten →