Algorithm-Sensitive Feature Weighting using Mutual Information and ReliefF for Heart Disease Classification
Edumatic: Jurnal Pendidikan Informatika · 28.04.2026 · 10 (1) · 260-269
DOI: 10.29408/edumatic.v10i1.34262 ↗Kurz gefasst
Fachartikel in der Zeitschrift Edumatic: Jurnal Pendidikan Informatika, online erschienen am 28.04.2026. Verfasst von Dwi Prihantono und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Heart disease remains a critical global health issue requiring reliable early prediction for clinical decision-making. This study evaluates the effect of feature selection and feature weighting on the performance of machine learning models with different learning mechanisms, namely K-Nearest Neighbors (KNN), Naïve Bayes (NB), and Logistic Regression (LR), for heart disease prediction. An algorithm-sensitive comparative framework was applied using global feature relevance estimation (Mutual Information), local feature relevance estimation (ReliefF), feature selection, and feature weighting, with raw features as baseline. Experiments were conducted on the Cleveland Heart Disease dataset using stratified 5-fold cross-validation. The results show that ReliefF-based feature weighting achieves the best performance for Naïve Bayes (accuracy = 0.8085; F1-score = 0.7774), while Logistic Regression attains the highest overall performance under the baseline (accuracy = 0.8547; F1-score = 0.8324). Feature selection improves KNN performance due to reduced sensitivity to irrelevant features. These findings indicate that the effectiveness of feature importance strategies depends on model-specific learning behavior, where feature weighting benefits probabilistic models, while feature selection is more effective for distance-based models. This study contributes an algorithm-sensitive evaluation perspective for aligning feature importance strategies with machine learning model characteristics to improve heart disease prediction performance.
Zitieren
APA
Prihantono, D., Faqih, U., & Indra, I. (2026). Algorithm-Sensitive Feature Weighting using Mutual Information and ReliefF for Heart Disease Classification. Edumatic: Jurnal Pendidikan Informatika, 10(1), 260-269. https://doi.org/10.29408/edumatic.v10i1.34262
Vancouver
Prihantono D, Faqih U, Indra I. Algorithm-Sensitive Feature Weighting using Mutual Information and ReliefF for Heart Disease Classification. Edumatic: Jurnal Pendidikan Informatika. 2026;10(1):260-269. doi:10.29408/edumatic.v10i1.34262
BibTeX
@article{Prihantono2026,
author = {Prihantono, Dwi and Faqih, Umar and Indra, Indra},
title = {Algorithm-Sensitive Feature Weighting using Mutual Information and ReliefF for Heart Disease Classification},
journal = {Edumatic: Jurnal Pendidikan Informatika},
year = {2026},
volume = {10},
number = {1},
pages = {260--269},
doi = {10.29408/edumatic.v10i1.34262}
}
EUVIMED