EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Comparative Study of Principal Component Analysis with Ensemble Learning for Classification of Medical Data

Siti Amirah Batrisya Mohd Rahaizi, Wendy Ling Shinyie, Soo-Fen Fam

Malaysian Journal of Science Health & Technology · 05.05.2026 · 12 (1) · 65-75

DOI: 10.33102/mjosht.572 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Malaysian Journal of Science Health & Technology, online erschienen am 05.05.2026. Verfasst von Siti Amirah Batrisya Mohd Rahaizi und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Dimensionality reduction is a critical component in the analysis of medical data, specifically when addressing challenges like multicollinearity, noise, and high-dimensional feature spaces that can decrease classification performance. While principal component analysis (PCA) is a traditional choice, its utility in medical datasets is often hindered by outliers, corrupted observations, and low interpretability, as principal components are linear combinations of all original variables. This research compares PCA, robust PCA (RPCA), and sparse PCA (SPCA) integrated with random forest (RF) and extremely randomized trees (ERT). A simulation study revealed that while all PCA variants struggle with low class separation, RPCA and SPCA significantly outperform standard PCA in the presence of outliers. This study utilized a diabetes dataset that underwent thorough preprocessing, including median imputation, normalization, and the synthetic minority over-sampling technique (SMOTE) to address class imbalance. Model optimization involved cross-validation of the RPCA regularization parameter and the SPCA sparsity parameter based on the area under the receiver operating characteristic (ROC) curve (AUC). At the same time, RF and ERT hyperparameters were optimized using a two-stage random and grid search approach. Final empirical results demonstrate that the RPCA-ERT model is superior, achieving an accuracy of 0.8954 and a sensitivity of 0.9434, underscoring its effectiveness in managing contaminated medical data. VIDEO EXPLAINER AUDIO PODCAST

Zitieren

APA

Rahaizi, S. A. B. M., Shinyie, W. L., & Fam, S. (2026). A Comparative Study of Principal Component Analysis with Ensemble Learning for Classification of Medical Data. Malaysian Journal of Science Health & Technology, 12(1), 65-75. https://doi.org/10.33102/mjosht.572

Vancouver

Rahaizi SABM, Shinyie WL, Fam S. A Comparative Study of Principal Component Analysis with Ensemble Learning for Classification of Medical Data. Malaysian Journal of Science Health & Technology. 2026;12(1):65-75. doi:10.33102/mjosht.572

BibTeX
@article{Rahaizi2026,
  author = {Rahaizi, Siti Amirah Batrisya Mohd and Shinyie, Wendy Ling and Fam, Soo-Fen},
  title = {A Comparative Study of Principal Component Analysis with Ensemble Learning for Classification of Medical Data},
  journal = {Malaysian Journal of Science Health & Technology},
  year = {2026},
  volume = {12},
  number = {1},
  pages = {65--75},
  doi = {10.33102/mjosht.572}
}
Kostenlos starten →