A Comparative Study of Ensemble and Transformer-Based Machine Learning Models for High-Dimensional Classification Problems
Communications on Applied Nonlinear Analysis · 31.12.2025 · 32 (10s) · 4367-4374
DOI: 10.52783/cana.v32.6798 ↗Kurz gefasst
Fachartikel in der Zeitschrift Communications on Applied Nonlinear Analysis, online erschienen am 31.12.2025. Verfasst von Pooja Katariya.
Abstract (Originalsprache)
High-dimensional classification problems are increasingly encountered in domains such as bioinformatics, finance, image processing, and text analytics, where datasets often contain thousands of features. These problems introduce challenges including the curse of dimensionality, overfitting, feature redundancy, and increased computational complexity. Traditional machine learning algorithms often struggle to maintain performance under such conditions. Ensemble learning techniques and transformer-based architectures have emerged as powerful approaches to address these challenges. Ensemble models improve predictive accuracy by combining multiple base learners, while transformer models utilize attention mechanisms to capture complex feature relationships. This paper presents a comprehensive comparative study between ensemble methods, including Random Forest, Gradient Boosting, and XGBoost, and transformer-based models such as TabTransformer and FT-Transformer. The comparison is conducted using high-dimensional datasets, evaluating performance based on accuracy, precision, recall, F1-score, AUROC, and computational efficiency. The results demonstrate that ensemble methods provide stable and interpretable performance on structured datasets, whereas transformer-based models outperform in capturing intricate feature dependencies in highly complex data environments. The study concludes by highlighting the potential of hybrid approaches that integrate both methodologies for improved performance.
Zitieren
APA
Katariya, P. (2025). A Comparative Study of Ensemble and Transformer-Based Machine Learning Models for High-Dimensional Classification Problems. Communications on Applied Nonlinear Analysis, 32(10s), 4367-4374. https://doi.org/10.52783/cana.v32.6798
Vancouver
Katariya P. A Comparative Study of Ensemble and Transformer-Based Machine Learning Models for High-Dimensional Classification Problems. Communications on Applied Nonlinear Analysis. 2025;32(10s):4367-4374. doi:10.52783/cana.v32.6798
BibTeX
@article{Katariya2025,
author = {Katariya, Pooja},
title = {A Comparative Study of Ensemble and Transformer-Based Machine Learning Models for High-Dimensional Classification Problems},
journal = {Communications on Applied Nonlinear Analysis},
year = {2025},
volume = {32},
number = {10s},
pages = {4367--4374},
doi = {10.52783/cana.v32.6798}
}
EUVIMED