Exploiting Vision Transformer and Ensemble Learning for Advanced Malware Classification
Engineering Reports · 2026-01 · 8 (1)
DOI: 10.1002/eng2.70558 ↗At a glance
Journal article in Engineering Reports, published online on 2026-01-22. Written by Fadi Makarem and 4 co-authors. Cited 1 times so far (Crossref); 53 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
Malware remains a significant concern for modern digital systems, increasing the need for reliable and scalable detection methods. This work proposes an ensemble method that combines a random forest (RF) with a vision transformer (ViT). The approach exploits complementary feature spaces, including bag‐of‐words (BoW) and image representations, to enhance multi‐class malware classification. We also evaluate traditional machine learning models (Naïve Bayes, Support Vector Machine, and RF) and deep learning (DL) models (ResNet50 and ViT) using the Microsoft Malware and Dike datasets. The proposed ensemble model achieves 99.32% accuracy and 98.11% F1 score on the Malware dataset, outperforming individual models and recent state‐of‐the‐art studies. While ViT captures spatial and sequence dependencies via attention mechanisms, RF captures textual and byte‐level frequency patterns. Their combination, through a product rule, enhances robustness and reliability in multi‐class cybersecurity tasks.
Cite
APA
Makarem, F., Chall, R. E., Samhat, A. E., Samrouth, K., & Bakir, N. (2026). Exploiting Vision Transformer and Ensemble Learning for Advanced Malware Classification. Engineering Reports, 8(1). https://doi.org/10.1002/eng2.70558
Vancouver
Makarem F, Chall RE, Samhat AE, Samrouth K, Bakir N. Exploiting Vision Transformer and Ensemble Learning for Advanced Malware Classification. Engineering Reports. 2026;8(1). doi:10.1002/eng2.70558
BibTeX
@article{Makarem2026,
author = {Makarem, Fadi and Chall, Rida El and Samhat, Abed Ellatif and Samrouth, Khouloud and Bakir, Nader},
title = {Exploiting Vision Transformer and Ensemble Learning for Advanced Malware Classification},
journal = {Engineering Reports},
year = {2026},
volume = {8},
number = {1},
doi = {10.1002/eng2.70558}
}
EUVIMED