A lightweight hybrid deep learning approach for fashion mnist classification with explainable attention visualization
PLOS One · 23.06.2026 · 21 (6) · e0351671
DOI: 10.1371/journal.pone.0351671 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 23.06.2026. Verfasst von Hafeez Ahmad und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical Engineering and Computer Science, National University of Sciences & Technology (NUST), Islamabad, Pakistan. Hauptthemen laut MEDLINE: Deep Learning, Image Processing, Computer-Assisted. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The classification of fashion images is an essential task in the e-commerce sector, where accurate categorization improves user experience and refines product discovery. Convolutional Neural Networks (CNNs) and Transformers have demonstrated strong performance in image classification tasks due to their ability to learn complex visual features. However, deep variants of these architectures, such as VGG-19, ResNet-50, Vision Transformer (ViT), and Swin Transformer, contain tens of millions of parameters, requiring high memory and powerful GPUs for training, which makes them less suitable for low-resource and edge device environments. To address these limitations, this research proposes a lightweight hybrid architecture, TinyCNN with Linear Self-Attention (LSA), optimized for resource-constrained settings. The proposed model contains fewer than half a million parameters and is trainable on a CPU, achieving a classification accuracy of 91.47% on the Fashion-MNIST dataset. In addition, multiple Explainable Artificial Intelligence (XAI) techniques are implemented, including Self-Attention visualization, Multi-Head Attention, Attention Flow, Attention Rollout, Fixed query position attention maps, Integrated Gradients, LIME, and SHAP, to provide visual interpretability of the model’s predictions and enhance transparency in its decision-making process.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Electrical Engineering and Computer Science, National University of Sciences & Technology (NUST), Islamabad, Pakistan.
- College of Computing and Informatics, Saudi Electronic University, Riyadh, Saudi Arabia.
- College of Aeronautical Engineering, Military College of Engineering NUST, Risalpur, Pakistan.
ORCID-Profile: Tahira Anwar Lashari, Saima Anwar Lashari
Zitieren
APA
Ahmad, H., Lashari, T. A., Lashari, S. A., Khan, I., & Jabeen, F. (2026). A lightweight hybrid deep learning approach for fashion mnist classification with explainable attention visualization. PLOS One, 21(6), e0351671. https://doi.org/10.1371/journal.pone.0351671
Vancouver
Ahmad H, Lashari TA, Lashari SA, Khan I, Jabeen F. A lightweight hybrid deep learning approach for fashion mnist classification with explainable attention visualization. PLOS One. 2026;21(6):e0351671. doi:10.1371/journal.pone.0351671
BibTeX
@article{Ahmad2026,
author = {Ahmad, Hafeez and Lashari, Tahira Anwar and Lashari, Saima Anwar and Khan, Ijaz and Jabeen, Farzana},
title = {A lightweight hybrid deep learning approach for fashion mnist classification with explainable attention visualization},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {6},
pages = {e0351671},
doi = {10.1371/journal.pone.0351671}
}
EUVIMED