EfficientMixer: A Lightweight Vision Architecture via Complementary Design Principles
Algorithms · 19.08.2026 · 19 (8) · 694
DOI: 10.3390/a19080694 ↗Kurz gefasst
Fachartikel in der Zeitschrift Algorithms, online erschienen am 19.08.2026. Verfasst von Weidong Zhang und 4 weiteren Autor:innen. Die Arbeit nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Lightweight vision models must maximize representational capacity under strict constraints on parameters and computational cost. We investigate whether principle-level architectural composition—the systematic integration of complementary design principles rather than optimization of individual components in isolation—can provide a more effective approach to lightweight model design. Motivated by this perspective, we propose EfficientMixer, a lightweight vision architecture that combines hierarchical feature scaling, isotropic spatial–channel mixing, and lightweight channel–spatial attention refinement, with each principle serving a complementary role within a unified architecture. We evaluate this composition under identical training settings and comparable parameter budgets across multiple image-classification datasets using baseline comparisons, component ablations, and computational-efficiency measurements. EfficientMixer consistently outperforms representative lightweight models while maintaining a constrained resource budget and achieves further performance gains when combined with Self-Competitive Distillation, showing that the architecture can benefit from improved training methods. These results show that systematically composing complementary architectural principles can improve representation quality and generalization in lightweight vision models, providing a practical design strategy for performance-constrained settings.
Zitieren
APA
Zhang, W., Li, B., Liu, H., Yang, Y., & Dalyanci, A. A. (2026). EfficientMixer: A Lightweight Vision Architecture via Complementary Design Principles. Algorithms, 19(8), 694. https://doi.org/10.3390/a19080694
Vancouver
Zhang W, Li B, Liu H, Yang Y, Dalyanci AA. EfficientMixer: A Lightweight Vision Architecture via Complementary Design Principles. Algorithms. 2026;19(8):694. doi:10.3390/a19080694
BibTeX
@article{Zhang2026,
author = {Zhang, Weidong and Li, Baoxin and Liu, Huan and Yang, Yezhou and Dalyanci, Ahmet Arda},
title = {EfficientMixer: A Lightweight Vision Architecture via Complementary Design Principles},
journal = {Algorithms},
year = {2026},
volume = {19},
number = {8},
pages = {694},
doi = {10.3390/a19080694}
}
EUVIMED