Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression
Machine Learning and Knowledge Extraction · 2026-08-11 · 8 (8) · 236
DOI: 10.3390/make8080236 ↗At a glance
Journal article in Machine Learning and Knowledge Extraction, published online on 2026-08-11. Written by Aleksei Samarin and 6 co-authors. 61 references. The full text is freely available (open access, CC BY 4.0). Funded by: Ministry of Economic Development of the Russian Federation.
Abstract (original language)
This paper presents a novel method for pruning deep neural networks based on the concept of flow, derived from the continuous modeling of signal propagation across layers. We derive flow functions for fully connected, convolutional, and self-attention architectures, and we propose a new iterative pruning algorithm, Iterative Flow-Aware Pruning (IFAP), that leverages these measures to identify and eliminate non-essential parameters while preserving critical information pathways. Extensive experiments across ten prominent architectures (including CNNs, vision transformers, and efficient mobile networks) on ten benchmark datasets demonstrate consistent accuracy–compression trade-offs: 81% of the evaluated configurations achieve a 60–81% reduction in computational cost relative to the corresponding baseline model. Furthermore, 97% of the evaluated configurations retain more than 98% of their baseline Top-1 accuracy. These results validate flow-based importance scoring as a robust and general-purpose foundation for model optimization.
Funding
- Ministry of Economic Development of the Russian Federation
Cite
APA
Samarin, A., Nazarenko, A., Kotenko, E., Toropov, A., Savelev, A., Motyko, A., & Malykh, V. (2026). Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression. Machine Learning and Knowledge Extraction, 8(8), 236. https://doi.org/10.3390/make8080236
Vancouver
Samarin A, Nazarenko A, Kotenko E, Toropov A, Savelev A, Motyko A, et al. Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression. Machine Learning and Knowledge Extraction. 2026;8(8):236. doi:10.3390/make8080236
BibTeX
@article{Samarin2026,
author = {Samarin, Aleksei and Nazarenko, Artem and Kotenko, Egor and Toropov, Aleksei and Savelev, Alexander and Motyko, Alexander and Malykh, Valentin},
title = {Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression},
journal = {Machine Learning and Knowledge Extraction},
year = {2026},
volume = {8},
number = {8},
pages = {236},
doi = {10.3390/make8080236}
}
EUVIMED