Tensor Network Methods for Hyperparameter Optimization and Compression of Convolutional Neural Networks
Applied Sciences · 11.02.2025 · 15 (4) · 1852
DOI: 10.3390/app15041852 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 11.02.2025. Verfasst von A. Naumov und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Neural networks have become a cornerstone of computer vision applications, with tasks ranging from image classification to object detection. However, challenges such as hyperparameter optimization (HPO) and model compression remain critical for improving performance and deploying models on resource-constrained devices. In this work, we address these challenges using Tensor Network-based methods. For HPO, we propose and evaluate the TetraOpt algorithm against various optimization algorithms. These evaluations were conducted on subsets of the NATS-Bench dataset, including CIFAR-10, CIFAR-100, and ImageNet subsets. TetraOpt consistently demonstrated superior performance, effectively exploring the global optimization space and identifying configurations with higher accuracies. For model compression, we introduce a novel iterative method that combines CP, SVD, and Tucker tensor decompositions. Applied to ResNet-18 and ResNet-152, we evaluated our method on the CIFAR-10 and Tiny ImageNet datasets. Our method achieved compression ratios of up to 14.5× for ResNet-18 and 2.5× for ResNet-152. Additionally, the inference time for processing an image on a CPU remained largely unaffected, demonstrating the practicality of the method.
Zitieren
APA
Naumov, A., Melnikov, A., Perelshtein, M., Melnikov, A., Abronin, V., & Oksanichenko, F. (2025). Tensor Network Methods for Hyperparameter Optimization and Compression of Convolutional Neural Networks. Applied Sciences, 15(4), 1852. https://doi.org/10.3390/app15041852
Vancouver
Naumov A, Melnikov A, Perelshtein M, Melnikov A, Abronin V, Oksanichenko F. Tensor Network Methods for Hyperparameter Optimization and Compression of Convolutional Neural Networks. Applied Sciences. 2025;15(4):1852. doi:10.3390/app15041852
BibTeX
@article{Naumov2025,
author = {Naumov, A. and Melnikov, A. and Perelshtein, M. and Melnikov, Ar. and Abronin, V. and Oksanichenko, F.},
title = {Tensor Network Methods for Hyperparameter Optimization and Compression of Convolutional Neural Networks},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {4},
pages = {1852},
doi = {10.3390/app15041852}
}
EUVIMED