EUVIMEDEUVIMED entdecken
Crossref

Deep Learning Model Compression Techniques: Advances, Opportunities, and Perspective

Hubert Msuya, Baraka J. Maiseli

Tanzania Journal of Engineering and Technology · 30.06.2023 · 42 (2) · 65-83

DOI: 10.52339/tjet.v42i2.853 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Tanzania Journal of Engineering and Technology, online erschienen am 30.06.2023. Verfasst von Hubert Msuya und 1 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, deep learning (DL) models have excelled in a wide range of fields. All of these successes are built on intricate DL models. The hundreds of millions or even billions of parameters and high-performance computing graphical processing units or tensor processing units are largely responsible for their achievement. DL model integration into real-time devices with tight latency limitations, limited memory, and power-constrained requirements is the key driving force behind investigation of DL model compression techniques. Also, there is an increase in data availability that encourages multimodal fusion in DL models to boost the models' predictive accuracy. In order to create compact DL models for deployment that is memory- and computationally efficient, the data included in the network parameters is compressed as much as possible, leaving only the bits necessary to carry out the task. A better trade-off between compression rate and accuracy loss should be established to take model acceleration and compression into consideration without severely reducing the model's performance. In this paper, we examine various DL model compression techniques used for both single- modality and multi-modal deep learning tasks. We explore over numerous DL model compression methods that have advanced in a number of applications. We then come up with the benefits and drawbacks of various compression and acceleration methods such as ineffectiveness in compressing more complicated networks with dimensionality-dependent complex structures, and, ultimately, the field's future prospects are given.

Zitieren

APA

Msuya, H., & Maiseli, B. J. (2023). Deep Learning Model Compression Techniques: Advances, Opportunities, and Perspective. Tanzania Journal of Engineering and Technology, 42(2), 65-83. https://doi.org/10.52339/tjet.v42i2.853

Vancouver

Msuya H, Maiseli BJ. Deep Learning Model Compression Techniques: Advances, Opportunities, and Perspective. Tanzania Journal of Engineering and Technology. 2023;42(2):65-83. doi:10.52339/tjet.v42i2.853

BibTeX
@article{Msuya2023,
  author = {Msuya, Hubert and Maiseli, Baraka J.},
  title = {Deep Learning Model Compression Techniques: Advances, Opportunities, and Perspective},
  journal = {Tanzania Journal of Engineering and Technology},
  year = {2023},
  volume = {42},
  number = {2},
  pages = {65--83},
  doi = {10.52339/tjet.v42i2.853}
}
Kostenlos starten →