EUVIMEDOpdag EUVIMED
Crossref

Transforming Large-Size to Lightweight Deep Neural Networks for IoT Applications

Rahul Mishra, Hari Gupta

ACM Computing Surveys · 2023-11-30 · 55 (11) · 1-35

DOI: 10.1145/3570955 ↗

At a glance

Journal article in ACM Computing Surveys, published online on 2023-02-09. Written by Rahul Mishra and 1 co-authors. Cited 41 times so far (Crossref); 146 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Deep Neural Networks (DNNs) have gained unprecedented popularity due to their high-order performance and automated feature extraction capability. This has encouraged researchers to incorporate DNN in different Internet of Things (IoT) applications in recent years. However, the colossal requirement of computation, energy, and storage of DNNs make their deployment prohibitive on resource-constrained IoT devices. Therefore, several compression techniques have been proposed in recent years to reduce the energy, storage, and computation requirements of the DNN. These techniques have utilized a different perspective for compressing a DNN with minimal accuracy compromise. This encourages us to comprehensively overview DNN compression techniques for the IoT. This article presents a comprehensive overview of existing literature on compressing the DNN that reduces energy consumption, storage, and computation requirements for IoT applications. We divide the existing approaches into five broad categories—network pruning, sparse representation, bits precision, knowledge distillation, and miscellaneous—based upon the mechanism incorporated for compressing the DNN. The article discusses the challenges associated with each category of DNN compression techniques and presents some prominent applications using IoT in conjunction with a compressed DNN. Finally, we provide a quick summary of existing work under each category with the future direction in DNN compression.

Cite

APA

Mishra, R., & Gupta, H. (2023). Transforming Large-Size to Lightweight Deep Neural Networks for IoT Applications. ACM Computing Surveys, 55(11), 1-35. https://doi.org/10.1145/3570955

Vancouver

Mishra R, Gupta H. Transforming Large-Size to Lightweight Deep Neural Networks for IoT Applications. ACM Computing Surveys. 2023;55(11):1-35. doi:10.1145/3570955

BibTeX
@article{Mishra2023,
  author = {Mishra, Rahul and Gupta, Hari},
  title = {Transforming Large-Size to Lightweight Deep Neural Networks for IoT Applications},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {11},
  pages = {1--35},
  doi = {10.1145/3570955}
}
Start for free →