EUVIMEDEUVIMED entdecken
Open Access · CC BY-ND 4.0

Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges

Yoshitomo Matsubara, Marco Levorato, Francesco Restuccia

ACM Computing Surveys · 31.05.2023 · 55 (5) · 1-30

DOI: 10.1145/3527155 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 03.12.2022. Verfasst von Yoshitomo Matsubara und 2 weiteren Autor:innen. Die Arbeit wurde bisher 285-mal zitiert (Crossref) und nennt 174 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0). Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Mobile devices such as smartphones and autonomous vehicles increasingly rely on deep neural networks (DNNs) to execute complex inference tasks such as image classification and speech recognition, among others. However, continuously executing the entire DNN on mobile devices can quickly deplete their battery. Although task offloading to cloud/edge servers may decrease the mobile device’s computational burden, erratic patterns in channel quality, network, and edge server load can lead to a significant delay in task execution. Recently, approaches based on split computing (SC) have been proposed, where the DNN is split into a head and a tail model, executed respectively on the mobile device and on the edge server. Ultimately, this may reduce bandwidth usage as well as energy consumption. Another approach, called early exiting (EE), trains models to embed multiple “exits” earlier in the architecture, each providing increasingly higher target accuracy. Therefore, the tradeoff between accuracy and delay can be tuned according to the current conditions or application demands. In this article, we provide a comprehensive survey of the state of the art in SC and EE strategies by presenting a comparison of the most relevant approaches. We conclude the article by providing a set of compelling research challenges.

Förderung

  • NSF

Zitieren

APA

Matsubara, Y., Levorato, M., & Restuccia, F. (2023). Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges. ACM Computing Surveys, 55(5), 1-30. https://doi.org/10.1145/3527155

Vancouver

Matsubara Y, Levorato M, Restuccia F. Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges. ACM Computing Surveys. 2023;55(5):1-30. doi:10.1145/3527155

BibTeX
@article{Matsubara2023,
  author = {Matsubara, Yoshitomo and Levorato, Marco and Restuccia, Francesco},
  title = {Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {5},
  pages = {1--30},
  doi = {10.1145/3527155}
}
Kostenlos starten →