EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SPViT: Accelerate Vision Transformer Inference on Mobile Devices via Adaptive Splitting and Offloading

Sifan Zhao, Tongtong Liu, Hai Jin, Dezhong Yao

IEEE Transactions on Mobile Computing · 2025-10 · 24 (10) · 9303-9318

DOI: 10.1109/tmc.2025.3562721 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2025-10. Verfasst von Sifan Zhao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Vision Transformer (ViT), which benefits from utilizing self-attention mechanisms, has demonstrated superior accuracy compared to CNNs. However, due to the expensive computational costs, deploying and inferring ViTs on resource-constrained mobile devices has become a challenge. To resolve this challenge, we conducted an empirical analysis to identify performance bottlenecks in deploying ViTs on mobile devices and explored viable solutions. In this paper, we propose SPViT, an adaptive split and offloading method that accelerates ViT inference on mobile devices. SPViT executes collaborative inference of ViT across available edge devices. We introduce a fine-grained splitting technique for the vision transformer structure. Furthermore, we propose an algorithm based on the Auto Regression model to predict partition latency and adaptive offload partitions. Finally, we design offline and online optimization methods to minimize the computational and communication overhead on each device. Based on real-world prototype experiments, SPViT effectively reduces inference latency by 2.2x to 3.3x across four state-of-the-art models.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Zhao, S., Liu, T., Jin, H., & Yao, D. (2025). SPViT: Accelerate Vision Transformer Inference on Mobile Devices via Adaptive Splitting and Offloading. IEEE Transactions on Mobile Computing, 24(10), 9303-9318. https://doi.org/10.1109/tmc.2025.3562721

Vancouver

Zhao S, Liu T, Jin H, Yao D. SPViT: Accelerate Vision Transformer Inference on Mobile Devices via Adaptive Splitting and Offloading. IEEE Transactions on Mobile Computing. 2025;24(10):9303-9318. doi:10.1109/tmc.2025.3562721

BibTeX
@article{Zhao2025,
  author = {Zhao, Sifan and Liu, Tongtong and Jin, Hai and Yao, Dezhong},
  title = {SPViT: Accelerate Vision Transformer Inference on Mobile Devices via Adaptive Splitting and Offloading},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2025},
  volume = {24},
  number = {10},
  pages = {9303--9318},
  doi = {10.1109/tmc.2025.3562721}
}
Kostenlos starten →