EUVIMEDEUVIMED entdecken
Crossref

Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics

Haosong Peng, Wei Feng, Hao Li, Yufeng Zhan, Ren Jin, Yuanqing Xia

IEEE Transactions on Computers · 2026-08 · 75 (8) · 2915-2928

DOI: 10.1109/tc.2026.3699450 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2026-08. Verfasst von Haosong Peng und 5 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing Natural Science Foundation Haidian Original Innovation Joint Fund Project, Open Project Program of National Key Laboratory of Space-Born Intelligent Information Processing.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The advent of edge computing has made real-time intelligent video analytics feasible. Previous works, based on traditional model architecture (e.g., CNN, RNN, etc.), employ various strategies to filter out non-region-of-interest content to minimize bandwidth and computation consumption but show inferior performance in adverse environments. Recently, visual foundation models based on transformers have shown great performance in adverse environments due to their amazing generalization capability. However, they require a large amount of computation power, which limits their applications in real-time intelligent video analytics. In this paper, we find visual foundation models like Vision Transformer (ViT) also have a dedicated acceleration mechanism for video analytics. To this end, we introduce Arena, an end-to-end edge-assisted video inference acceleration system based on ViT. We leverage the capability of ViT that can be accelerated through token pruning by only offloading and feeding Patches-of-Interest to the downstream models. Additionally, we design an adaptive keyframe inference switching algorithm tailored to different videos, capable of adapting to the current video content to jointly optimize accuracy and bandwidth. Through extensive experiments, our findings reveal that Arena can boost inference speeds by up to 1.58 $\boldsymbol{\times}$ × , 1.82 $\boldsymbol{\times}$ × and 1.98 $\boldsymbol{\times}$ × on average while consuming only 47%, 31% and 27% of the bandwidth, respectively, all with high inference accuracy.

Förderung

  • National Natural Science Foundation of China
  • Beijing Natural Science Foundation Haidian Original Innovation Joint Fund Project
  • Open Project Program of National Key Laboratory of Space-Born Intelligent Information Processing

Zitieren

APA

Peng, H., Feng, W., Li, H., Zhan, Y., Jin, R., & Xia, Y. (2026). Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics. IEEE Transactions on Computers, 75(8), 2915-2928. https://doi.org/10.1109/tc.2026.3699450

Vancouver

Peng H, Feng W, Li H, Zhan Y, Jin R, Xia Y. Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics. IEEE Transactions on Computers. 2026;75(8):2915-2928. doi:10.1109/tc.2026.3699450

BibTeX
@article{Peng2026,
  author = {Peng, Haosong and Feng, Wei and Li, Hao and Zhan, Yufeng and Jin, Ren and Xia, Yuanqing},
  title = {Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics},
  journal = {IEEE Transactions on Computers},
  year = {2026},
  volume = {75},
  number = {8},
  pages = {2915--2928},
  doi = {10.1109/tc.2026.3699450}
}
Kostenlos starten →