EUVIMEDEUVIMED entdecken
Crossref

Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications

Cen Chen, Songyu Xie, Jing Liu, Zhongyao Cheng, Ziqian Zeng, Huiping Zhuang

IEEE Transactions on Consumer Electronics · 2024-02 · 70 (1) · 4108-4119

DOI: 10.1109/tce.2024.3364677 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-02. Verfasst von Cen Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, Natural Science Foundation of Guangdong Province of China, CCF-Phytium Fund and CAAI-MindSpore Open Fund, developed on OpenI Community.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

3D point cloud videos are widely used in edge computing scenarios to achieve seamless connectivity and extremely low latency in applications such as autonomous driving. It faces difficulties primarily because point cloud data is often voluminous and contains redundancies. These issues can lead to significant drawbacks in practical applications, causing inference delays and reducing accuracy. To tackle these challenges, we propose a novel approach: a transformer-based spatio-temporal pruning method designed specifically for point cloud videos. Our goal is to expedite network inference. Initially, we utilize the attention mechanism of the transformer to calculate importance scores for different frames and tokens within 3D point cloud videos. To capture the temporal context of each point cloud token, we introduce a frame-wise relation matrix for importance score computation. Subsequently, we use these importance scores as criteria for pruning at both frame and token levels. The experimental results indicate that our approach outperforms other methods. For example, on NTU RGB+D 60 dataset, it shows improvement in accuracy by 0.5% and the average inference time decrease by 28%, while memory consumption is reduced by 28%.

Förderung

  • Fundamental Research Funds for the Central Universities
  • Natural Science Foundation of Guangdong Province of China
  • CCF-Phytium Fund and CAAI-MindSpore Open Fund, developed on OpenI Community

Zitieren

APA

Chen, C., Xie, S., Liu, J., Cheng, Z., Zeng, Z., & Zhuang, H. (2024). Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications. IEEE Transactions on Consumer Electronics, 70(1), 4108-4119. https://doi.org/10.1109/tce.2024.3364677

Vancouver

Chen C, Xie S, Liu J, Cheng Z, Zeng Z, Zhuang H. Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications. IEEE Transactions on Consumer Electronics. 2024;70(1):4108-4119. doi:10.1109/tce.2024.3364677

BibTeX
@article{Chen2024,
  author = {Chen, Cen and Xie, Songyu and Liu, Jing and Cheng, Zhongyao and Zeng, Ziqian and Zhuang, Huiping},
  title = {Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2024},
  volume = {70},
  number = {1},
  pages = {4108--4119},
  doi = {10.1109/tce.2024.3364677}
}
Kostenlos starten →