Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications
IEEE Transactions on Consumer Electronics · 2024-02 · 70 (1) · 4108-4119
DOI: 10.1109/tce.2024.3364677 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-02. Verfasst von Cen Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, Natural Science Foundation of Guangdong Province of China, CCF-Phytium Fund and CAAI-MindSpore Open Fund, developed on OpenI Community.
Abstract (Originalsprache)
3D point cloud videos are widely used in edge computing scenarios to achieve seamless connectivity and extremely low latency in applications such as autonomous driving. It faces difficulties primarily because point cloud data is often voluminous and contains redundancies. These issues can lead to significant drawbacks in practical applications, causing inference delays and reducing accuracy. To tackle these challenges, we propose a novel approach: a transformer-based spatio-temporal pruning method designed specifically for point cloud videos. Our goal is to expedite network inference. Initially, we utilize the attention mechanism of the transformer to calculate importance scores for different frames and tokens within 3D point cloud videos. To capture the temporal context of each point cloud token, we introduce a frame-wise relation matrix for importance score computation. Subsequently, we use these importance scores as criteria for pruning at both frame and token levels. The experimental results indicate that our approach outperforms other methods. For example, on NTU RGB+D 60 dataset, it shows improvement in accuracy by 0.5% and the average inference time decrease by 28%, while memory consumption is reduced by 28%.
Förderung
- Fundamental Research Funds for the Central Universities
- Natural Science Foundation of Guangdong Province of China
- CCF-Phytium Fund and CAAI-MindSpore Open Fund, developed on OpenI Community
Zitieren
APA
Chen, C., Xie, S., Liu, J., Cheng, Z., Zeng, Z., & Zhuang, H. (2024). Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications. IEEE Transactions on Consumer Electronics, 70(1), 4108-4119. https://doi.org/10.1109/tce.2024.3364677
Vancouver
Chen C, Xie S, Liu J, Cheng Z, Zeng Z, Zhuang H. Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications. IEEE Transactions on Consumer Electronics. 2024;70(1):4108-4119. doi:10.1109/tce.2024.3364677
BibTeX
@article{Chen2024,
author = {Chen, Cen and Xie, Songyu and Liu, Jing and Cheng, Zhongyao and Zeng, Ziqian and Zhuang, Huiping},
title = {Efficient Point Cloud Video Recognition via Spatio-Temporal Pruning for MEC-Based Consumer Applications},
journal = {IEEE Transactions on Consumer Electronics},
year = {2024},
volume = {70},
number = {1},
pages = {4108--4119},
doi = {10.1109/tce.2024.3364677}
}
EUVIMED