EUVIMEDEUVIMED entdecken
Crossref

MSTP-Net: Multiscale Spatio-Temporal Parallel Networks for Human Motion Prediction

Lujing Chen, Rui Liu, Wei Zhang, Yaqing Hou, Qiang Zhang, Dongsheng Zhou

IEEE Transactions on Consumer Electronics · 2024-02 · 70 (1) · 3318-3331

DOI: 10.1109/tce.2023.3278466 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-02. Verfasst von Lujing Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: Project of NSFC, Special Project of Central Government Guiding Local Science and Technology Development, Program for Innovative Research Team in University of Liaoning Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As a new rising technology, human motion prediction has broad application prospects in the field of consumer electronics. Since different scale features have different receptive fields in neural networks, researchers began to extract features at different scales to improve prediction accuracy in many recent works. However, human motion refers to the dimensions of both temporal and spatial, and most current approaches tend to perform multiscale feature extraction in only one dimension without fully considering its spatio-temporal dependence. Different with these works, this paper proposes a novel multiscale spatio-temporal parallel network named MSTP-Net, which attempts to improve human prediction by considering multiscale features in both the temporal and spatial dimensions. The network adopts a two-branch parallel structure to model human motion postures in both temporal and spatial dimensions. Each branch of the network specifically consists of corresponding multi-scale modules and the transformer structures. As the entire network model uses a parallel spatio-temporal multiscale strategy, the spatio-temporal features can be fully extracted. And the parameter amount of the proposed network is also reduced compare with the base line. So, the proposed MSTP-Net is a lightweight network, which could improve the prediction accuracy and extend the effective prediction time. The effectiveness of this method is demonstrated by comparing it with the SOTA methods on the Human3.6M dataset.

Förderung

  • Project of NSFC
  • Special Project of Central Government Guiding Local Science and Technology Development
  • Program for Innovative Research Team in University of Liaoning Province
  • Support Plan for Key Field Innovation Team of Dalian
  • Science and Technology Innovation Fund of Dalian
  • Support Plan for Leading Innovation Team of Dalian University
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Chen, L., Liu, R., Zhang, W., Hou, Y., Zhang, Q., & Zhou, D. (2024). MSTP-Net: Multiscale Spatio-Temporal Parallel Networks for Human Motion Prediction. IEEE Transactions on Consumer Electronics, 70(1), 3318-3331. https://doi.org/10.1109/tce.2023.3278466

Vancouver

Chen L, Liu R, Zhang W, Hou Y, Zhang Q, Zhou D. MSTP-Net: Multiscale Spatio-Temporal Parallel Networks for Human Motion Prediction. IEEE Transactions on Consumer Electronics. 2024;70(1):3318-3331. doi:10.1109/tce.2023.3278466

BibTeX
@article{Chen2024,
  author = {Chen, Lujing and Liu, Rui and Zhang, Wei and Hou, Yaqing and Zhang, Qiang and Zhou, Dongsheng},
  title = {MSTP-Net: Multiscale Spatio-Temporal Parallel Networks for Human Motion Prediction},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2024},
  volume = {70},
  number = {1},
  pages = {3318--3331},
  doi = {10.1109/tce.2023.3278466}
}
Kostenlos starten →