EUVIMEDEUVIMED entdecken
Crossref

Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home

Boyu Yang, Liyazhou Hu, Yuyang Peng, Tingting Wang, Xiaofen Fang, Lina Wang, Kai Fang

IEEE Transactions on Consumer Electronics · 2024-02 · 70 (1) · 876-888

DOI: 10.1109/tce.2023.3303309 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-02. Verfasst von Boyu Yang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: Zhejiang Provincial Natural Science Foundation of China, Zhejiang Provincial Visiting Engineer Project, Science and Technology Innovation Activity Plan for College Students in Zhejiang Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, Human Pose Prediction (HPP) using image frames captured by cameras has been widely used in the smart home sector. Combining deep learning vision processing with HPP and using the Graph Convolutional Network (GCN) to extract temporal and spatial features of human actions has achieved satisfactory accuracy. However, there is still a lack of sufficient interpretability to translate theoretical findings into human-centric consumer applications. In this paper, a novel Interpretable GCN-based HPP (IGCN-HPP) model is proposed to address the above problem. Specifically, a multi-layer spatio-temporal convolution is first constructed to capture the depth features in human action data for prediction. Secondly, a GCN Explainer is proposed to assist in model training. When pre-processed graphics frames are fed into the GCN model, it generates various subgraphs. What’s more, using Shapley values from game theory and specific graph rules to assess each subgraph’s contribution to HPP, the neighborhood relationships between subgraphs and among nodes are estimated with the contribution optimization algorithm (COA). The reasonable interpretation of the predicted human pose is obtained by extracting and aggregating the subgraphs that contributed most to the proper prediction category. Qualitative and quantitative experimental results show that the proposed IGCN-HPP outperforms the baseline model in terms of predictive performance.

Förderung

  • Zhejiang Provincial Natural Science Foundation of China
  • Zhejiang Provincial Visiting Engineer Project
  • Science and Technology Innovation Activity Plan for College Students in Zhejiang Province

Zitieren

APA

Yang, B., Hu, L., Peng, Y., Wang, T., Fang, X., Wang, L., & Fang, K. (2024). Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home. IEEE Transactions on Consumer Electronics, 70(1), 876-888. https://doi.org/10.1109/tce.2023.3303309

Vancouver

Yang B, Hu L, Peng Y, Wang T, Fang X, Wang L, et al. Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home. IEEE Transactions on Consumer Electronics. 2024;70(1):876-888. doi:10.1109/tce.2023.3303309

BibTeX
@article{Yang2024,
  author = {Yang, Boyu and Hu, Liyazhou and Peng, Yuyang and Wang, Tingting and Fang, Xiaofen and Wang, Lina and Fang, Kai},
  title = {Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2024},
  volume = {70},
  number = {1},
  pages = {876--888},
  doi = {10.1109/tce.2023.3303309}
}
Kostenlos starten →