Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home
IEEE Transactions on Consumer Electronics · 2024-02 · 70 (1) · 876-888
DOI: 10.1109/tce.2023.3303309 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-02. Verfasst von Boyu Yang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: Zhejiang Provincial Natural Science Foundation of China, Zhejiang Provincial Visiting Engineer Project, Science and Technology Innovation Activity Plan for College Students in Zhejiang Province.
Abstract (Originalsprache)
Recently, Human Pose Prediction (HPP) using image frames captured by cameras has been widely used in the smart home sector. Combining deep learning vision processing with HPP and using the Graph Convolutional Network (GCN) to extract temporal and spatial features of human actions has achieved satisfactory accuracy. However, there is still a lack of sufficient interpretability to translate theoretical findings into human-centric consumer applications. In this paper, a novel Interpretable GCN-based HPP (IGCN-HPP) model is proposed to address the above problem. Specifically, a multi-layer spatio-temporal convolution is first constructed to capture the depth features in human action data for prediction. Secondly, a GCN Explainer is proposed to assist in model training. When pre-processed graphics frames are fed into the GCN model, it generates various subgraphs. What’s more, using Shapley values from game theory and specific graph rules to assess each subgraph’s contribution to HPP, the neighborhood relationships between subgraphs and among nodes are estimated with the contribution optimization algorithm (COA). The reasonable interpretation of the predicted human pose is obtained by extracting and aggregating the subgraphs that contributed most to the proper prediction category. Qualitative and quantitative experimental results show that the proposed IGCN-HPP outperforms the baseline model in terms of predictive performance.
Förderung
- Zhejiang Provincial Natural Science Foundation of China
- Zhejiang Provincial Visiting Engineer Project
- Science and Technology Innovation Activity Plan for College Students in Zhejiang Province
Zitieren
APA
Yang, B., Hu, L., Peng, Y., Wang, T., Fang, X., Wang, L., & Fang, K. (2024). Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home. IEEE Transactions on Consumer Electronics, 70(1), 876-888. https://doi.org/10.1109/tce.2023.3303309
Vancouver
Yang B, Hu L, Peng Y, Wang T, Fang X, Wang L, et al. Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home. IEEE Transactions on Consumer Electronics. 2024;70(1):876-888. doi:10.1109/tce.2023.3303309
BibTeX
@article{Yang2024,
author = {Yang, Boyu and Hu, Liyazhou and Peng, Yuyang and Wang, Tingting and Fang, Xiaofen and Wang, Lina and Fang, Kai},
title = {Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home},
journal = {IEEE Transactions on Consumer Electronics},
year = {2024},
volume = {70},
number = {1},
pages = {876--888},
doi = {10.1109/tce.2023.3303309}
}
EUVIMED