EUVIMEDEUVIMED entdecken
Open Access

Merge-and-Split Graph Convolutional Network for Skeleton-Based Interaction Recognition

Haoqiang Wang iD, Yong Wang, Sheng Yan, Xin Du, Yuan Gao, Hong Liu

Cyborg and Bionic Systems · 2024-01 · 5

DOI: 10.34133/cbsystems.0102 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cyborg and Bionic Systems, online erschienen am 20.03.2024. Verfasst von Haoqiang Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We introduce an innovative approach to address a significant challenge in interaction recognition, specifically the capture of correlation features between different interaction body parts. These features are often overlooked by traditional graph convolution networks commonly used in interaction recognition tasks. Our solution, the Merge-and-Split Graph Convolutional Network, takes a unique perspective, treating interaction recognition as a global problem. It leverages a Merge-and-Split Graph structure to effectively capture dependencies between interaction body parts. To extract the essential interaction features, we introduce the Merge-and-Split Graph Convolution module, which seamlessly combines the Merge-and-Split Graph with Graph Convolutional Networks. This fusion enables the extraction of rich semantic information between adjacent joint points. In addition, we introduce a Short-term Dependence module designed to extract joint and motion characteristics specific to each type of interaction. Furthermore, to extract correlation features between different hierarchical sets, we present the Hierarchical Guided Attention Module. This module plays a crucial role in highlighting the relevant hierarchical sets that contain essential interaction information. The effectiveness of our proposed model is demonstrated by achieving state-of-the-art performance on 2 widely recognized datasets, namely, the NTU60 and NTU120 interaction datasets. Our model’s efficacy is rigorously validated through extensive experiments, and we have made the code available for the research community at https://github.com/wanghq05/MS-GCN/ .

Autor:innen und Institutionen

  • School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China.
  • Computing Sciences (CS), Faculty of Information Technology and Communication Sciences (ITC), Tampere University, Tampere, Finland.
  • Key Laboratory of Machine Perception, Shenzhen Graduate School, Peking University, Beijing, China.

ORCID-Profile: Haoqiang Wang

Zitieren

APA

Wang, H., Wang, Y., Yan, S., Du, X., Gao, Y., & Liu, H. (2024). Merge-and-Split Graph Convolutional Network for Skeleton-Based Interaction Recognition. Cyborg and Bionic Systems, 5. https://doi.org/10.34133/cbsystems.0102

Vancouver

Wang H, Wang Y, Yan S, Du X, Gao Y, Liu H. Merge-and-Split Graph Convolutional Network for Skeleton-Based Interaction Recognition. Cyborg and Bionic Systems. 2024;5. doi:10.34133/cbsystems.0102

BibTeX
@article{Wang2024,
  author = {Wang, Haoqiang and Wang, Yong and Yan, Sheng and Du, Xin and Gao, Yuan and Liu, Hong},
  title = {Merge-and-Split Graph Convolutional Network for Skeleton-Based Interaction Recognition},
  journal = {Cyborg and Bionic Systems},
  year = {2024},
  volume = {5},
  doi = {10.34133/cbsystems.0102}
}
Kostenlos starten →