Loading...
Please wait, while we are loading the content...
Whole and Part Adaptive Fusion Graph Convolutional Networks for Skeleton-Based Action Recognition
Content Provider | MDPI |
---|---|
Author | Zuo, Qi Zou, Lian Fan, Cien Li, Dongqian Jiang, Hao Liu, Yifeng |
Copyright Year | 2020 |
Description | Spatiotemporal graph convolution has made significant progress in skeleton-based action recognition in recent years. Most of the existing graph convolution methods take all the joints of the human skeleton as the overall modeling graph, ignoring the differences in the movement patterns of various parts of the human, and cannot well connect the relationship between the different parts of the human skeleton. To capture the unique features of different parts of human skeleton data and the correlation of different parts, we propose two new graph convolution methods: the whole graph convolution network (WGCN) and the part graph convolution network (PGCN). WGCN learns the whole scale skeleton spatiotemporal features according to the movement patterns and physical structure of the human skeleton. PGCN divides the human skeleton graph into several subgraphs to learn the part scale spatiotemporal features. Moreover, we propose an adaptive fusion module that combines the two features for multiple complementary adaptive fusion to obtain more effective skeleton features. By coupling these proposals, we build a whole and part adaptive fusion graph convolution neural network (WPGCN) that outperforms previous state-of-the-art methods on three large-scale datasets: NTU RGB+D 60, NTU RGB+D 120, and Kinetics Skeleton 400. |
Starting Page | 7149 |
e-ISSN | 14248220 |
DOI | 10.3390/s20247149 |
Journal | Sensors |
Issue Number | 24 |
Volume Number | 20 |
Language | English |
Publisher | MDPI |
Publisher Date | 2020-12-13 |
Access Restriction | Open |
Subject Keyword | Sensors Artificial Intelligence Whole and Part Adaptive Fusion Graph Convolutional Network Skeleton-based Human Action Recognition |
Content Type | Text |
Resource Type | Article |