使用基于 Seleton 的键框架选择模块识别手势识别 (Gesture Recognition with a Skeleton-Based Keyframe Selection Module)

We propose a bidirectional consecutively connected two-pathway network (BCCN) for efficient gesture recognition. The BCCN consists of two pathways: (i) a keyframe pathway and (ii) a temporal-attention pathway. The keyframe pathway is configured using the skeleton-based keyframe selection module. Keyframes pass through the pathway to extract the spatial feature of itself, and the temporal-attention pathway extracts temporal semantics. Our model improved gesture recognition performance in videos and obtained better activation maps for spatial and temporal properties. Tests were performed on the Chalearn dataset, the ETRI-Activity 3D dataset, and the Toyota Smart Home dataset.

翻译：我们建议双向相连接双向双向双向双向双向双向双向路径网络(BCCN),以进行有效的手势识别。 BCCN由两条路径组成:(一) 键盘路径和(二) 时间关注路径。键盘路径使用基于骨架的键盘选择模块配置。键盘路经过路径以提取自身空间特征,而时间关注路径提取时间语义。我们的模型改善了视频中的动作识别性能,并获得了更好的空间和时间属性激活图。在Chalearn数据集、 ETRI-Actionivity 3D数据集和丰田智能家数据集上进行了测试。