Skeleton based recognition systems are gaining popularity and machine learning models focusing on points or joints in a skeleton have proved to be computationally effective and application in many areas like Robotics. It is easy to track points and thereby preserving spatial and temporal information, which plays an important role in abstracting the required information, classification becomes an easy task. In this paper, we aim to study these points but using a cloud mechanism, where we define a cloud as collection of points. However, when we add temporal information, it may not be possible to retrieve the coordinates of a point in each frame and hence instead of focusing on a single point, we can use k-neighbors to retrieve the state of the point under discussion. Our focus is to gather such information using weight sharing but making sure that when we try to retrieve the information from neighbors, we do not carry noise with it. LSTM which has capability of long-term modelling and can carry both temporal and spatial information. In this article we tried to summarise graph based gesture recognition method.
翻译:基于Skeleton的识别系统越来越受欢迎,而侧重于骨骼中的点或关节的机器学习模式在计算上被证明是有效的,并且适用于机器人等许多领域。很容易跟踪点,从而保存空间和时间信息,这些信息在提取所需信息方面起着重要作用。分类是一项容易的任务。在本文中,我们的目标是研究这些点,但使用云机制,我们把云定义为点的集合。然而,当我们添加时间信息时,可能无法检索每个框架中的点的坐标,因此,我们不用只关注一个点,就可以使用 k 邻居来检索讨论点的状态。我们的重点是利用权重共享来收集此类信息,但确保当我们试图从邻居那里检索信息时,我们不携带噪音。LSTM具有长期建模能力,可以携带时间和空间信息。在文章中,我们试图对基于图形的手势识别方法进行总结。