We propose an evolutionary computation method for an adversarial attack on the length and thickness of parts of legged robots by deep reinforcement learning. This attack changes the robot body shape and interferes with walking-we call the attacked body as adversarial body shape. The evolutionary computation method searches adversarial body shape by minimizing the expected cumulative reward earned through walking simulation. To evaluate the effectiveness of the proposed method, we perform experiments with three-legged robots, Walker2d, Ant-v2, and Humanoid-v2 in OpenAI Gym. The experimental results reveal that Walker2d and Ant-v2 are more vulnerable to the attack on the length than the thickness of the body parts, whereas Humanoid-v2 is vulnerable to the attack on both of the length and thickness. We further identify that the adversarial body shapes break left-right symmetry or shift the center of gravity of the legged robots. Finding adversarial body shape can be used to proactively diagnose the vulnerability of legged robot walking.
翻译:我们建议采用进化计算方法,通过深加学习,对腿部机器人的长度和厚度进行对抗性攻击。这次攻击改变机器人身体的形状,并干扰我们把被攻击的身体称为对抗性身体的形状。进化计算方法通过尽量减少通过步行模拟获得的预期累积报酬,对对抗性身体形状进行搜索。为了评价拟议方法的有效性,我们在OpenAI Gym对三腿机器人Walker2d、Ant-v2和Humanoid-v2进行了实验。实验结果表明,Walker2d和Ant-v2比身体部分的厚度更容易受到攻击,而人类-v2则易受长度和厚度两方面的攻击。我们进一步确定,对抗性身体的形状是折断左翼对称或改变腿部机器人的重心。可以使用对抗性身体形状来主动判断脚部机器人行走的脆弱性。