The scale of Internet-connected systems has increased considerably, and these systems are being exposed to cyber attacks more than ever. The complexity and dynamics of cyber attacks require protecting mechanisms to be responsive, adaptive, and scalable. Machine learning, or more specifically deep reinforcement learning (DRL), methods have been proposed widely to address these issues. By incorporating deep learning into traditional RL, DRL is highly capable of solving complex, dynamic, and especially high-dimensional cyber defense problems. This paper presents a survey of DRL approaches developed for cyber security. We touch on different vital aspects, including DRL-based security methods for cyber-physical systems, autonomous intrusion detection techniques, and multiagent DRL-based game theory simulations for defense strategies against cyber attacks. Extensive discussions and future research directions on DRL-based cyber security are also given. We expect that this comprehensive review provides the foundations for and facilitates future studies on exploring the potential of emerging DRL to cope with increasingly complex cyber security problems.
翻译:互联网连通系统的规模大为扩大,这些系统比以往更加受到网络攻击的影响。网络攻击的复杂性和动态要求保护机制反应、适应性和可扩展性。机器学习,或更具体地说是深度强化学习(DRL),已经广泛提出了解决这些问题的方法。通过将深度学习纳入传统的RL,DRL非常能够解决复杂、动态、特别是高维的网络防御问题。本文介绍了为网络安全开发的DRL方法调查。我们触及了不同的重要方面,包括基于DRL的网络物理系统安全方法、自主入侵探测技术和多剂DRL的防御网络攻击战略游戏理论模拟。还就DRL的网络安全进行了广泛的讨论和今后的研究方向。我们期望这一全面审查将为探索新兴DRL应对日益复杂的网络安全问题的潜力奠定基础,并为今后的研究提供便利。