Recent advancements in quantum computing have shown promising computational advantages in many problem areas. As one of those areas with increasing attention, hybrid quantum-classical machine learning systems have demonstrated the capability to solve various data-driven learning tasks. Recent works show that parameterized quantum circuits (PQCs) can be used to solve challenging reinforcement learning (RL) tasks with provable learning advantages. While existing works yield potentials of PQC-based methods, the design choices of PQC architectures and their influences on the learning tasks are generally underexplored. In this work, we introduce EQAS-PQC, an evolutionary quantum architecture search framework for PQC-based models, which uses a population-based genetic algorithm to evolve PQC architectures by exploring the search space of quantum operations. Experimental results show that our method can significantly improve the performance of hybrid quantum-classical models in solving benchmark reinforcement problems. We also model the probability distributions of quantum operations in top-performing architectures to identify essential design choices that are critical to the performance.
翻译:量子计算的最新进展在许多问题领域显示出了有希望的计算优势。作为关注程度不断提高的领域之一,混合量子古典机器学习系统展示了解决各种数据驱动学习任务的能力。最近的工程显示,参数化量子电路(PQCs)可以用来解决具有挑战性的增强学习任务,并具有可证实的学习优势。虽然现有工程产生基于质子计算方法的潜力,但基于质子计算方法的结构的设计选择及其对学习任务的影响一般都没有得到充分探讨。在这项工作中,我们引入了EQAS-PQC,即基于质子计算模型的进化量子结构搜索框架,即利用基于人口的遗传算法来通过探索量子操作的搜索空间来发展质子计算结构。实验结果表明,我们的方法可以显著改善基于量子模型的混合量子模型在解决基准增强问题方面的性能。我们还模拟了顶级结构中量子操作的概率分布,以确定对性能至关重要的基本设计选择。