We introduce OLIVAW, an AI Othello player adopting the design principles of the famous AlphaGo programs. The main motivation behind OLIVAW was to attain exceptional competence in a non-trivial board game at a tiny fraction of the cost of its illustrious predecessors. In this paper, we show how the AlphaGo Zero's paradigm can be successfully applied to the popular game of Othello using only commodity hardware and free cloud services. While being simpler than Chess or Go, Othello maintains a considerable search space and difficulty in evaluating board positions. To achieve this result, OLIVAW implements some improvements inspired by recent works to accelerate the standard AlphaGo Zero learning process. The main modification implies doubling the positions collected per game during the training phase, by including also positions not played but largely explored by the agent. We tested the strength of OLIVAW in three different ways: by pitting it against Edax, the strongest open-source Othello engine, by playing anonymous games on the web platform OthelloQuest, and finally in two in-person matches against top-notch human players: a national champion and a former world champion.
翻译:我们引入了AI Othello球员的OLIVAW, 采用著名的AlphaGo方案的设计原则。 OLIVAW的主要动机是,以其杰出前辈的一小部分成本,在非三重棋盘游戏中获得特殊能力。 在本文中,我们展示了AlphaGo Zero的范式如何仅使用商品硬件和免费云服务成功地应用于流行的Othello游戏。Othello在比Ches或Go更简单的同时,在评估董事会位置方面保持了相当大的搜索空间和困难。为了实现这一结果,OLIVAW在近期工作的基础上进行了一些改进,以加速标准AlphaGo Zero学习进程。主要修改意味着在培训阶段将每场比赛所收集的职位翻一番,其中也包括没有发挥但基本上由代理人探索的职位。 我们用三种不同的方式测试了OLVAW的实力:通过在网络平台Othello最强的开放源引擎与Edax(最强的开放源Othello引擎),在Othello Quest上玩匿名游戏,最后是两次人与顶尖牌人对顶人的比赛。