Multi-agent market simulation is commonly used to create an environment for downstream machine learning or reinforcement learning tasks, such as training or testing trading strategies before deploying them to real-time trading. In electronic trading markets only the price or volume time series, that result from interaction of multiple market participants, are typically directly observable. Therefore, multi-agent market environments need to be calibrated so that the time series that result from interaction of simulated agents resemble historical -- which amounts to solving a highly complex large-scale optimization problem. In this paper, we propose a simple and efficient framework for calibrating multi-agent market simulator parameters from historical time series observations. First, we consider a novel concept of eligibility set to bypass the potential non-identifiability issue. Second, we generalize the two-sample Kolmogorov-Smirnov (K-S) test with Bonferroni correction to test the similarity between two high-dimensional time series distributions, which gives a simple yet effective distance metric between the time series sample sets. Third, we suggest using Bayesian optimization (BO) and trust-region BO (TuRBO) to minimize the aforementioned distance metric. Finally, we demonstrate the efficiency of our framework using numerical experiments.
翻译:多试剂市场模拟通常用于为下游机器学习或强化学习任务创造一个环境,例如培训或测试贸易战略,然后将其部署到实时交易。在电子交易市场中,通常只能直接观察多市场参与者相互作用产生的价格或体积时间序列。因此,需要调整多试剂市场环境,使模拟剂相互作用所产生的时间序列与历史相似 -- -- 相当于解决高度复杂的大规模优化问题。在本文中,我们提出了一个简单而有效的框架,用于校准历史时间序列观测的多试剂市场模拟参数。首先,我们考虑一个新的资格概念,以绕过潜在的不可识别性问题。第二,我们笼统地推广了与Bonferroni(K-S)的双模模版测试,以测试两个高维时间序列分布之间的相似性,从而在时间序列各组之间提供一个简单而有效的距离测量标准。第三,我们建议使用Bayesian优化(BO)和信任区域BO(TuRBO),以尽量减少上述距离框架。最后,我们用数字框架来展示我们的效率实验。