In edge computing, suppressing data size is a challenge for machine learning models that perform complex tasks such as autonomous driving, in which computational resources (speed, memory size and power) are limited. Efficient lossy compression of matrix data has been introduced by decomposing it into the product of an integer and real matrices. However, its optimisation is difficult as it requires simultaneous optimisation of an integer and real variables. In this paper, we improve this optimisation by utilising recently developed black-box optimisation (BBO) algorithms with an Ising solver for integer variables. In addition, the algorithm can be used to solve mixed-integer programming problems that are linear and non-linear in terms of real and integer variables, respectively. The differences between the choice of Ising solvers (simulated annealing (SA), quantum annealing (QA) and simulated quenching (SQ)) and the strategies of the BBO algorithms (BOCS, FMQA and their variations) are discussed for further development of the BBO techniques.
翻译:在边缘计算中,抑制数据大小是执行诸如自动驱动等复杂任务的机器学习模型的一项挑战,在这种模型中,计算资源(速度、内存大小和功率)有限。矩阵数据通过将其分解成一个整数和真实矩阵的产物而引入了有效的损耗压缩矩阵数据。然而,它的优化是困难的,因为它需要同时优化一个整数和真实变量。在本文中,我们通过利用最近开发的黑箱优化算法(BBBO)来改进这种优化,并使用一个Ising求解器来解决整数变量。此外,还可利用算法来解决在实际变量和整数变量方面线性和非线性混合整数编程的编程问题。为了进一步发展BBO技术,正在讨论Ising解决器的选择(模拟肛射(SA)、量Annealing(QA)和模拟排气(SQQ)与BBO算法(BOCS、FQA及其变式)之间的差别。