Transfer learning is one of the subjects undergoing intense study in the area of machine learning. In object recognition and object detection there are known experiments for the transferability of parameters, but not for neural networks which are suitable for object-detection in real time embedded applications, such as the SqueezeDet neural network. We use transfer learning to accelerate the training of SqueezeDet to a new group of classes. Also, experiments are conducted to study the transferability and co-adaptation phenomena introduced by the transfer learning process. To accelerate training, we propose a new implementation of the SqueezeDet training which provides a faster pipeline for data processing and achieves $1.8$ times speedup compared to the initial implementation. Finally, we created a mechanism for automatic hyperparamer optimization using an empirical method.
翻译:转移学习是在机器学习领域进行密集研究的主题之一。在物体识别和物体探测方面,已知有参数可转移的实验,但不适用于适合实时内嵌应用中天体探测的神经网络,例如SqueezeDet神经网络。我们利用转移学习来加速对SquezeDet的训练,以至新的班级。此外,还进行了实验来研究转移学习过程带来的可转移性和共同适应性现象。为了加速培训,我们提议重新实施SqueezeDet培训,为数据处理提供一条更快的管道,并实现与初步实施相比1.8美元的加速时间。最后,我们建立了使用经验方法自动超分解优化的机制。