State-of-the-art performance for many emerging edge applications is achieved by deep neural networks (DNNs). Often, the employed DNNs are location- and time-dependent, and the parameters of a specific DNN must be delivered from an edge server to the edge device rapidly and efficiently to carry out time-sensitive inference tasks. This can be considered as a joint source-channel coding (JSCC) problem, in which the goal is not to recover the DNN coefficients with the minimal distortion, but in a manner that provides the highest accuracy in the downstream task. For this purpose we introduce AirNet, a novel training and analog transmission method to deliver DNNs over the air. We first train the DNN with noise injection to counter the wireless channel noise. We also employ pruning to identify the most significant DNN parameters that can be delivered within the available channel bandwidth, knowledge distillation, and non-linear bandwidth expansion to provide better error protection for the most important network parameters. We show that AirNet achieves significantly higher test accuracy compared to the separation-based alternative, and exhibits graceful degradation with channel quality.
翻译:许多新兴边缘应用的最新性能是通过深神经网络(DNN)实现的。 受雇的DNN通常是基于位置和时间的,而特定的DNN的参数必须迅速、高效地从边缘服务器传送到边缘装置,以便执行时间敏感的推理任务。 这可被视为一个联合源-通道编码问题,其目标是不以微小扭曲恢复DNN系数,但以提供下游任务最高精确度的方式。为此目的,我们引入AirNet,这是一种新颖的培训和模拟传输方法,用来在空中运送DNNN。我们首先用噪音注入训练DNNNN,以对抗无线频道的噪音。我们还使用喷射仪,以确定在现有频道带宽、知识蒸馏和非线性带宽扩展中可以提供的最重要DNN参数,以便为最重要的网络参数提供更好的错误保护。 我们表明,ANet比分离替代参数的测试精度要高得多,并显示频道质量的优劣性降解。