We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.
翻译:我们研究无线边缘的图像检索问题,在无线边缘,一个边缘装置捕捉一个图像,然后用来从边缘服务器上检索类似图像。这些图像可以是同一人或在不同时间和地点从其他相机上取走的车辆的图像。我们的目标是在无线链接的电力和带宽限制下,最大限度地提高检索任务的准确性。由于基础应用程序的严格延迟限制,不可能以足够质量发送整个图像。我们建议了分别基于数字通信和模拟通信的两个替代方案。在数字方法中,我们首先提出一个深神经网络(DNN)辅助检索导向图像压缩方案,其输出位序列使用传统频道代码在频道上传输。在模拟联合源和频道编码(JSCC)方法中,特性矢量直接被映入频道符号。我们根据不同频道条件下的重新定位(re-ID)任务评估两种方案,包括静态和淡化的频道。我们显示,JSC方案大大提高了端到端的准确性,加快了编码进程,并且提供了优度降解的图像,通过模拟,通过不同的频道研究对不同的频道进行了评估。