We study the problem of deep joint source-channel coding (D-JSCC) for correlated image sources, where each source is transmitted through a noisy independent channel to the common receiver. In particular, we consider a pair of images captured by two cameras with probably overlapping fields of view transmitted over wireless channels and reconstructed in the center node. The challenging problem involves designing a practical code to utilize both source and channel correlations to improve transmission efficiency without additional transmission overhead. To tackle this, we need to consider the common information across two stereo images as well as the differences between two transmission channels. In this case, we propose a deep neural networks solution that includes lightweight edge encoders and a powerful center decoder. Besides, in the decoder, we propose a novel channel state information aware cross attention module to highlight the overlapping fields and leverage the relevance between two noisy feature maps.Our results show the impressive improvement of reconstruction quality in both links by exploiting the noisy representations of the other link. Moreover, the proposed scheme shows competitive results compared to the separated schemes with capacity-achieving channel codes.
翻译:我们研究了相关图像源的深层联合源-通道编码(D-JSCC)问题,每个源是通过一个吵闹的独立频道传送给普通接收器的。特别是,我们考虑两个摄像头摄取的一副图像,这些图像可能通过无线频道传输并重建到中节点,其视野领域可能重叠。挑战问题涉及设计一个实用代码,利用源和信道的关联来提高传输效率,而不增加传输管理费用。要解决这个问题,我们需要考虑两个立体图像的共同信息以及两个传输渠道之间的差异。在这种情况下,我们提出一个深层神经网络解决方案,其中包括轻量边缘编码器和一个强大的中心解码器。此外,在解码器中,我们建议建立一个新的频道国家信息,注意交叉关注模块,以突出重叠的字段并利用两幅噪音地貌图的相关性。我们的研究结果表明,通过利用其他链接的噪音表达方式,两个链接的重建质量都有了令人印象深刻的改善。此外,拟议的计划显示与配有能力生成频道代码的分离计划相比,具有竞争性的结果。