Realizing the potential of neural video codecs on mobile devices is a big technological challenge due to the computational complexity of deep networks and the power-constrained mobile hardware. We demonstrate practical feasibility by leveraging Qualcomm's technology and innovation, bridging the gap from neural network-based codec simulations running on wall-powered workstations, to real-time operation on a mobile device powered by Snapdragon technology. We show the first-ever inter-frame neural video decoder running on a commercial mobile phone, decoding high-definition videos in real-time while maintaining a low bitrate and high visual quality.
翻译:实现移动设备上神经视频编码器的潜力是一项巨大的技术挑战,因为深层网络和受电源限制的移动硬件的计算复杂。 我们通过利用Qalcomm的技术和创新,缩小墙动力工作站上以神经网络为基础的编码模拟器与由Scaddragon技术驱动的移动设备实时操作之间的差距,展示了有史以来首次在商业移动电话上运行的跨机神经视频解码器,实时解码高清晰度视频,同时保持低位位元和高视觉质量。