As an important perceptual characteristic of the Human Visual System (HVS), the Just Noticeable Difference (JND) has been studied for decades with image and video processing (e.g., perceptual visual signal compression). However, there is little exploration on the existence of JND for the Deep Machine Vision (DMV), although the DMV has made great strides in many machine vision tasks. In this paper, we take an initial attempt, and demonstrate that the DMV has the JND, termed as the DMV-JND. We then propose a JND model for the image classification task in the DMV. It has been discovered that the DMV can tolerate distorted images with average PSNR of only 9.56dB (the lower the better), by generating JND via unsupervised learning with the proposed DMV-JND-NET. In particular, a semantic-guided redundancy assessment strategy is designed to restrain the magnitude and spatial distribution of the DMV-JND. Experimental results on image classification demonstrate that we successfully find the JND for deep machine vision. Our DMV-JND facilitates a possible direction for DMV-oriented image and video compression, watermarking, quality assessment, deep neural network security, and so on.
翻译:作为人类视觉系统(HVS)的一个重要概念特征,数十年来一直通过图像和视频处理(例如,视觉视觉信号压缩)来研究“可察觉差异”(JND),然而,虽然DMV在许多机器视觉任务方面迈出了很大步伐,但很少探索DMV是否存在DND用于深机视(DMV),尽管DMV在许多机视任务中取得了很大进步。在本文中,我们初步尝试,并表明DMV拥有称为DMV-JND的JND。我们随后为DMV的图像分类任务提出了一个JND模型。我们发现DMV能容忍被扭曲的图像,而PSNR的平均数仅为9.56DB(越低越好),通过与提议的DMV-JND-NET进行不受监督的学习来生成JND(DMV) 。特别是,一个以语义为指南的冗余评估战略旨在限制DMV-JND的大小和空间分布。关于图像分类的实验结果显示,我们成功地找到了DDD用于深水视的深部。我们的DMV-JNDDMV-ND可以对网络质量和摄像像像像进行深入评估。