It has been found that representations learned by Deep Neural Networks (DNNs) correlate very well to neural responses measured in primates' brains and psychological representations exhibited by human similarity judgment. On another hand, past studies have shown that particular colors can be associated with specific emotion arousal in humans. Do deep neural networks also learn this behavior? In this study, we investigate if DNNs can learn implicit associations in stimuli, particularly, an emotion-color association between image stimuli. Our study was conducted in two parts. First, we collected human responses on a forced-choice decision task in which subjects were asked to select a color for a specified emotion-inducing image. Next, we modeled this decision task on neural networks using the similarity between deep representation (extracted using DNNs trained on object classification tasks) of the images and images of colors used in the task. We found that our model showed a fuzzy linear relationship between the two decision probabilities. This results in two interesting findings, 1. The representations learned by deep neural networks can indeed show an emotion-color association 2. The emotion-color association is not just random but involves some cognitive phenomena. Finally, we also show that this method can help us in the emotion classification task, specifically when there are very few examples to train the model. This analysis can be relevant to psychologists studying emotion-color associations and artificial intelligence researchers modeling emotional intelligence in machines or studying representations learned by deep neural networks.
翻译:发现深神经网络(Deep Neal Neal Networks) 所学的表述与灵长类大脑和人类相似性判断所显示的心理表现中测量的神经反应非常吻合。 另一方面,过去的研究表明,某些颜色可以与人类中特定的情感振奋感动相联系。 深神经网络也可以学习这种行为? 在这项研究中, 我们调查DNNs是否可以在刺激性中学习隐含的关联, 特别是图像模拟性之间的情感- 颜色关联。 我们的研究分两个部分进行。 首先, 我们收集了人类对强制选择决定性网络的反应, 要求对象为特定情感启发性图像选择一种颜色。 其次, 我们用对神经网络进行模拟决定性任务, 使用深度表现( 使用受目标分类训练的 DNNS ) 之间的相似性来进行这种行为? 我们发现, 我们的模型显示了两种决定性概率之间的模糊的线性模型关系。 我们通过两个有趣的发现, 1 由深神经网络所学的描述确实可以显示一种情感- 情感- 感官感官协会 显示一种情感- 。 最后, 情感- 也就是分析可以具体地显示, 这个方法是, 当我们学习时, 我们的情感- 分析是, 这个感官- 分析, 这个方法可以显示, 分析, 方法可以显示, 分析, 分析, 。