Videos have become a powerful tool for spreading illegal content such as military propaganda, revenge porn, or bullying through social networks. To counter these illegal activities, it has become essential to try new methods to verify the origin of videos from these platforms. However, collecting datasets large enough to train neural networks for this task has become difficult because of the privacy regulations that have been enacted in recent years. To mitigate this limitation, in this work we propose two different solutions based on transfer learning and multitask learning to determine whether a video has been uploaded from or downloaded to a specific social platform through the use of shared features with images trained on the same task. By transferring features from the shallowest to the deepest levels of the network from the image task to videos, we measure the amount of information shared between these two tasks. Then, we introduce a model based on multitask learning, which learns from both tasks simultaneously. The promising experimental results show, in particular, the effectiveness of the multitask approach. According to our knowledge, this is the first work that addresses the problem of social media platform identification of videos through the use of shared features.
翻译:视频已成为通过社交网络传播军事宣传、报复性色情或欺凌等非法内容的有力工具。为了打击这些非法活动,必须尝试新的方法来核查这些平台的视频来源。然而,由于近年来颁布的隐私条例,收集足以培训神经网络开展这项工作的大量数据集变得十分困难。为了减轻这一限制,我们在工作中提出了基于转让学习和多任务学习的两种不同的解决方案,以确定视频是否通过使用经过相同任务培训的图像从一个视频上传或下载到一个特定的社会平台。通过将图像任务从最浅的网络特征转移到最深层次的视频,我们衡量这两个任务之间共享的信息数量。然后,我们引入一个基于多任务学习的模式,同时学习这两个任务。有希望的实验结果显示,特别是多任务方法的有效性。据我们所知,这是解决社会媒体平台通过使用共享特征识别视频问题的第一个工作。