Opinion prediction is an emerging research area with diverse real-world applications, such as market research and situational awareness. We identify two lines of approaches to the problem of opinion prediction. One uses topic-based sentiment analysis with time-series modeling, while the other uses static embedding of text. The latter approaches seek user-specific solutions by generating user fingerprints. Such approaches are useful in predicting user's reactions to unseen content. In this work, we propose a novel dynamic fingerprinting method that leverages contextual embedding of user's comments conditioned on relevant user's reading history. We integrate BERT variants with a recurrent neural network to generate predictions. The results show up to 13\% improvement in micro F1-score compared to previous approaches. Experimental results show novel insights that were previously unknown such as better predictions for an increase in dynamic history length, the impact of the nature of the article on performance, thereby laying the foundation for further research.
翻译:意见预测是一个新兴的研究领域,具有多种现实应用,例如市场研究和情景意识。我们确定了两种观点预测问题的方法。一种是使用时间序列模型进行基于主题的情绪分析,另一种是使用静态嵌入文本。后者通过生成用户指纹寻求针对用户的解决方案。这种方法有助于预测用户对无形内容的反应。在这项工作中,我们提出了一个新的动态指纹鉴别方法,利用以相关用户阅读历史为条件的用户评论背景嵌入。我们将BERT变量与经常性神经网络结合,以产生预测。结果显示,与以往方法相比,微F1核心的改进达到13 ⁇ 。实验结果显示,以前从未见过的新的洞见,例如,对动态历史长度增加的更好预测,文章的性质对业绩的影响,从而为进一步研究打下基础。