A recent research trend has emerged to identify developers' emotions, by applying sentiment analysis to the content of communication traces left in collaborative development environments. Trying to overcome the limitations posed by using off-the-shelf sentiment analysis tools, researchers recently started to develop their own tools for the software engineering domain. In this paper, we report a benchmark study to assess the performance and reliability of three sentiment analysis tools specifically customized for software engineering. Furthermore, we offer a reflection on the open challenges, as they emerge from a qualitative analysis of misclassified texts.
翻译:最近出现了一种研究趋势,通过对合作发展环境中遗留的通信痕迹内容进行情绪分析,确定开发商的情绪。为了克服使用现成情绪分析工具带来的限制,研究人员最近开始开发自己的软件工程领域工具。在本文中,我们报告了一项基准研究,以评估专门为软件工程定制的三种情绪分析工具的性能和可靠性。此外,我们还反思了公开的挑战,因为这些挑战来自对分类错误文本的质量分析。