The detection of state-sponsored trolls acting in information operations is an unsolved and critical challenge for the research community, with repercussions that go beyond the online realm. In this paper, we propose a novel AI-based solution for the detection of state-sponsored troll accounts, which consists of two steps. The first step aims at classifying trajectories of accounts' online activities as belonging to either a state-sponsored troll or to an organic user account. In the second step, we exploit the classified trajectories to compute a metric, namely "troll score", which allows us to quantify the extent to which an account behaves like a state-sponsored troll. As a study case, we consider the troll accounts involved in the Russian interference campaign during the 2016 US Presidential election, identified as Russian trolls by the US Congress. Experimental results show that our approach identifies accounts' trajectories with an AUC close to 99% and, accordingly, classify Russian trolls and organic users with an AUC of 90%. Finally, we evaluate whether the proposed solution can be generalized to different contexts (e.g., discussions about Covid-19) and generic misbehaving users, showing promising results that will be further expanded in our future endeavors.
翻译:在信息操作中发现国家赞助的巨怪,对于研究界来说,这是一个尚未解决的、至关重要的挑战,其影响超越了在线领域。在本文中,我们提出了一个基于AI的新解决方案,以探测国家赞助的巨怪账户,由两步组成。第一步的目的是将账户在线活动的轨迹归类为属于国家赞助的巨魔或有机用户账户。在第二步,我们利用分类的轨迹来计算一个量度,即“分数 ”, 从而使我们能够量化一个账户行为像国家赞助的巨魔。作为一个研究案例,我们考虑2016年美国总统选举期间俄罗斯干预运动所涉及的巨魔账户,被美国国会确定为俄罗斯巨魔。实验结果显示,我们的方法确定了账户的轨迹,其AUC接近99 %,因此,将俄罗斯巨魔和有机用户分类为90 %。最后,我们评估拟议的解决办法能否被概括为不同背景(例如,关于Covid-19的讨论),以及将进一步显示我们未来目标用户的前景。