The detection of state-sponsored trolls acting in information operations is an unsolved and critical challenge for the research community, with repercussions that go beyond the online realm. In this paper, we propose a novel AI-based solution for the detection of state-sponsored troll accounts, which consists of two steps. The first step aims at classifying trajectories of accounts' online activities as belonging to either a state-sponsored troll or to an organic user account. In the second step, we exploit the classified trajectories to compute a metric, namely "troll score", which allows us to quantify the extent to which an account behaves like a state-sponsored troll. As a study case, we consider the troll accounts involved in the Russian interference campaign during the 2016 US Presidential election, identified as Russian trolls by the US Congress. Experimental results show that our approach identifies accounts' trajectories with an AUC close to 99\% and, accordingly, classify Russian trolls and organic users with an AUC of 97\%. Finally, we evaluate whether the proposed solution can be generalized to different contexts (e.g., discussions about Covid-19) and generic misbehaving users, showing promising results that will be further expanded in our future endeavors.
翻译:在信息操作中发现国家赞助的巨怪是研究界尚未解决的关键挑战,其影响范围超越了在线领域。在本文中,我们提出了一个基于AI的新解决方案,以探测国家赞助的巨怪账户,由两步组成。第一步的目的是将账户在线活动的轨迹归类为属于国家赞助的巨魔或有机用户账户。在第二步中,我们利用分类的轨迹来计算一个指标,即“分数 ”,这使我们能够量化一个账户行为像国家赞助的巨魔的程度。作为一个研究案例,我们考虑2016年美国总统选举期间俄罗斯干预运动所涉及的巨魔账户,被美国国会确定为俄罗斯巨魔。实验结果显示,我们的方法确定了账户的轨迹,该账户的轨迹接近99 ⁇,因此将俄罗斯巨魔和有机用户分类为97 ⁇ 。最后,我们评估了拟议的解决办法能否在不同的环境中(例如,关于Covid-19的讨论,将会进一步显示我们未来的目标)和普通的错误结果。