The proliferation of radical online communities and their violent offshoots has sparked great societal concern. However, the current practice of banning such communities from mainstream platforms has unintended consequences: (I) the further radicalization of their members in fringe platforms where they migrate; and (ii) the spillover of harmful content from fringe back onto mainstream platforms. Here, in a large observational study on two banned subreddits, r/The\_Donald and r/fatpeoplehate, we examine how factors associated with the RECRO radicalization framework relate to users' migration decisions. Specifically, we quantify how these factors affect users' decisions to post on fringe platforms and, for those who do, whether they continue posting on the mainstream platform. Our results show that individual-level factors, those relating to the behavior of users, are associated with the decision to post on the fringe platform. Whereas social-level factors, users' connection with the radical community, only affect the propensity to be coactive on both platforms. Overall, our findings pave the way for evidence-based moderation policies, as the decisions to migrate and remain coactive amplify unintended consequences of community bans.
翻译:激进的在线社群及其暴力分支的激增引起了巨大的社会关注。然而,目前禁止这些社群进入主流平台的做法产生了意想不到的后果:(一) 其成员在他们移徙的边缘平台上进一步激进化;以及(二) 有害内容从边缘向主流平台蔓延。这里,在对两个被禁止的子编辑(r/The ⁇ Donald和r/fatpeopulhate)的大型观察研究中,我们研究了RECRO激进化框架的相关因素如何与用户的移民决定相关。具体地说,我们量化这些因素如何影响用户在边缘平台上发布的决定,以及对于是否在主流平台上继续发布的决定。我们的结果显示,个人层面的因素,即与用户行为有关的因素,与在边缘平台上发布的决定相关联。而社会层面的因素,用户与激进社群的联系,只影响两个平台上互动的倾向。总体而言,我们的调查结果为基于证据的温和政策铺平了道路,因为决定是迁移和继续积极扩大社区禁令的意外后果。