When toxic online communities on mainstream platforms face moderation measures, such as bans, they may migrate to other platforms with laxer policies or set up their own dedicated websites. Previous work suggests that within mainstream platforms, community-level moderation is effective in mitigating the harm caused by the moderated communities. It is, however, unclear whether these results also hold when considering the broader Web ecosystem. Do toxic communities continue to grow in terms of their user base and activity on the new platforms? Do their members become more toxic and ideologically radicalized? In this paper, we report the results of a large-scale observational study of how problematic online communities progress following community-level moderation measures. We analyze data from r/The_Donald and r/Incels, two communities that were banned from Reddit and subsequently migrated to their own standalone websites. Our results suggest that, in both cases, moderation measures significantly decreased posting activity on the new platform, reducing the number of posts, active users, and newcomers. In spite of that, users in one of the studied communities (r/The_Donald) showed increases in signals associated with toxicity and radicalization, which justifies concerns that the reduction in activity may come at the expense of a more toxic and radical community. Overall, our results paint a nuanced portrait of the consequences of community-level moderation and can inform their design and deployment.
翻译:当主流平台上的有毒在线社区面临禁止等温和措施时,它们可能会迁移到具有宽松政策的其他平台,或者建立自己的专门网站。先前的工作表明,在主流平台内,社区一级的温和措施对于减轻受监管社区造成的伤害是有效的。然而,在考虑更广泛的网络生态系统时,尚不清楚这些结果是否同样有效。有毒社区是否在其用户基础和在新平台上的活动方面继续增长?其成员是否变得更加有毒和意识形态激进?在本文件中,我们报告了大规模观测研究的结果,研究社区一级温和措施之后,在线社区的进展有多么困难。我们分析了从r/The-Donald和r/Incels这两个被禁止重新编辑并随后迁移到自己独立网站的社区的数据。我们的结果表明,在这两种情况下,温和措施都大大减少了在新平台上张贴的活动,减少了职位、活跃用户和新人的数量。 尽管如此,在所研究的社区(r/The_Donald)的用户显示出与毒性和激进化措施有关的信号增加。我们从redald 和激进化程度来看,他们的社区在设计上可能降低其毒性和程度的后果。