Should social media platforms intervene when communities repeatedly break rules? What actions can they consider? In light of this hotly debated issue, platforms have begun experimenting with softer alternatives to outright bans. We examine one such intervention called quarantining, that impedes direct access to and promotion of controversial communities. Specifically, we present two case studies of what happened when Reddit quarantined the influential communities r/TheRedPill (TRP) and r/The_Donald (TD). Working with over 85M Reddit posts, we apply causal inference methods to examine the quarantine's effects on TRP and TD. We find that the quarantine made it more difficult to recruit new members: new user influx to TRP and TD decreased by 79.5% and 58%, respectively. Despite quarantining, existing users' misogyny and racism levels remained unaffected. We conclude by reflecting on the effectiveness of this design friction in limiting the influence of toxic communities and discuss broader implications for content moderation.
翻译:社会媒体平台在社群一再违反规则时应该干预吗? 他们可以考虑什么行动? 面对这个激烈争论的问题,平台已经开始尝试更软的替代彻底禁止的替代方案。 我们检查了一种被称为“检疫”的干预,它阻碍直接接触和推动有争议的社群。 具体地说,我们对Reddid隔离有影响力的社群r/TheredPill(TRP)和r/The_Donald(TD)时发生的情况进行了两个案例研究。 我们与超过85M Redddit 站一起,运用因果推论方法来检查检疫对TRP和TD的影响。 我们发现,这种隔离使得招募新成员更加困难:新的用户流入TRP和TD分别减少了79.5%和58%。 尽管存在检疫,但现有用户的厌恶情绪和种族主义程度仍然没有受到影响。 我们最后通过思考这种设计摩擦在限制有毒社群的影响方面的效果,并讨论对内容调适的更广泛影响。