We consider a simple form of pricing for a crowdsourcing system, where pricing policy is published a priori, and workers then decide their task acceptance. Such a pricing form is widely adopted in practice for its simplicity, e.g., Amazon Mechanical Turk, although additional sophistication to pricing rule can enhance budget efficiency. With the goal of designing efficient and simple pricing rules, we study the impact of the following two design features in pricing policies: (i) personalization tailoring policy worker-by-worker and (ii) bonus payment to qualified task completion. In the Bayesian setting, where the only prior distribution of workers' profiles is available, we first study the Price of Agnosticism (PoA) that quantifies the utility gap between personalized and common pricing policies. We show that PoA is bounded within a constant factor under some mild conditions, and the impact of bonus is essential in common pricing. These analytic results imply that complex personalized pricing can be replaced by simple common pricing once it is equipped with a proper bonus payment. To provide insights on efficient common pricing, we then study the efficient mechanisms of bonus payment for several profile distribution regimes which may exist in practice. We provide primitive experiments on Amazon Mechanical Turk, which support our analytical findings.
翻译:我们考虑的是众包系统的简单定价形式,即定价政策先行公布,然后由工人决定接受任务。这种定价形式在实践中被广泛采用,因为其简单性,例如亚马逊机械土耳其公司,尽管定价规则的更精细性可以提高预算效率。为了设计高效和简单的定价规则,我们研究了定价政策中以下两个设计特点的影响:(一) 个人化,逐个调整政策工作人员,和(二) 为完成符合资格的任务支付奖金。在巴伊西亚环境下,只有事先分发工人简历,我们首先研究量化个人化和共同定价政策之间的效用差距的Agnotisticis(PoA)价格(PoA)价格。我们表明,在某种温和的条件下,《PoA》与一个不变的因素联系在一起,而奖金的影响在共同定价政策中至关重要。这些分析结果意味着,复杂的个人化定价一旦具备适当的奖金支付条件,就可以被简单通用的定价所取代。为了了解高效的共同定价,我们然后研究几个配置分配制度的高效的奖金支付机制。我们提供了可能存在的亚马孙系统分析结果。我们提供了一些原始的亚马孙试验。