Incentivizing distributive fairness for crowdsourcing workers

Chenxi Qiu, Anna Squicciarini, Benjamin Hanrahan

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    6 Scopus citations

    Abstract

    In a crowd market such as Amazon Mechanical Turk, the remuneration of Human Intelligence Tasks is determined by the requester, for which they are not given many cues to ascertain how to "fairly" pay their workers. Furthermore, the current methods for setting a price are mostly binary - in that, the worker either gets paid or not - as opposed to paying workers a "fair" wage based on the quality and utility of work completed. Instead, the price should better reflect the historical performance of the market and the requirements of the task. In this paper, we introduce a game theoretical model that takes into account a more balanced set of market parameters, and propose a pricing policy and a rating policy to incentivize requesters to offer "fair" compensation for crowdsourcing workers. We present our findings from applying and developing this model on real data gathered from workers on Amazon Mechanical Turk and simulations that we ran to validate our assumptions. Our simulation results also demonstrate that our policies motivate requesters to pay their workers more "fairly" compared with the payment set by the current market.

    Original languageEnglish (US)
    Title of host publication18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019
    PublisherInternational Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
    Pages404-412
    Number of pages9
    ISBN (Electronic)9781510892002
    StatePublished - 2019
    Event18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019 - Montreal, Canada
    Duration: May 13 2019May 17 2019

    Publication series

    NameProceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS
    Volume1
    ISSN (Print)1548-8403
    ISSN (Electronic)1558-2914

    Conference

    Conference18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019
    Country/TerritoryCanada
    CityMontreal
    Period5/13/195/17/19

    All Science Journal Classification (ASJC) codes

    • Artificial Intelligence
    • Software
    • Control and Systems Engineering

    Fingerprint

    Dive into the research topics of 'Incentivizing distributive fairness for crowdsourcing workers'. Together they form a unique fingerprint.

    Cite this